Oct 20 10:07:51 user nova-compute[74311]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74311) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 10:07:51 user nova-compute[74311]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74311) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 10:07:51 user nova-compute[74311]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74311) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 10:07:51 user nova-compute[74311]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 20 10:07:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:07:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:07:52 user nova-compute[74311]: INFO nova.virt.driver [None req-de316bef-6844-448a-944c-ab744d43b749 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 20 10:07:52 user nova-compute[74311]: INFO nova.compute.provider_config [None req-de316bef-6844-448a-944c-ab744d43b749 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-de316bef-6844-448a-944c-ab744d43b749 None None] Acquiring lock "singleton_lock" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-de316bef-6844-448a-944c-ab744d43b749 None None] Acquired lock "singleton_lock" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-de316bef-6844-448a-944c-ab744d43b749 None None] Releasing lock "singleton_lock" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] Full set of CONF: {{(pid=74311) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ******************************************************************************** {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] Configuration options gathered from: {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ================================================================================ {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] allow_resize_to_same_host      = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] arq_binding_timeout            = 300 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] backdoor_port                  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] backdoor_socket                = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] block_device_allocate_retries  = 300 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] block_device_allocate_retries_interval = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cert                           = self.pem {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] compute_monitors               = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] config_dir                     = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] config_drive_format            = iso9660 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] config_source                  = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] console_host                   = user {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] control_exchange               = nova {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cpu_allocation_ratio           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] daemon                         = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] debug                          = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] default_access_ip_network_name = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] default_availability_zone      = nova {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] default_ephemeral_format       = ext4 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] default_green_pool_size        = 1000 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] default_schedule_zone          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] disk_allocation_ratio          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] enable_new_services            = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] enabled_ssl_apis               = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] flat_injected                  = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] force_config_drive             = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] force_raw_images               = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] graceful_shutdown_timeout      = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] heal_instance_info_cache_interval = 60 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] host                           = user {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] instance_build_timeout         = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] instance_delete_interval       = 300 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] instance_name_template         = instance-%08x {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] instance_usage_audit           = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] instance_usage_audit_period    = month {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] internal_service_availability_zone = internal {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] key                            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] live_migration_retry_count     = 30 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] log_config_append              = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] log_dir                        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] log_file                       = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] log_options                    = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] log_rotate_interval            = 1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] log_rotate_interval_type       = days {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] log_rotation_type              = none {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] long_rpc_timeout               = 1800 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] max_concurrent_builds          = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] max_concurrent_live_migrations = 1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] max_concurrent_snapshots       = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] max_local_block_devices        = 3 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] max_logfile_count              = 30 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] max_logfile_size_mb            = 200 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] maximum_instance_delete_attempts = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] metadata_listen                = 0.0.0.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] metadata_listen_port           = 8775 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] metadata_workers               = 3 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] migrate_max_retries            = -1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] mkisofs_cmd                    = genisoimage {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] my_ip                          = 10.0.0.210 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] network_allocate_retries       = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] osapi_compute_listen_port      = 8774 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] osapi_compute_unique_server_name_scope =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] osapi_compute_workers          = 3 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] password_length                = 12 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] periodic_enable                = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] periodic_fuzzy_delay           = 60 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] pointer_model                  = ps2mouse {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] preallocate_images             = none {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] publish_errors                 = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] pybasedir                      = /opt/stack/nova {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ram_allocation_ratio           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] rate_limit_burst               = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] rate_limit_except_level        = CRITICAL {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] rate_limit_interval            = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] reboot_timeout                 = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] reclaim_instance_interval      = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] record                         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] reimage_timeout_per_gb         = 60 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] report_interval                = 120 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] rescue_timeout                 = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] reserved_host_cpus             = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] reserved_host_disk_mb          = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] reserved_host_memory_mb        = 512 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] reserved_huge_pages            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] resize_confirm_window          = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] resize_fs_using_block_device   = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] resume_guests_state_on_host_boot = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] rpc_response_timeout           = 60 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] run_external_periodic_tasks    = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] running_deleted_instance_action = reap {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] running_deleted_instance_timeout = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] scheduler_instance_sync_interval = 120 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] service_down_time              = 720 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] servicegroup_driver            = db {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] shelved_offload_time           = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] shelved_poll_interval          = 3600 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] shutdown_timeout               = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] source_is_ipv6                 = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ssl_only                       = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] state_path                     = /opt/stack/data/nova {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] sync_power_state_interval      = 600 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] sync_power_state_pool_size     = 1000 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] syslog_log_facility            = LOG_USER {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] tempdir                        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] timeout_nbd                    = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] transport_url                  = **** {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] update_resources_interval      = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] use_cow_images                 = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] use_eventlog                   = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] use_journal                    = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] use_json                       = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] use_rootwrap_daemon            = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] use_stderr                     = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] use_syslog                     = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vcpu_pin_set                   = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vif_plugging_is_fatal          = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vif_plugging_timeout           = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] virt_mkfs                      = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] volume_usage_poll_interval     = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] watch_log_file                 = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] web                            = /usr/share/spice-html5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_concurrency.disable_process_locking = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.auth_strategy              = keystone {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.compute_link_prefix        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.dhcp_domain                = novalocal {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.enable_instance_password   = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.glance_link_prefix         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.instance_list_per_project_cells = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.list_records_by_skipping_down_cells = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.local_metadata_per_cell    = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.max_limit                  = 1000 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.metadata_cache_expiration  = 15 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.neutron_default_tenant_id  = default {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.use_forwarded_for          = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.use_neutron_default_nets   = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.vendordata_dynamic_targets = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.vendordata_jsonfile_path   = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.backend_argument         = **** {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.config_prefix            = cache.oslo {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.dead_timeout             = 60.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.debug_cache_backend      = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.enable_retry_client      = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.enable_socket_keepalive  = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.enabled                  = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.expiration_time          = 600 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.hashclient_retry_attempts = 2 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.memcache_dead_retry      = 300 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.memcache_password        =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.memcache_sasl_enabled    = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.memcache_username        =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.proxies                  = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.retry_attempts           = 2 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.retry_delay              = 0.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.socket_keepalive_count   = 1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.socket_keepalive_idle    = 1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.socket_keepalive_interval = 1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.tls_allowed_ciphers      = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.tls_cafile               = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.tls_certfile             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.tls_enabled              = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cache.tls_keyfile              = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.auth_section            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.auth_type               = password {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.cafile                  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.certfile                = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.collect_timing          = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.cross_az_attach         = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.debug                   = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.endpoint_template       = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.http_retries            = 3 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.insecure                = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.keyfile                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.os_region_name          = RegionOne {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.split_loggers           = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cinder.timeout                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] compute.cpu_dedicated_set      = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] compute.cpu_shared_set         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] compute.image_type_exclude_list = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] compute.resource_provider_association_refresh = 300 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] compute.shutdown_retry_interval = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] conductor.workers              = 3 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] console.allowed_origins        = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] console.ssl_ciphers            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] console.ssl_minimum_version    = default {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] consoleauth.token_ttl          = 600 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.cafile                  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.certfile                = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.collect_timing          = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.connect_retries         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.connect_retry_delay     = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.endpoint_override       = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.insecure                = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.keyfile                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.max_version             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.min_version             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.region_name             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.service_name            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.service_type            = accelerator {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.split_loggers           = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.status_code_retries     = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.status_code_retry_delay = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.timeout                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] cyborg.version                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.backend               = sqlalchemy {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.connection            = **** {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.connection_debug      = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.connection_parameters =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.connection_recycle_time = 3600 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.connection_trace      = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.db_inc_retry_interval = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.db_max_retries        = 20 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.db_max_retry_interval = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.db_retry_interval     = 1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.max_overflow          = 50 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.max_pool_size         = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.max_retries           = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.mysql_wsrep_sync_wait = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.pool_timeout          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.retry_interval        = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.slave_connection      = **** {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] database.sqlite_synchronous    = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.backend           = sqlalchemy {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.connection        = **** {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.connection_debug  = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.connection_parameters =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.connection_recycle_time = 3600 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.connection_trace  = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.db_inc_retry_interval = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.db_max_retries    = 20 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.db_max_retry_interval = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.db_retry_interval = 1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.max_overflow      = 50 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.max_pool_size     = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.max_retries       = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.pool_timeout      = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.retry_interval    = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.slave_connection  = **** {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] api_database.sqlite_synchronous = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] devices.enabled_mdev_types     = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ephemeral_storage_encryption.enabled = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.api_servers             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.cafile                  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.certfile                = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.collect_timing          = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.connect_retries         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.connect_retry_delay     = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.debug                   = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.default_trusted_certificate_ids = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.enable_certificate_validation = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.enable_rbd_download     = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.endpoint_override       = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.insecure                = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.keyfile                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.max_version             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.min_version             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.num_retries             = 3 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.rbd_ceph_conf           =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.rbd_connect_timeout     = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.rbd_pool                =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.rbd_user                =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.region_name             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.service_name            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.service_type            = image {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.split_loggers           = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.status_code_retries     = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.status_code_retry_delay = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.timeout                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.verify_glance_signatures = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] glance.version                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] guestfs.debug                  = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.config_drive_cdrom      = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.config_drive_inject_password = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.enable_remotefx         = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.instances_path_share    =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.limit_cpu_features      = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.use_multipath_io        = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.vswitch_name            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] mks.enabled                    = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] image_cache.manager_interval   = 2400 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] image_cache.precache_concurrency = 1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] image_cache.remove_unused_base_images = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] image_cache.subdirectory_name  = _base {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.api_max_retries         = 60 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.api_retry_interval      = 2 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.auth_section            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.auth_type               = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.cafile                  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.certfile                = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.collect_timing          = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.conductor_group         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.connect_retries         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.connect_retry_delay     = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.endpoint_override       = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.insecure                = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.keyfile                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.max_version             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.min_version             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.peer_list               = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.region_name             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.serial_console_state_timeout = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.service_name            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.service_type            = baremetal {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.split_loggers           = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.status_code_retries     = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.status_code_retry_delay = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.timeout                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ironic.version                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] key_manager.fixed_key          = **** {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.barbican_api_version  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.barbican_endpoint     = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.barbican_endpoint_type = public {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.barbican_region_name  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.cafile                = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.certfile              = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.collect_timing        = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.insecure              = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.keyfile               = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.number_of_retries     = 60 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.retry_delay           = 1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.send_service_user_token = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.split_loggers         = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.timeout               = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.verify_ssl            = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican.verify_ssl_path       = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican_service_user.auth_section = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican_service_user.auth_type = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican_service_user.cafile   = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican_service_user.certfile = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican_service_user.collect_timing = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican_service_user.insecure = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican_service_user.keyfile  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican_service_user.split_loggers = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] barbican_service_user.timeout  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.approle_role_id          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.approle_secret_id        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.cafile                   = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.certfile                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.collect_timing           = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.insecure                 = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.keyfile                  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.kv_mountpoint            = secret {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.kv_path                  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.kv_version               = 2 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.namespace                = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.root_token_id            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.split_loggers            = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.ssl_ca_crt_file          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.timeout                  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.use_ssl                  = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.auth_section          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.auth_type             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.cafile                = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.certfile              = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.collect_timing        = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.connect_retries       = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.connect_retry_delay   = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.endpoint_override     = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.insecure              = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.keyfile               = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.max_version           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.min_version           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.region_name           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.service_name          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.service_type          = identity {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.split_loggers         = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.status_code_retries   = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.status_code_retry_delay = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.timeout               = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] keystone.version               = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.connection_uri         =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.cpu_mode               = custom {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: WARNING oslo_config.cfg [None req-de316bef-6844-448a-944c-ab744d43b749 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.cpu_power_governor_high = performance {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.cpu_power_management   = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.device_detach_attempts = 8 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.device_detach_timeout  = 20 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.disk_cachemodes        = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.disk_prefix            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.enabled_perf_events    = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.file_backed_memory     = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.gid_maps               = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.hw_disk_discard        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.hw_machine_type        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.images_rbd_pool        = rbd {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.images_type            = default {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.images_volume_group    = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.inject_key             = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.inject_partition       = -2 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.inject_password        = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.iscsi_iface            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.iser_use_multipath     = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.live_migration_downtime = 500 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.live_migration_inbound_addr = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.live_migration_scheme  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.live_migration_timeout_action = abort {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.live_migration_tunnelled = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: WARNING oslo_config.cfg [None req-de316bef-6844-448a-944c-ab744d43b749 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 20 10:07:52 user nova-compute[74311]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 20 10:07:52 user nova-compute[74311]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 20 10:07:52 user nova-compute[74311]: and ``live_migration_inbound_addr`` respectively.
Oct 20 10:07:52 user nova-compute[74311]: ).  Its value may be silently ignored in the future.
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.live_migration_with_native_tls = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.max_queues             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.nfs_mount_options      = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.num_pcie_ports         = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.pmem_namespaces        = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.quobyte_client_cfg     = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.rbd_secret_uuid        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.rbd_user               = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.rescue_image_id        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.rescue_kernel_id       = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.rx_queue_size          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.smbfs_mount_options    =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.snapshot_compression   = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.snapshot_image_format  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.sparse_logical_volumes = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.swtpm_enabled          = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.swtpm_group            = tss {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.swtpm_user             = tss {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.sysinfo_serial         = unique {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.tb_cache_size          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.tx_queue_size          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.uid_maps               = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.use_virtio_for_bridges = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.virt_type              = kvm {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.volume_clear           = zero {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.volume_clear_size      = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.volume_use_multipath   = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.vzstorage_cache_path   = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.auth_section           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.auth_type              = password {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.cafile                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.certfile               = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.collect_timing         = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.connect_retries        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.connect_retry_delay    = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.default_floating_pool  = public {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.endpoint_override      = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.extension_sync_interval = 600 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.http_retries           = 3 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.insecure               = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.keyfile                = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.max_version            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.min_version            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.ovs_bridge             = br-int {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.physnets               = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.region_name            = RegionOne {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.service_metadata_proxy = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.service_name           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.service_type           = network {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.split_loggers          = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.status_code_retries    = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.status_code_retry_delay = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.timeout                = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] neutron.version                = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] notifications.bdms_in_notifications = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] notifications.default_level    = INFO {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] notifications.notification_format = unversioned {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] notifications.notify_on_state_change = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] pci.alias                      = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] pci.device_spec                = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] pci.report_in_placement        = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.auth_section         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.auth_type            = password {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.cafile               = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.certfile             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.collect_timing       = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.connect_retries      = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.connect_retry_delay  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.default_domain_id    = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.default_domain_name  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.domain_id            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.domain_name          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.endpoint_override    = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.insecure             = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.keyfile              = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.max_version          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.min_version          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.password             = **** {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.project_domain_id    = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.project_domain_name  = Default {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.project_id           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.project_name         = service {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.region_name          = RegionOne {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.service_name         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.service_type         = placement {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.split_loggers        = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.status_code_retries  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.status_code_retry_delay = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.system_scope         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.timeout              = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.trust_id             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.user_domain_id       = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.user_domain_name     = Default {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.user_id              = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.username             = placement {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] placement.version              = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] quota.cores                    = 20 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] quota.count_usage_from_placement = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] quota.injected_file_content_bytes = 10240 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] quota.injected_file_path_length = 255 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] quota.injected_files           = 5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] quota.instances                = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] quota.key_pairs                = 100 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] quota.metadata_items           = 128 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] quota.ram                      = 51200 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] quota.recheck_quota            = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] quota.server_group_members     = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] quota.server_groups            = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] rdp.enabled                    = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] scheduler.image_metadata_prefilter = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] scheduler.max_attempts         = 3 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] scheduler.max_placement_results = 1000 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] scheduler.workers              = 3 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.host_subset_size = 1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.isolated_hosts = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.isolated_images = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.pci_in_placement = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.track_instance_changes = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] metrics.required               = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] metrics.weight_multiplier      = 1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] metrics.weight_setting         = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] serial_console.enabled         = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] serial_console.port_range      = 10000:20000 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] serial_console.serialproxy_port = 6083 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] service_user.auth_section      = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] service_user.auth_type         = password {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] service_user.cafile            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] service_user.certfile          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] service_user.collect_timing    = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] service_user.insecure          = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] service_user.keyfile           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] service_user.send_service_user_token = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] service_user.split_loggers     = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] service_user.timeout           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] spice.agent_enabled            = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] spice.enabled                  = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] spice.html5proxy_port          = 6082 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] spice.image_compression        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] spice.jpeg_compression         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] spice.playback_compression     = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] spice.server_listen            = 127.0.0.1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] spice.streaming_mode           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] spice.zlib_compression         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] upgrade_levels.baseapi         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] upgrade_levels.cert            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] upgrade_levels.compute         = auto {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] upgrade_levels.conductor       = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] upgrade_levels.scheduler       = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vendordata_dynamic_auth.cafile = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vendordata_dynamic_auth.certfile = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vendordata_dynamic_auth.insecure = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vendordata_dynamic_auth.timeout = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.api_retry_count         = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.ca_file                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.cache_prefix            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.cluster_name            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.connection_pool_size    = 10 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.console_delay_seconds   = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.datastore_regex         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.host_ip                 = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.host_password           = **** {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.host_port               = 443 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.host_username           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.insecure                = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.integration_bridge      = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.maximum_objects         = 100 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.pbm_default_policy      = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.pbm_enabled             = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.pbm_wsdl_location       = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.serial_port_proxy_uri   = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.serial_port_service_uri = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.task_poll_interval      = 0.5 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.use_linked_clone        = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.vnc_keymap              = en-us {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.vnc_port                = 5900 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vmware.vnc_port_total          = 10000 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vnc.auth_schemes               = ['none'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vnc.enabled                    = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vnc.novncproxy_port            = 6080 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vnc.vencrypt_ca_certs          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vnc.vencrypt_client_cert       = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vnc.vencrypt_client_key        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.disable_rootwrap   = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.enable_numa_live_migration = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.libvirt_disable_apic = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] wsgi.client_socket_timeout     = 900 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] wsgi.default_pool_size         = 1000 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] wsgi.keep_alive                = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] wsgi.max_header_line           = 16384 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] wsgi.ssl_ca_file               = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] wsgi.ssl_cert_file             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] wsgi.ssl_key_file              = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] wsgi.tcp_keepidle              = 600 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] zvm.ca_file                    = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] zvm.cloud_connector_url        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] zvm.reachable_timeout          = 300 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_policy.enforce_new_defaults = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_policy.enforce_scope      = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_policy.policy_default_rule = default {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] profiler.connection_string     = messaging:// {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] profiler.enabled               = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] profiler.es_doc_type           = notification {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] profiler.es_scroll_size        = 10000 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] profiler.es_scroll_time        = 2m {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] profiler.filter_error_trace    = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] profiler.hmac_keys             = **** {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] profiler.sentinel_service_name = mymaster {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] profiler.socket_timeout        = 0.1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] profiler.trace_requests        = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] profiler.trace_sqlalchemy      = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] profiler_jaeger.process_tags   = {} {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] profiler_jaeger.service_name_prefix = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] profiler_otlp.service_name_prefix = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] remote_debug.host              = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] remote_debug.port              = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_notifications.retry = -1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.auth_section        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.auth_type           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.cafile              = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.certfile            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.collect_timing      = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.connect_retries     = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.connect_retry_delay = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.endpoint_id         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.endpoint_override   = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.insecure            = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.keyfile             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.max_version         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.min_version         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.region_name         = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.service_name        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.service_type        = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.split_loggers       = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.status_code_retries = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.status_code_retry_delay = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.timeout             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.valid_interfaces    = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_limit.version             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_reports.file_event_handler = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] oslo_reports.log_dir           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vif_plug_ovs_privileged.group  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] vif_plug_ovs_privileged.user   = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_ovs.isolate_vif         = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] os_brick.lock_path             = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] privsep_osbrick.capabilities   = [21] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] privsep_osbrick.group          = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] privsep_osbrick.helper_command = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] privsep_osbrick.user           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] nova_sys_admin.group           = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] nova_sys_admin.helper_command  = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] nova_sys_admin.user            = None {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG oslo_service.service [None req-de316bef-6844-448a-944c-ab744d43b749 None None] ******************************************************************************** {{(pid=74311) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 20 10:07:52 user nova-compute[74311]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 20 10:07:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Connecting to libvirt: qemu:///system {{(pid=74311) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fb1ac552440> {{(pid=74311) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 20 10:07:52 user nova-compute[74311]: libvirt:  error : internal error: could not initialize domain event timer
Oct 20 10:07:52 user nova-compute[74311]: WARNING nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 20 10:07:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fb1ac552440> {{(pid=74311) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Starting native event thread {{(pid=74311) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Starting green dispatch thread {{(pid=74311) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 20 10:07:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Starting connection event dispatch thread {{(pid=74311) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 20 10:07:52 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Connection event '1' reason 'None'
Oct 20 10:07:52 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 10:07:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.mount [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Initialising _HostMountState generation 0 {{(pid=74311) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 20 10:07:59 user nova-compute[74311]: INFO nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Libvirt host capabilities <capabilities>
Oct 20 10:07:59 user nova-compute[74311]:   <host>
Oct 20 10:07:59 user nova-compute[74311]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 20 10:07:59 user nova-compute[74311]:     <cpu>
Oct 20 10:07:59 user nova-compute[74311]:       <arch>x86_64</arch>
Oct 20 10:07:59 user nova-compute[74311]:       <model>IvyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <vendor>Intel</vendor>
Oct 20 10:07:59 user nova-compute[74311]:       <microcode version='1070'/>
Oct 20 10:07:59 user nova-compute[74311]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 20 10:07:59 user nova-compute[74311]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature name='ss'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature name='vmx'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature name='pcid'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature name='osxsave'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature name='hypervisor'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature name='arat'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature name='tsc_adjust'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature name='md-clear'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature name='stibp'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature name='arch-capabilities'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature name='ssbd'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature name='invtsc'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature name='rsba'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature name='skip-l1dfl-vmentry'/>
Oct 20 10:07:59 user nova-compute[74311]:       <pages unit='KiB' size='4'/>
Oct 20 10:07:59 user nova-compute[74311]:       <pages unit='KiB' size='2048'/>
Oct 20 10:07:59 user nova-compute[74311]:     </cpu>
Oct 20 10:07:59 user nova-compute[74311]:     <power_management>
Oct 20 10:07:59 user nova-compute[74311]:       <suspend_mem/>
Oct 20 10:07:59 user nova-compute[74311]:       <suspend_disk/>
Oct 20 10:07:59 user nova-compute[74311]:       <suspend_hybrid/>
Oct 20 10:07:59 user nova-compute[74311]:     </power_management>
Oct 20 10:07:59 user nova-compute[74311]:     <iommu support='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     <migration_features>
Oct 20 10:07:59 user nova-compute[74311]:       <live/>
Oct 20 10:07:59 user nova-compute[74311]:       <uri_transports>
Oct 20 10:07:59 user nova-compute[74311]:         <uri_transport>tcp</uri_transport>
Oct 20 10:07:59 user nova-compute[74311]:         <uri_transport>rdma</uri_transport>
Oct 20 10:07:59 user nova-compute[74311]:       </uri_transports>
Oct 20 10:07:59 user nova-compute[74311]:     </migration_features>
Oct 20 10:07:59 user nova-compute[74311]:     <topology>
Oct 20 10:07:59 user nova-compute[74311]:       <cells num='2'>
Oct 20 10:07:59 user nova-compute[74311]:         <cell id='0'>
Oct 20 10:07:59 user nova-compute[74311]:           <memory unit='KiB'>8140616</memory>
Oct 20 10:07:59 user nova-compute[74311]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 20 10:07:59 user nova-compute[74311]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 10:07:59 user nova-compute[74311]:           <distances>
Oct 20 10:07:59 user nova-compute[74311]:             <sibling id='0' value='10'/>
Oct 20 10:07:59 user nova-compute[74311]:             <sibling id='1' value='20'/>
Oct 20 10:07:59 user nova-compute[74311]:           </distances>
Oct 20 10:07:59 user nova-compute[74311]:           <cpus num='6'>
Oct 20 10:07:59 user nova-compute[74311]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 20 10:07:59 user nova-compute[74311]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 20 10:07:59 user nova-compute[74311]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 20 10:07:59 user nova-compute[74311]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 20 10:07:59 user nova-compute[74311]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 20 10:07:59 user nova-compute[74311]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 20 10:07:59 user nova-compute[74311]:           </cpus>
Oct 20 10:07:59 user nova-compute[74311]:         </cell>
Oct 20 10:07:59 user nova-compute[74311]:         <cell id='1'>
Oct 20 10:07:59 user nova-compute[74311]:           <memory unit='KiB'>8255068</memory>
Oct 20 10:07:59 user nova-compute[74311]:           <pages unit='KiB' size='4'>2063767</pages>
Oct 20 10:07:59 user nova-compute[74311]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 10:07:59 user nova-compute[74311]:           <distances>
Oct 20 10:07:59 user nova-compute[74311]:             <sibling id='0' value='20'/>
Oct 20 10:07:59 user nova-compute[74311]:             <sibling id='1' value='10'/>
Oct 20 10:07:59 user nova-compute[74311]:           </distances>
Oct 20 10:07:59 user nova-compute[74311]:           <cpus num='6'>
Oct 20 10:07:59 user nova-compute[74311]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 20 10:07:59 user nova-compute[74311]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 20 10:07:59 user nova-compute[74311]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 20 10:07:59 user nova-compute[74311]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 20 10:07:59 user nova-compute[74311]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 20 10:07:59 user nova-compute[74311]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 20 10:07:59 user nova-compute[74311]:           </cpus>
Oct 20 10:07:59 user nova-compute[74311]:         </cell>
Oct 20 10:07:59 user nova-compute[74311]:       </cells>
Oct 20 10:07:59 user nova-compute[74311]:     </topology>
Oct 20 10:07:59 user nova-compute[74311]:     <cache>
Oct 20 10:07:59 user nova-compute[74311]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 20 10:07:59 user nova-compute[74311]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 20 10:07:59 user nova-compute[74311]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 20 10:07:59 user nova-compute[74311]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 20 10:07:59 user nova-compute[74311]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 20 10:07:59 user nova-compute[74311]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 20 10:07:59 user nova-compute[74311]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 20 10:07:59 user nova-compute[74311]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 20 10:07:59 user nova-compute[74311]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 20 10:07:59 user nova-compute[74311]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 20 10:07:59 user nova-compute[74311]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 20 10:07:59 user nova-compute[74311]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 20 10:07:59 user nova-compute[74311]:     </cache>
Oct 20 10:07:59 user nova-compute[74311]:     <secmodel>
Oct 20 10:07:59 user nova-compute[74311]:       <model>apparmor</model>
Oct 20 10:07:59 user nova-compute[74311]:       <doi>0</doi>
Oct 20 10:07:59 user nova-compute[74311]:     </secmodel>
Oct 20 10:07:59 user nova-compute[74311]:     <secmodel>
Oct 20 10:07:59 user nova-compute[74311]:       <model>dac</model>
Oct 20 10:07:59 user nova-compute[74311]:       <doi>0</doi>
Oct 20 10:07:59 user nova-compute[74311]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 20 10:07:59 user nova-compute[74311]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 20 10:07:59 user nova-compute[74311]:     </secmodel>
Oct 20 10:07:59 user nova-compute[74311]:   </host>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='alpha'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>64</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>clipper</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='armv6l'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>spitz</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>nuri</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>kzm</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sx1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>z2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>tosa</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>n810</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>n800</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>terrier</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>midway</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>microbit</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>verdex</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>highbank</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>akita</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>connex</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>collie</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='armv7l'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>spitz</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>nuri</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>kzm</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sx1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>z2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>tosa</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>n810</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>n800</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>terrier</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>midway</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>microbit</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>verdex</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>highbank</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>akita</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>connex</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>collie</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='aarch64'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>64</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>spitz</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>nuri</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>kzm</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sx1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>z2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>tosa</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>n810</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>n800</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>terrier</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>midway</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>microbit</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>verdex</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>raspi3b</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>highbank</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>akita</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>connex</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>collie</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <acpi default='on' toggle='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='cris'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='i686'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>isapc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>microvm</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='kvm'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <pae/>
Oct 20 10:07:59 user nova-compute[74311]:       <nonpae/>
Oct 20 10:07:59 user nova-compute[74311]:       <acpi default='on' toggle='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:       <apic default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='m68k'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>an5206</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>q800</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>next-cube</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='microblaze'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='microblazeel'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='mips'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='16'>malta</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='mipsel'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='16'>malta</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='mips64'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>64</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='16'>malta</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>pica61</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>magnum</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='mips64el'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>64</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='16'>malta</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>pica61</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>magnum</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='16'>boston</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='ppc'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mac99</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>40p</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>taihu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='ppc64'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>64</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>taihu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>40p</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mac99</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='ppc64le'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>64</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>taihu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>40p</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>mac99</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='riscv32'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='8'>spike</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>opentitan</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='8'>virt</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='riscv64'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>64</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='8'>spike</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>shakti_c</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='8'>virt</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='s390x'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>64</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='sh4'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>shix</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>r2d</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='sh4eb'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>64</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>shix</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>r2d</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='sparc'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>SS-5</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>SS-20</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>LX</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>SS-4</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>SS-10</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>Voyager</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='sparc64'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>64</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sun4u</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>niagara</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>sun4v</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='x86_64'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>64</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='1'>isapc</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>microvm</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='kvm'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <acpi default='on' toggle='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:       <apic default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='xtensa'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>sim</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>kc705</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>ml605</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>virt</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>lx200</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>lx60</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]:   <guest>
Oct 20 10:07:59 user nova-compute[74311]:     <os_type>hvm</os_type>
Oct 20 10:07:59 user nova-compute[74311]:     <arch name='xtensaeb'>
Oct 20 10:07:59 user nova-compute[74311]:       <wordsize>32</wordsize>
Oct 20 10:07:59 user nova-compute[74311]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='4'>sim</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>kc705</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>ml605</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>virt</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>lx200</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>lx60</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 10:07:59 user nova-compute[74311]:       <domain type='qemu'/>
Oct 20 10:07:59 user nova-compute[74311]:     </arch>
Oct 20 10:07:59 user nova-compute[74311]:     <features>
Oct 20 10:07:59 user nova-compute[74311]:       <cpuselection/>
Oct 20 10:07:59 user nova-compute[74311]:       <deviceboot/>
Oct 20 10:07:59 user nova-compute[74311]:       <disksnapshot default='on' toggle='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     </features>
Oct 20 10:07:59 user nova-compute[74311]:   </guest>
Oct 20 10:07:59 user nova-compute[74311]: </capabilities>
Oct 20 10:07:59 user nova-compute[74311]: 
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 20 10:07:59 user nova-compute[74311]: <domainCapabilities>
Oct 20 10:07:59 user nova-compute[74311]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 10:07:59 user nova-compute[74311]:   <domain>kvm</domain>
Oct 20 10:07:59 user nova-compute[74311]:   <machine>pc-q35-6.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:   <arch>i686</arch>
Oct 20 10:07:59 user nova-compute[74311]:   <vcpu max='288'/>
Oct 20 10:07:59 user nova-compute[74311]:   <iothreads supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:   <os supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:     <enum name='firmware'/>
Oct 20 10:07:59 user nova-compute[74311]:     <loader supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>rom</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>pflash</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='readonly'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>yes</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>no</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='secure'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>no</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </loader>
Oct 20 10:07:59 user nova-compute[74311]:   </os>
Oct 20 10:07:59 user nova-compute[74311]:   <cpu>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='host-passthrough' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='hostPassthroughMigratable'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>off</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='maximum' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='maximumMigratable'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>on</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>off</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='host-model' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <vendor>Intel</vendor>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ss'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='vmx'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='pcid'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='hypervisor'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='arat'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='umip'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='md-clear'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='stibp'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ssbd'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ibpb'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ibrs'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='amd-stibp'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='erms'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='lm'/>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='custom' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>qemu64</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>qemu32</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>phenom</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium3</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium2</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>n270</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>kvm64</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>kvm32</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>coreduo</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>core2duo</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>athlon</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Westmere</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Snowridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>SandyBridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Penryn</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G5</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G4</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G3</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G2</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G1</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Nehalem</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>IvyBridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Icelake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-Rome</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-Milan</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Dhyana</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cooperlake</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Conroe</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>486</model>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:   </cpu>
Oct 20 10:07:59 user nova-compute[74311]:   <memoryBacking supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:     <enum name='sourceType'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>file</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>anonymous</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>memfd</value>
Oct 20 10:07:59 user nova-compute[74311]:     </enum>
Oct 20 10:07:59 user nova-compute[74311]:   </memoryBacking>
Oct 20 10:07:59 user nova-compute[74311]:   <devices>
Oct 20 10:07:59 user nova-compute[74311]:     <disk supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='diskDevice'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>disk</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>cdrom</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>floppy</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>lun</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='bus'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>fdc</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>sata</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </disk>
Oct 20 10:07:59 user nova-compute[74311]:     <graphics supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>sdl</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vnc</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>spice</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>egl-headless</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </graphics>
Oct 20 10:07:59 user nova-compute[74311]:     <video supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='modelType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vga</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>cirrus</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vmvga</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>qxl</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>none</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>bochs</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>ramfb</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </video>
Oct 20 10:07:59 user nova-compute[74311]:     <hostdev supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='mode'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>subsystem</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='startupPolicy'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>default</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>mandatory</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>requisite</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>optional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='subsysType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>pci</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='capsType'/>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='pciBackend'/>
Oct 20 10:07:59 user nova-compute[74311]:     </hostdev>
Oct 20 10:07:59 user nova-compute[74311]:     <rng supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>random</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>egd</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>builtin</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </rng>
Oct 20 10:07:59 user nova-compute[74311]:     <filesystem supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='driverType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>path</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>handle</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtiofs</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </filesystem>
Oct 20 10:07:59 user nova-compute[74311]:     <tpm supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>tpm-tis</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>tpm-crb</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>passthrough</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>emulator</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </tpm>
Oct 20 10:07:59 user nova-compute[74311]:   </devices>
Oct 20 10:07:59 user nova-compute[74311]:   <features>
Oct 20 10:07:59 user nova-compute[74311]:     <gic supported='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     <vmcoreinfo supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <genid supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <backingStoreInput supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <backup supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <sev supported='no'/>
Oct 20 10:07:59 user nova-compute[74311]:   </features>
Oct 20 10:07:59 user nova-compute[74311]: </domainCapabilities>
Oct 20 10:07:59 user nova-compute[74311]:  {{(pid=74311) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 20 10:07:59 user nova-compute[74311]: <domainCapabilities>
Oct 20 10:07:59 user nova-compute[74311]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 10:07:59 user nova-compute[74311]:   <domain>kvm</domain>
Oct 20 10:07:59 user nova-compute[74311]:   <machine>pc-i440fx-jammy</machine>
Oct 20 10:07:59 user nova-compute[74311]:   <arch>i686</arch>
Oct 20 10:07:59 user nova-compute[74311]:   <vcpu max='255'/>
Oct 20 10:07:59 user nova-compute[74311]:   <iothreads supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:   <os supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:     <enum name='firmware'/>
Oct 20 10:07:59 user nova-compute[74311]:     <loader supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>rom</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>pflash</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='readonly'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>yes</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>no</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='secure'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>no</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </loader>
Oct 20 10:07:59 user nova-compute[74311]:   </os>
Oct 20 10:07:59 user nova-compute[74311]:   <cpu>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='host-passthrough' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='hostPassthroughMigratable'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>off</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='maximum' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='maximumMigratable'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>on</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>off</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='host-model' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <vendor>Intel</vendor>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ss'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='vmx'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='pcid'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='hypervisor'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='arat'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='umip'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='md-clear'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='stibp'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ssbd'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ibpb'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ibrs'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='amd-stibp'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='erms'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='lm'/>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='custom' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>qemu64</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>qemu32</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>phenom</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium3</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium2</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>n270</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>kvm64</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>kvm32</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>coreduo</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>core2duo</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>athlon</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Westmere</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Snowridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>SandyBridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Penryn</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G5</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G4</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G3</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G2</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G1</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Nehalem</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>IvyBridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Icelake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-Rome</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-Milan</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Dhyana</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cooperlake</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Conroe</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>486</model>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:   </cpu>
Oct 20 10:07:59 user nova-compute[74311]:   <memoryBacking supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:     <enum name='sourceType'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>file</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>anonymous</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>memfd</value>
Oct 20 10:07:59 user nova-compute[74311]:     </enum>
Oct 20 10:07:59 user nova-compute[74311]:   </memoryBacking>
Oct 20 10:07:59 user nova-compute[74311]:   <devices>
Oct 20 10:07:59 user nova-compute[74311]:     <disk supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='diskDevice'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>disk</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>cdrom</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>floppy</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>lun</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='bus'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>ide</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>fdc</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>sata</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </disk>
Oct 20 10:07:59 user nova-compute[74311]:     <graphics supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>sdl</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vnc</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>spice</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>egl-headless</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </graphics>
Oct 20 10:07:59 user nova-compute[74311]:     <video supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='modelType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vga</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>cirrus</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vmvga</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>qxl</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>none</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>bochs</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>ramfb</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </video>
Oct 20 10:07:59 user nova-compute[74311]:     <hostdev supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='mode'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>subsystem</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='startupPolicy'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>default</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>mandatory</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>requisite</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>optional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='subsysType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>pci</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='capsType'/>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='pciBackend'/>
Oct 20 10:07:59 user nova-compute[74311]:     </hostdev>
Oct 20 10:07:59 user nova-compute[74311]:     <rng supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>random</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>egd</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>builtin</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </rng>
Oct 20 10:07:59 user nova-compute[74311]:     <filesystem supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='driverType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>path</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>handle</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtiofs</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </filesystem>
Oct 20 10:07:59 user nova-compute[74311]:     <tpm supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>tpm-tis</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>tpm-crb</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>passthrough</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>emulator</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </tpm>
Oct 20 10:07:59 user nova-compute[74311]:   </devices>
Oct 20 10:07:59 user nova-compute[74311]:   <features>
Oct 20 10:07:59 user nova-compute[74311]:     <gic supported='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     <vmcoreinfo supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <genid supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <backingStoreInput supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <backup supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <sev supported='no'/>
Oct 20 10:07:59 user nova-compute[74311]:   </features>
Oct 20 10:07:59 user nova-compute[74311]: </domainCapabilities>
Oct 20 10:07:59 user nova-compute[74311]:  {{(pid=74311) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 20 10:07:59 user nova-compute[74311]: <domainCapabilities>
Oct 20 10:07:59 user nova-compute[74311]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 10:07:59 user nova-compute[74311]:   <domain>kvm</domain>
Oct 20 10:07:59 user nova-compute[74311]:   <machine>pc-q35-jammy</machine>
Oct 20 10:07:59 user nova-compute[74311]:   <arch>i686</arch>
Oct 20 10:07:59 user nova-compute[74311]:   <vcpu max='288'/>
Oct 20 10:07:59 user nova-compute[74311]:   <iothreads supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:   <os supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:     <enum name='firmware'/>
Oct 20 10:07:59 user nova-compute[74311]:     <loader supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>rom</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>pflash</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='readonly'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>yes</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>no</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='secure'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>no</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </loader>
Oct 20 10:07:59 user nova-compute[74311]:   </os>
Oct 20 10:07:59 user nova-compute[74311]:   <cpu>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='host-passthrough' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='hostPassthroughMigratable'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>off</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='maximum' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='maximumMigratable'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>on</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>off</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='host-model' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <vendor>Intel</vendor>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ss'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='vmx'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='pcid'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='hypervisor'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='arat'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='umip'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='md-clear'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='stibp'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ssbd'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ibpb'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ibrs'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='amd-stibp'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='erms'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='lm'/>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='custom' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>qemu64</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>qemu32</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>phenom</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium3</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium2</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>n270</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>kvm64</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>kvm32</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>coreduo</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>core2duo</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>athlon</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Westmere</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Snowridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>SandyBridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Penryn</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G5</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G4</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G3</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G2</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G1</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Nehalem</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>IvyBridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Icelake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-Rome</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-Milan</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Dhyana</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cooperlake</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Conroe</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>486</model>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:   </cpu>
Oct 20 10:07:59 user nova-compute[74311]:   <memoryBacking supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:     <enum name='sourceType'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>file</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>anonymous</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>memfd</value>
Oct 20 10:07:59 user nova-compute[74311]:     </enum>
Oct 20 10:07:59 user nova-compute[74311]:   </memoryBacking>
Oct 20 10:07:59 user nova-compute[74311]:   <devices>
Oct 20 10:07:59 user nova-compute[74311]:     <disk supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='diskDevice'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>disk</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>cdrom</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>floppy</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>lun</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='bus'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>fdc</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>sata</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </disk>
Oct 20 10:07:59 user nova-compute[74311]:     <graphics supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>sdl</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vnc</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>spice</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>egl-headless</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </graphics>
Oct 20 10:07:59 user nova-compute[74311]:     <video supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='modelType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vga</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>cirrus</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vmvga</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>qxl</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>none</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>bochs</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>ramfb</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </video>
Oct 20 10:07:59 user nova-compute[74311]:     <hostdev supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='mode'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>subsystem</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='startupPolicy'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>default</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>mandatory</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>requisite</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>optional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='subsysType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>pci</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='capsType'/>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='pciBackend'/>
Oct 20 10:07:59 user nova-compute[74311]:     </hostdev>
Oct 20 10:07:59 user nova-compute[74311]:     <rng supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>random</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>egd</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>builtin</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </rng>
Oct 20 10:07:59 user nova-compute[74311]:     <filesystem supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='driverType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>path</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>handle</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtiofs</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </filesystem>
Oct 20 10:07:59 user nova-compute[74311]:     <tpm supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>tpm-tis</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>tpm-crb</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>passthrough</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>emulator</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </tpm>
Oct 20 10:07:59 user nova-compute[74311]:   </devices>
Oct 20 10:07:59 user nova-compute[74311]:   <features>
Oct 20 10:07:59 user nova-compute[74311]:     <gic supported='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     <vmcoreinfo supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <genid supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <backingStoreInput supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <backup supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <sev supported='no'/>
Oct 20 10:07:59 user nova-compute[74311]:   </features>
Oct 20 10:07:59 user nova-compute[74311]: </domainCapabilities>
Oct 20 10:07:59 user nova-compute[74311]:  {{(pid=74311) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 20 10:07:59 user nova-compute[74311]: <domainCapabilities>
Oct 20 10:07:59 user nova-compute[74311]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 10:07:59 user nova-compute[74311]:   <domain>kvm</domain>
Oct 20 10:07:59 user nova-compute[74311]:   <machine>pc-i440fx-6.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:   <arch>i686</arch>
Oct 20 10:07:59 user nova-compute[74311]:   <vcpu max='255'/>
Oct 20 10:07:59 user nova-compute[74311]:   <iothreads supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:   <os supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:     <enum name='firmware'/>
Oct 20 10:07:59 user nova-compute[74311]:     <loader supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>rom</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>pflash</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='readonly'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>yes</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>no</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='secure'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>no</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </loader>
Oct 20 10:07:59 user nova-compute[74311]:   </os>
Oct 20 10:07:59 user nova-compute[74311]:   <cpu>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='host-passthrough' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='hostPassthroughMigratable'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>off</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='maximum' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='maximumMigratable'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>on</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>off</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='host-model' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <vendor>Intel</vendor>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ss'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='vmx'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='pcid'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='hypervisor'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='arat'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='umip'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='md-clear'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='stibp'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ssbd'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ibpb'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ibrs'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='amd-stibp'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='erms'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='lm'/>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='custom' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>qemu64</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>qemu32</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>phenom</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium3</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium2</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>n270</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>kvm64</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>kvm32</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>coreduo</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>core2duo</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>athlon</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Westmere</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Snowridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>SandyBridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Penryn</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G5</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G4</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G3</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G2</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G1</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Nehalem</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>IvyBridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Icelake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-Rome</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-Milan</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Dhyana</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cooperlake</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Conroe</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>486</model>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:   </cpu>
Oct 20 10:07:59 user nova-compute[74311]:   <memoryBacking supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:     <enum name='sourceType'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>file</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>anonymous</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>memfd</value>
Oct 20 10:07:59 user nova-compute[74311]:     </enum>
Oct 20 10:07:59 user nova-compute[74311]:   </memoryBacking>
Oct 20 10:07:59 user nova-compute[74311]:   <devices>
Oct 20 10:07:59 user nova-compute[74311]:     <disk supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='diskDevice'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>disk</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>cdrom</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>floppy</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>lun</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='bus'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>ide</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>fdc</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>sata</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </disk>
Oct 20 10:07:59 user nova-compute[74311]:     <graphics supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>sdl</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vnc</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>spice</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>egl-headless</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </graphics>
Oct 20 10:07:59 user nova-compute[74311]:     <video supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='modelType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vga</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>cirrus</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vmvga</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>qxl</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>none</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>bochs</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>ramfb</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </video>
Oct 20 10:07:59 user nova-compute[74311]:     <hostdev supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='mode'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>subsystem</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='startupPolicy'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>default</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>mandatory</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>requisite</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>optional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='subsysType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>pci</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='capsType'/>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='pciBackend'/>
Oct 20 10:07:59 user nova-compute[74311]:     </hostdev>
Oct 20 10:07:59 user nova-compute[74311]:     <rng supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>random</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>egd</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>builtin</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </rng>
Oct 20 10:07:59 user nova-compute[74311]:     <filesystem supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='driverType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>path</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>handle</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtiofs</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </filesystem>
Oct 20 10:07:59 user nova-compute[74311]:     <tpm supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>tpm-tis</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>tpm-crb</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>passthrough</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>emulator</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </tpm>
Oct 20 10:07:59 user nova-compute[74311]:   </devices>
Oct 20 10:07:59 user nova-compute[74311]:   <features>
Oct 20 10:07:59 user nova-compute[74311]:     <gic supported='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     <vmcoreinfo supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <genid supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <backingStoreInput supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <backup supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <sev supported='no'/>
Oct 20 10:07:59 user nova-compute[74311]:   </features>
Oct 20 10:07:59 user nova-compute[74311]: </domainCapabilities>
Oct 20 10:07:59 user nova-compute[74311]:  {{(pid=74311) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 20 10:07:59 user nova-compute[74311]: <domainCapabilities>
Oct 20 10:07:59 user nova-compute[74311]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 10:07:59 user nova-compute[74311]:   <domain>kvm</domain>
Oct 20 10:07:59 user nova-compute[74311]:   <machine>pc-q35-6.2</machine>
Oct 20 10:07:59 user nova-compute[74311]:   <arch>x86_64</arch>
Oct 20 10:07:59 user nova-compute[74311]:   <vcpu max='288'/>
Oct 20 10:07:59 user nova-compute[74311]:   <iothreads supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:   <os supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:     <enum name='firmware'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>efi</value>
Oct 20 10:07:59 user nova-compute[74311]:     </enum>
Oct 20 10:07:59 user nova-compute[74311]:     <loader supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>rom</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>pflash</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='readonly'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>yes</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>no</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='secure'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>yes</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>no</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </loader>
Oct 20 10:07:59 user nova-compute[74311]:   </os>
Oct 20 10:07:59 user nova-compute[74311]:   <cpu>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='host-passthrough' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='hostPassthroughMigratable'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>on</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>off</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='maximum' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='maximumMigratable'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>on</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>off</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='host-model' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <vendor>Intel</vendor>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ss'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='vmx'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='pcid'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='hypervisor'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='arat'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='umip'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='md-clear'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='stibp'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ssbd'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='invtsc'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ibpb'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ibrs'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='amd-stibp'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='rsba'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='erms'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='custom' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>qemu64</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>qemu32</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>phenom</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium3</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium2</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>n270</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>kvm64</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>kvm32</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>coreduo</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>core2duo</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>athlon</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>Westmere</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Snowridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>SandyBridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>Penryn</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G5</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G4</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G3</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G2</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>Opteron_G1</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>Nehalem</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>IvyBridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Icelake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-Rome</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-Milan</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Dhyana</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cooperlake</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>Conroe</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>486</model>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:   </cpu>
Oct 20 10:07:59 user nova-compute[74311]:   <memoryBacking supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:     <enum name='sourceType'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>file</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>anonymous</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>memfd</value>
Oct 20 10:07:59 user nova-compute[74311]:     </enum>
Oct 20 10:07:59 user nova-compute[74311]:   </memoryBacking>
Oct 20 10:07:59 user nova-compute[74311]:   <devices>
Oct 20 10:07:59 user nova-compute[74311]:     <disk supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='diskDevice'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>disk</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>cdrom</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>floppy</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>lun</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='bus'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>fdc</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>sata</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </disk>
Oct 20 10:07:59 user nova-compute[74311]:     <graphics supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>sdl</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vnc</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>spice</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>egl-headless</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </graphics>
Oct 20 10:07:59 user nova-compute[74311]:     <video supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='modelType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vga</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>cirrus</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vmvga</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>qxl</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>none</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>bochs</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>ramfb</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </video>
Oct 20 10:07:59 user nova-compute[74311]:     <hostdev supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='mode'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>subsystem</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='startupPolicy'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>default</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>mandatory</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>requisite</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>optional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='subsysType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>pci</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='capsType'/>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='pciBackend'/>
Oct 20 10:07:59 user nova-compute[74311]:     </hostdev>
Oct 20 10:07:59 user nova-compute[74311]:     <rng supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>random</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>egd</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>builtin</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </rng>
Oct 20 10:07:59 user nova-compute[74311]:     <filesystem supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='driverType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>path</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>handle</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtiofs</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </filesystem>
Oct 20 10:07:59 user nova-compute[74311]:     <tpm supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>tpm-tis</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>tpm-crb</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>passthrough</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>emulator</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </tpm>
Oct 20 10:07:59 user nova-compute[74311]:   </devices>
Oct 20 10:07:59 user nova-compute[74311]:   <features>
Oct 20 10:07:59 user nova-compute[74311]:     <gic supported='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     <vmcoreinfo supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <genid supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <backingStoreInput supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <backup supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <sev supported='no'/>
Oct 20 10:07:59 user nova-compute[74311]:   </features>
Oct 20 10:07:59 user nova-compute[74311]: </domainCapabilities>
Oct 20 10:07:59 user nova-compute[74311]:  {{(pid=74311) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 20 10:07:59 user nova-compute[74311]: <domainCapabilities>
Oct 20 10:07:59 user nova-compute[74311]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 10:07:59 user nova-compute[74311]:   <domain>kvm</domain>
Oct 20 10:07:59 user nova-compute[74311]:   <machine>pc-i440fx-jammy</machine>
Oct 20 10:07:59 user nova-compute[74311]:   <arch>x86_64</arch>
Oct 20 10:07:59 user nova-compute[74311]:   <vcpu max='255'/>
Oct 20 10:07:59 user nova-compute[74311]:   <iothreads supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:   <os supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:     <enum name='firmware'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>efi</value>
Oct 20 10:07:59 user nova-compute[74311]:     </enum>
Oct 20 10:07:59 user nova-compute[74311]:     <loader supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>rom</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>pflash</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='readonly'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>yes</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>no</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='secure'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>no</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </loader>
Oct 20 10:07:59 user nova-compute[74311]:   </os>
Oct 20 10:07:59 user nova-compute[74311]:   <cpu>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='host-passthrough' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='hostPassthroughMigratable'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>on</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>off</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='maximum' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='maximumMigratable'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>on</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>off</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='host-model' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <vendor>Intel</vendor>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ss'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='vmx'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='pcid'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='hypervisor'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='arat'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='umip'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='md-clear'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='stibp'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ssbd'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='invtsc'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ibpb'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ibrs'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='amd-stibp'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='rsba'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='erms'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='custom' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>qemu64</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>qemu32</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>phenom</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium3</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium2</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>pentium</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>n270</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>kvm64</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>kvm32</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>coreduo</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>core2duo</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>athlon</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>Westmere</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Snowridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Skylake-Client</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>SandyBridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>Penryn</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G5</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G4</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G3</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Opteron_G2</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>Opteron_G1</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>Nehalem</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>IvyBridge</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Icelake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Haswell</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-Rome</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-Milan</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>EPYC</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Dhyana</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cooperlake</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>Conroe</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='no'>Broadwell</model>
Oct 20 10:07:59 user nova-compute[74311]:       <model usable='yes'>486</model>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:   </cpu>
Oct 20 10:07:59 user nova-compute[74311]:   <memoryBacking supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:     <enum name='sourceType'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>file</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>anonymous</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>memfd</value>
Oct 20 10:07:59 user nova-compute[74311]:     </enum>
Oct 20 10:07:59 user nova-compute[74311]:   </memoryBacking>
Oct 20 10:07:59 user nova-compute[74311]:   <devices>
Oct 20 10:07:59 user nova-compute[74311]:     <disk supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='diskDevice'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>disk</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>cdrom</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>floppy</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>lun</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='bus'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>ide</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>fdc</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>sata</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </disk>
Oct 20 10:07:59 user nova-compute[74311]:     <graphics supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>sdl</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vnc</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>spice</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>egl-headless</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </graphics>
Oct 20 10:07:59 user nova-compute[74311]:     <video supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='modelType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vga</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>cirrus</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>vmvga</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>qxl</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>none</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>bochs</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>ramfb</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </video>
Oct 20 10:07:59 user nova-compute[74311]:     <hostdev supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='mode'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>subsystem</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='startupPolicy'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>default</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>mandatory</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>requisite</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>optional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='subsysType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>pci</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='capsType'/>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='pciBackend'/>
Oct 20 10:07:59 user nova-compute[74311]:     </hostdev>
Oct 20 10:07:59 user nova-compute[74311]:     <rng supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>random</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>egd</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>builtin</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </rng>
Oct 20 10:07:59 user nova-compute[74311]:     <filesystem supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='driverType'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>path</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>handle</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>virtiofs</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </filesystem>
Oct 20 10:07:59 user nova-compute[74311]:     <tpm supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>tpm-tis</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>tpm-crb</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>passthrough</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>emulator</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </tpm>
Oct 20 10:07:59 user nova-compute[74311]:   </devices>
Oct 20 10:07:59 user nova-compute[74311]:   <features>
Oct 20 10:07:59 user nova-compute[74311]:     <gic supported='no'/>
Oct 20 10:07:59 user nova-compute[74311]:     <vmcoreinfo supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <genid supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <backingStoreInput supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <backup supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:     <sev supported='no'/>
Oct 20 10:07:59 user nova-compute[74311]:   </features>
Oct 20 10:07:59 user nova-compute[74311]: </domainCapabilities>
Oct 20 10:07:59 user nova-compute[74311]:  {{(pid=74311) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 10:07:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 20 10:07:59 user nova-compute[74311]: <domainCapabilities>
Oct 20 10:07:59 user nova-compute[74311]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 10:07:59 user nova-compute[74311]:   <domain>kvm</domain>
Oct 20 10:07:59 user nova-compute[74311]:   <machine>pc-q35-jammy</machine>
Oct 20 10:07:59 user nova-compute[74311]:   <arch>x86_64</arch>
Oct 20 10:07:59 user nova-compute[74311]:   <vcpu max='288'/>
Oct 20 10:07:59 user nova-compute[74311]:   <iothreads supported='yes'/>
Oct 20 10:07:59 user nova-compute[74311]:   <os supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:     <enum name='firmware'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>efi</value>
Oct 20 10:07:59 user nova-compute[74311]:     </enum>
Oct 20 10:07:59 user nova-compute[74311]:     <loader supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>rom</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>pflash</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='readonly'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>yes</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>no</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='secure'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>yes</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>no</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </loader>
Oct 20 10:07:59 user nova-compute[74311]:   </os>
Oct 20 10:07:59 user nova-compute[74311]:   <cpu>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='host-passthrough' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='hostPassthroughMigratable'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>on</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>off</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='maximum' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <enum name='maximumMigratable'>
Oct 20 10:07:59 user nova-compute[74311]:         <value>on</value>
Oct 20 10:07:59 user nova-compute[74311]:         <value>off</value>
Oct 20 10:07:59 user nova-compute[74311]:       </enum>
Oct 20 10:07:59 user nova-compute[74311]:     </mode>
Oct 20 10:07:59 user nova-compute[74311]:     <mode name='host-model' supported='yes'>
Oct 20 10:07:59 user nova-compute[74311]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 10:07:59 user nova-compute[74311]:       <vendor>Intel</vendor>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='ss'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='vmx'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='pcid'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='hypervisor'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='arat'/>
Oct 20 10:07:59 user nova-compute[74311]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='umip'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='md-clear'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='stibp'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='ssbd'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='invtsc'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='ibpb'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='ibrs'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='amd-stibp'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='rsba'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='disable' name='erms'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 10:08:00 user nova-compute[74311]:     </mode>
Oct 20 10:08:00 user nova-compute[74311]:     <mode name='custom' supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>qemu64</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>qemu32</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>phenom</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>pentium3</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>pentium2</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>pentium</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>n270</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>kvm64</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>kvm32</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>coreduo</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>core2duo</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>athlon</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>Westmere</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Snowridge</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Skylake-Server</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Skylake-Client</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>SandyBridge</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>Penryn</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Opteron_G5</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Opteron_G4</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Opteron_G3</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Opteron_G2</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>Opteron_G1</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>Nehalem</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>IvyBridge</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Icelake-Server</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Haswell</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>EPYC-Rome</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>EPYC-Milan</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>EPYC</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Dhyana</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Cooperlake</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>Conroe</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Broadwell</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>486</model>
Oct 20 10:08:00 user nova-compute[74311]:     </mode>
Oct 20 10:08:00 user nova-compute[74311]:   </cpu>
Oct 20 10:08:00 user nova-compute[74311]:   <memoryBacking supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:     <enum name='sourceType'>
Oct 20 10:08:00 user nova-compute[74311]:       <value>file</value>
Oct 20 10:08:00 user nova-compute[74311]:       <value>anonymous</value>
Oct 20 10:08:00 user nova-compute[74311]:       <value>memfd</value>
Oct 20 10:08:00 user nova-compute[74311]:     </enum>
Oct 20 10:08:00 user nova-compute[74311]:   </memoryBacking>
Oct 20 10:08:00 user nova-compute[74311]:   <devices>
Oct 20 10:08:00 user nova-compute[74311]:     <disk supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='diskDevice'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>disk</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>cdrom</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>floppy</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>lun</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='bus'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>fdc</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>sata</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </disk>
Oct 20 10:08:00 user nova-compute[74311]:     <graphics supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>sdl</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>vnc</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>spice</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>egl-headless</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </graphics>
Oct 20 10:08:00 user nova-compute[74311]:     <video supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='modelType'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>vga</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>cirrus</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>vmvga</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>qxl</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>none</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>bochs</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>ramfb</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </video>
Oct 20 10:08:00 user nova-compute[74311]:     <hostdev supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='mode'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>subsystem</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='startupPolicy'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>default</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>mandatory</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>requisite</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>optional</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='subsysType'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>pci</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='capsType'/>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='pciBackend'/>
Oct 20 10:08:00 user nova-compute[74311]:     </hostdev>
Oct 20 10:08:00 user nova-compute[74311]:     <rng supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>random</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>egd</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>builtin</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </rng>
Oct 20 10:08:00 user nova-compute[74311]:     <filesystem supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='driverType'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>path</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>handle</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtiofs</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </filesystem>
Oct 20 10:08:00 user nova-compute[74311]:     <tpm supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>tpm-tis</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>tpm-crb</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>passthrough</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>emulator</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </tpm>
Oct 20 10:08:00 user nova-compute[74311]:   </devices>
Oct 20 10:08:00 user nova-compute[74311]:   <features>
Oct 20 10:08:00 user nova-compute[74311]:     <gic supported='no'/>
Oct 20 10:08:00 user nova-compute[74311]:     <vmcoreinfo supported='yes'/>
Oct 20 10:08:00 user nova-compute[74311]:     <genid supported='yes'/>
Oct 20 10:08:00 user nova-compute[74311]:     <backingStoreInput supported='yes'/>
Oct 20 10:08:00 user nova-compute[74311]:     <backup supported='yes'/>
Oct 20 10:08:00 user nova-compute[74311]:     <sev supported='no'/>
Oct 20 10:08:00 user nova-compute[74311]:   </features>
Oct 20 10:08:00 user nova-compute[74311]: </domainCapabilities>
Oct 20 10:08:00 user nova-compute[74311]:  {{(pid=74311) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 20 10:08:00 user nova-compute[74311]: <domainCapabilities>
Oct 20 10:08:00 user nova-compute[74311]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 10:08:00 user nova-compute[74311]:   <domain>kvm</domain>
Oct 20 10:08:00 user nova-compute[74311]:   <machine>pc-i440fx-6.2</machine>
Oct 20 10:08:00 user nova-compute[74311]:   <arch>x86_64</arch>
Oct 20 10:08:00 user nova-compute[74311]:   <vcpu max='255'/>
Oct 20 10:08:00 user nova-compute[74311]:   <iothreads supported='yes'/>
Oct 20 10:08:00 user nova-compute[74311]:   <os supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:     <enum name='firmware'>
Oct 20 10:08:00 user nova-compute[74311]:       <value>efi</value>
Oct 20 10:08:00 user nova-compute[74311]:     </enum>
Oct 20 10:08:00 user nova-compute[74311]:     <loader supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>rom</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>pflash</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='readonly'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>yes</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>no</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='secure'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>no</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </loader>
Oct 20 10:08:00 user nova-compute[74311]:   </os>
Oct 20 10:08:00 user nova-compute[74311]:   <cpu>
Oct 20 10:08:00 user nova-compute[74311]:     <mode name='host-passthrough' supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='hostPassthroughMigratable'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>on</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>off</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </mode>
Oct 20 10:08:00 user nova-compute[74311]:     <mode name='maximum' supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='maximumMigratable'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>on</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>off</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </mode>
Oct 20 10:08:00 user nova-compute[74311]:     <mode name='host-model' supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <vendor>Intel</vendor>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='ss'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='vmx'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='pcid'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='hypervisor'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='arat'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='umip'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='md-clear'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='stibp'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='ssbd'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='invtsc'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='ibpb'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='ibrs'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='amd-stibp'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='rsba'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='disable' name='erms'/>
Oct 20 10:08:00 user nova-compute[74311]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 10:08:00 user nova-compute[74311]:     </mode>
Oct 20 10:08:00 user nova-compute[74311]:     <mode name='custom' supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>qemu64</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>qemu32</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>phenom</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>pentium3</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>pentium2</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>pentium</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>n270</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>kvm64</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>kvm32</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>coreduo</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>core2duo</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>athlon</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>Westmere</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Snowridge</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Skylake-Server</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Skylake-Client</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>SandyBridge</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>Penryn</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Opteron_G5</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Opteron_G4</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Opteron_G3</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Opteron_G2</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>Opteron_G1</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>Nehalem</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>IvyBridge</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Icelake-Server</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Haswell</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>EPYC-Rome</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>EPYC-Milan</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>EPYC</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Dhyana</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Cooperlake</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>Conroe</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='no'>Broadwell</model>
Oct 20 10:08:00 user nova-compute[74311]:       <model usable='yes'>486</model>
Oct 20 10:08:00 user nova-compute[74311]:     </mode>
Oct 20 10:08:00 user nova-compute[74311]:   </cpu>
Oct 20 10:08:00 user nova-compute[74311]:   <memoryBacking supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:     <enum name='sourceType'>
Oct 20 10:08:00 user nova-compute[74311]:       <value>file</value>
Oct 20 10:08:00 user nova-compute[74311]:       <value>anonymous</value>
Oct 20 10:08:00 user nova-compute[74311]:       <value>memfd</value>
Oct 20 10:08:00 user nova-compute[74311]:     </enum>
Oct 20 10:08:00 user nova-compute[74311]:   </memoryBacking>
Oct 20 10:08:00 user nova-compute[74311]:   <devices>
Oct 20 10:08:00 user nova-compute[74311]:     <disk supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='diskDevice'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>disk</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>cdrom</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>floppy</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>lun</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='bus'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>ide</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>fdc</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>sata</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </disk>
Oct 20 10:08:00 user nova-compute[74311]:     <graphics supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='type'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>sdl</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>vnc</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>spice</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>egl-headless</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </graphics>
Oct 20 10:08:00 user nova-compute[74311]:     <video supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='modelType'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>vga</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>cirrus</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>vmvga</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>qxl</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>none</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>bochs</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>ramfb</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </video>
Oct 20 10:08:00 user nova-compute[74311]:     <hostdev supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='mode'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>subsystem</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='startupPolicy'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>default</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>mandatory</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>requisite</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>optional</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='subsysType'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>usb</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>pci</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>scsi</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='capsType'/>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='pciBackend'/>
Oct 20 10:08:00 user nova-compute[74311]:     </hostdev>
Oct 20 10:08:00 user nova-compute[74311]:     <rng supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio-transitional</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtio-non-transitional</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>random</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>egd</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>builtin</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </rng>
Oct 20 10:08:00 user nova-compute[74311]:     <filesystem supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='driverType'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>path</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>handle</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>virtiofs</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </filesystem>
Oct 20 10:08:00 user nova-compute[74311]:     <tpm supported='yes'>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='model'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>tpm-tis</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>tpm-crb</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:       <enum name='backendModel'>
Oct 20 10:08:00 user nova-compute[74311]:         <value>passthrough</value>
Oct 20 10:08:00 user nova-compute[74311]:         <value>emulator</value>
Oct 20 10:08:00 user nova-compute[74311]:       </enum>
Oct 20 10:08:00 user nova-compute[74311]:     </tpm>
Oct 20 10:08:00 user nova-compute[74311]:   </devices>
Oct 20 10:08:00 user nova-compute[74311]:   <features>
Oct 20 10:08:00 user nova-compute[74311]:     <gic supported='no'/>
Oct 20 10:08:00 user nova-compute[74311]:     <vmcoreinfo supported='yes'/>
Oct 20 10:08:00 user nova-compute[74311]:     <genid supported='yes'/>
Oct 20 10:08:00 user nova-compute[74311]:     <backingStoreInput supported='yes'/>
Oct 20 10:08:00 user nova-compute[74311]:     <backup supported='yes'/>
Oct 20 10:08:00 user nova-compute[74311]:     <sev supported='no'/>
Oct 20 10:08:00 user nova-compute[74311]:   </features>
Oct 20 10:08:00 user nova-compute[74311]: </domainCapabilities>
Oct 20 10:08:00 user nova-compute[74311]:  {{(pid=74311) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74311) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74311) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Checking secure boot support for host arch (x86_64) {{(pid=74311) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 20 10:08:00 user nova-compute[74311]: INFO nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Secure Boot support detected
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] cpu compare xml: <cpu match="exact">
Oct 20 10:08:00 user nova-compute[74311]:   <model>Nehalem</model>
Oct 20 10:08:00 user nova-compute[74311]: </cpu>
Oct 20 10:08:00 user nova-compute[74311]:  {{(pid=74311) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 20 10:08:00 user nova-compute[74311]: INFO nova.virt.node [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Generated node identity 77cac819-3c22-4fec-a59d-0525ac40a90b
Oct 20 10:08:00 user nova-compute[74311]: INFO nova.virt.node [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Wrote node identity 77cac819-3c22-4fec-a59d-0525ac40a90b to /opt/stack/data/nova/compute_id
Oct 20 10:08:00 user nova-compute[74311]: WARNING nova.compute.manager [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Compute nodes ['77cac819-3c22-4fec-a59d-0525ac40a90b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 20 10:08:00 user nova-compute[74311]: INFO nova.compute.manager [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 20 10:08:00 user nova-compute[74311]: WARNING nova.compute.manager [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 10:08:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:08:00 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:08:00 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Hypervisor/Node resource view: name=user free_ram=10925MB free_disk=26.201522827148438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:08:00 user nova-compute[74311]: WARNING nova.compute.resource_tracker [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] No compute node record for user:77cac819-3c22-4fec-a59d-0525ac40a90b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 77cac819-3c22-4fec-a59d-0525ac40a90b could not be found.
Oct 20 10:08:00 user nova-compute[74311]: INFO nova.compute.resource_tracker [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Compute node record created for user:user with uuid: 77cac819-3c22-4fec-a59d-0525ac40a90b
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:08:00 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] [req-a07541eb-9abb-47a1-b0e0-ce2eb41ecb71] Created resource provider record via placement API for resource provider with UUID 77cac819-3c22-4fec-a59d-0525ac40a90b and name user.
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74311) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 20 10:08:00 user nova-compute[74311]: INFO nova.virt.libvirt.host [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] kernel doesn't support AMD SEV
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Updating inventory in ProviderTree for provider 77cac819-3c22-4fec-a59d-0525ac40a90b with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Libvirt baseline CPU <cpu>
Oct 20 10:08:00 user nova-compute[74311]:   <arch>x86_64</arch>
Oct 20 10:08:00 user nova-compute[74311]:   <model>Nehalem</model>
Oct 20 10:08:00 user nova-compute[74311]:   <vendor>Intel</vendor>
Oct 20 10:08:00 user nova-compute[74311]:   <topology sockets="6" cores="1" threads="1"/>
Oct 20 10:08:00 user nova-compute[74311]: </cpu>
Oct 20 10:08:00 user nova-compute[74311]:  {{(pid=74311) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Updated inventory for provider 77cac819-3c22-4fec-a59d-0525ac40a90b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Updating resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b generation from 0 to 1 during operation: update_inventory {{(pid=74311) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 10:08:00 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Updating inventory in ProviderTree for provider 77cac819-3c22-4fec-a59d-0525ac40a90b with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 10:08:01 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Updating resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b generation from 1 to 2 during operation: update_traits {{(pid=74311) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 10:08:01 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:08:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:08:01 user nova-compute[74311]: DEBUG nova.service [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Creating RPC server for service compute {{(pid=74311) start /opt/stack/nova/nova/service.py:182}}
Oct 20 10:08:01 user nova-compute[74311]: DEBUG nova.service [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] Join ServiceGroup membership for this service compute {{(pid=74311) start /opt/stack/nova/nova/service.py:199}}
Oct 20 10:08:01 user nova-compute[74311]: DEBUG nova.servicegroup.drivers.db [None req-3037cea9-8a51-42a8-b235-f7a60f3e64d5 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74311) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 20 10:08:32 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:08:32 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Didn't find any instances for network info cache update. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:08:52 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:08:52 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:08:52 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=10358MB free_disk=26.105209350585938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:08:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:09:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:09:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:09:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:09:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:09:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Didn't find any instances for network info cache update. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:09:53 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:09:53 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:09:53 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=10292MB free_disk=26.169452667236328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:09:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:09:54 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:10:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:10:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:10:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:10:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Didn't find any instances for network info cache update. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 10:10:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:10:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:10:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:10:54 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:10:54 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:10:54 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=10319MB free_disk=25.922927856445312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:10:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:10:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:11:51 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:11:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:11:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:11:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:11:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Didn't find any instances for network info cache update. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 10:11:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:11:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:11:54 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:11:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:11:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:11:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:11:55 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:11:56 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:11:56 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:11:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:11:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:11:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:11:56 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:11:56 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:11:56 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:11:56 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=9579MB free_disk=25.942916870117188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:11:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:11:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:11:56 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:11:56 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:11:56 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:11:56 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:11:56 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:11:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:01 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:12:02 user nova-compute[74311]: INFO nova.compute.claims [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Claim successful on node user
Oct 20 10:12:02 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "22d78096-bc6c-4d6b-93b6-845d596ed24b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:12:02 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:12:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:12:02 user nova-compute[74311]: INFO nova.compute.claims [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Claim successful on node user
Oct 20 10:12:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:12:02 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Creating image(s)
Oct 20 10:12:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "/opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "/opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "/opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:03 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:12:03 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:12:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:03 user nova-compute[74311]: DEBUG nova.compute.manager [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:12:03 user nova-compute[74311]: DEBUG nova.compute.manager [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:12:03 user nova-compute[74311]: DEBUG nova.network.neutron [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:12:03 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:12:03 user nova-compute[74311]: DEBUG nova.policy [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c40e8a363dd4eaf862c0b61de171130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc9455e6a754bafb33349644f579988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:12:03 user nova-compute[74311]: DEBUG nova.compute.manager [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:12:03 user nova-compute[74311]: DEBUG nova.compute.manager [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:12:03 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:12:03 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Creating image(s)
Oct 20 10:12:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "/opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "/opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "/opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:03 user nova-compute[74311]: DEBUG nova.policy [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c6b76de1f054ca0973f2f9ba2eafaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090bd6a8a14d4a308e67be7a12e47ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:12:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223.part --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223.part --force-share --output=json" returned: 0 in 0.208s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:04 user nova-compute[74311]: DEBUG nova.virt.images [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] 4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa was qcow2, converting to raw {{(pid=74311) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 10:12:04 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:12:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223.part /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223.converted {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223.part /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223.converted" returned: 0 in 0.131s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223.converted --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.521s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:04 user nova-compute[74311]: INFO oslo.privsep.daemon [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpyg93oyyr/privsep.sock']
Oct 20 10:12:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:04 user sudo[83561]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpyg93oyyr/privsep.sock
Oct 20 10:12:04 user sudo[83561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 10:12:05 user sudo[83561]: pam_unix(sudo:session): session closed for user root
Oct 20 10:12:05 user nova-compute[74311]: INFO oslo.privsep.daemon [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Spawned new privsep daemon via rootwrap
Oct 20 10:12:05 user nova-compute[74311]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 10:12:05 user nova-compute[74311]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 10:12:05 user nova-compute[74311]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 20 10:12:05 user nova-compute[74311]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83564
Oct 20 10:12:05 user nova-compute[74311]: WARNING oslo_privsep.priv_context [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] privsep daemon already running
Oct 20 10:12:05 user nova-compute[74311]: DEBUG nova.network.neutron [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Successfully created port: 3a618325-862e-4c54-a654-6d3284cb8bf3 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:12:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.161s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.167s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk 1073741824" returned: 0 in 0.041s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.227s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.161s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.187s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk 1073741824" returned: 0 in 0.045s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Cannot resize image /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Ensure instance console log exists: /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.154s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Cannot resize image /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Ensure instance console log exists: /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Successfully created port: 3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:12:07 user nova-compute[74311]: INFO nova.compute.claims [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Claim successful on node user
Oct 20 10:12:07 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Successfully updated port: 3a618325-862e-4c54-a654-6d3284cb8bf3 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquired lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "560c41a4-79a3-461d-976d-f260bc9086f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "560c41a4-79a3-461d-976d-f260bc9086f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:07 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:12:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:12:08 user nova-compute[74311]: INFO nova.compute.claims [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Claim successful on node user
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.policy [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b357b019ce2a4153af47b9e4c5586148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd174f4a262b044e58e8f211b06a41d40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:12:08 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Creating image(s)
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "/opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "/opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-571c8c20-f47b-4e09-bf1e-8a2a3bb258c2 req-c5a5bd23-403c-4c70-8e33-1226bd195030 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Received event network-changed-3a618325-862e-4c54-a654-6d3284cb8bf3 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-571c8c20-f47b-4e09-bf1e-8a2a3bb258c2 req-c5a5bd23-403c-4c70-8e33-1226bd195030 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Refreshing instance network info cache due to event network-changed-3a618325-862e-4c54-a654-6d3284cb8bf3. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-571c8c20-f47b-4e09-bf1e-8a2a3bb258c2 req-c5a5bd23-403c-4c70-8e33-1226bd195030 service nova] Acquiring lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.234s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:12:08 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk 1073741824" returned: 0 in 0.039s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.policy [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe1aad9aa1e64a9db4f78c0c12779300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61fab5f8b38b490985cc614ade80f25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.network.neutron [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Updating instance_info_cache with network_info: [{"id": "3a618325-862e-4c54-a654-6d3284cb8bf3", "address": "fa:16:3e:e2:bf:e1", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a618325-86", "ovs_interfaceid": "3a618325-862e-4c54-a654-6d3284cb8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:12:08 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Creating image(s)
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "/opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "/opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "/opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Releasing lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Instance network_info: |[{"id": "3a618325-862e-4c54-a654-6d3284cb8bf3", "address": "fa:16:3e:e2:bf:e1", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a618325-86", "ovs_interfaceid": "3a618325-862e-4c54-a654-6d3284cb8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-571c8c20-f47b-4e09-bf1e-8a2a3bb258c2 req-c5a5bd23-403c-4c70-8e33-1226bd195030 service nova] Acquired lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.network.neutron [req-571c8c20-f47b-4e09-bf1e-8a2a3bb258c2 req-c5a5bd23-403c-4c70-8e33-1226bd195030 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Refreshing network info cache for port 3a618325-862e-4c54-a654-6d3284cb8bf3 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Start _get_guest_xml network_info=[{"id": "3a618325-862e-4c54-a654-6d3284cb8bf3", "address": "fa:16:3e:e2:bf:e1", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a618325-86", "ovs_interfaceid": "3a618325-862e-4c54-a654-6d3284cb8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.230s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:08 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:08 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:12:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2023935930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2023935930',id=2,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090bd6a8a14d4a308e67be7a12e47ae6',ramdisk_id='',reservation_id='r-0p926s0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:03Z,user_data=None,user_id='0c6b76de1f054ca0973f2f9ba2eafaed',uuid=22d78096-bc6c-4d6b-93b6-845d596ed24b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a618325-862e-4c54-a654-6d3284cb8bf3", "address": "fa:16:3e:e2:bf:e1", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a618325-86", "ovs_interfaceid": "3a618325-862e-4c54-a654-6d3284cb8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converting VIF {"id": "3a618325-862e-4c54-a654-6d3284cb8bf3", "address": "fa:16:3e:e2:bf:e1", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a618325-86", "ovs_interfaceid": "3a618325-862e-4c54-a654-6d3284cb8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:bf:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a618325-862e-4c54-a654-6d3284cb8bf3,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a618325-86') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.objects.instance [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'pci_devices' on Instance uuid 22d78096-bc6c-4d6b-93b6-845d596ed24b {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.212s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Cannot resize image /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Ensure instance console log exists: /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:12:09 user nova-compute[74311]:   <uuid>22d78096-bc6c-4d6b-93b6-845d596ed24b</uuid>
Oct 20 10:12:09 user nova-compute[74311]:   <name>instance-00000002</name>
Oct 20 10:12:09 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:12:09 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:12:09 user nova-compute[74311]:   <metadata>
Oct 20 10:12:09 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:12:09 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:12:09 user nova-compute[74311]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2023935930</nova:name>
Oct 20 10:12:09 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:12:08</nova:creationTime>
Oct 20 10:12:09 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:12:09 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:12:09 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:12:09 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:12:09 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:12:09 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:12:09 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:12:09 user nova-compute[74311]:       <nova:owner>
Oct 20 10:12:09 user nova-compute[74311]:         <nova:user uuid="0c6b76de1f054ca0973f2f9ba2eafaed">tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member</nova:user>
Oct 20 10:12:09 user nova-compute[74311]:         <nova:project uuid="090bd6a8a14d4a308e67be7a12e47ae6">tempest-ServerBootFromVolumeStableRescueTest-2019341345</nova:project>
Oct 20 10:12:09 user nova-compute[74311]:       </nova:owner>
Oct 20 10:12:09 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:12:09 user nova-compute[74311]:       <nova:ports>
Oct 20 10:12:09 user nova-compute[74311]:         <nova:port uuid="3a618325-862e-4c54-a654-6d3284cb8bf3">
Oct 20 10:12:09 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 10:12:09 user nova-compute[74311]:         </nova:port>
Oct 20 10:12:09 user nova-compute[74311]:       </nova:ports>
Oct 20 10:12:09 user nova-compute[74311]:     </nova:instance>
Oct 20 10:12:09 user nova-compute[74311]:   </metadata>
Oct 20 10:12:09 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:12:09 user nova-compute[74311]:     <system>
Oct 20 10:12:09 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:12:09 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:12:09 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:12:09 user nova-compute[74311]:       <entry name="serial">22d78096-bc6c-4d6b-93b6-845d596ed24b</entry>
Oct 20 10:12:09 user nova-compute[74311]:       <entry name="uuid">22d78096-bc6c-4d6b-93b6-845d596ed24b</entry>
Oct 20 10:12:09 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:12:09 user nova-compute[74311]:     </system>
Oct 20 10:12:09 user nova-compute[74311]:   </sysinfo>
Oct 20 10:12:09 user nova-compute[74311]:   <os>
Oct 20 10:12:09 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:12:09 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:12:09 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:12:09 user nova-compute[74311]:   </os>
Oct 20 10:12:09 user nova-compute[74311]:   <features>
Oct 20 10:12:09 user nova-compute[74311]:     <acpi/>
Oct 20 10:12:09 user nova-compute[74311]:     <apic/>
Oct 20 10:12:09 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:12:09 user nova-compute[74311]:   </features>
Oct 20 10:12:09 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:12:09 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:12:09 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:12:09 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:12:09 user nova-compute[74311]:   </clock>
Oct 20 10:12:09 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:12:09 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:12:09 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:12:09 user nova-compute[74311]:   </cpu>
Oct 20 10:12:09 user nova-compute[74311]:   <devices>
Oct 20 10:12:09 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:12:09 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:12:09 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk"/>
Oct 20 10:12:09 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:12:09 user nova-compute[74311]:     </disk>
Oct 20 10:12:09 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:12:09 user nova-compute[74311]:       <mac address="fa:16:3e:e2:bf:e1"/>
Oct 20 10:12:09 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:09 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:12:09 user nova-compute[74311]:       <target dev="tap3a618325-86"/>
Oct 20 10:12:09 user nova-compute[74311]:     </interface>
Oct 20 10:12:09 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:12:09 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/console.log" append="off"/>
Oct 20 10:12:09 user nova-compute[74311]:     </serial>
Oct 20 10:12:09 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:12:09 user nova-compute[74311]:     <video>
Oct 20 10:12:09 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:09 user nova-compute[74311]:     </video>
Oct 20 10:12:09 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:12:09 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:12:09 user nova-compute[74311]:     </rng>
Oct 20 10:12:09 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:12:09 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:12:09 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:12:09 user nova-compute[74311]:     </memballoon>
Oct 20 10:12:09 user nova-compute[74311]:   </devices>
Oct 20 10:12:09 user nova-compute[74311]: </domain>
Oct 20 10:12:09 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2023935930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2023935930',id=2,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090bd6a8a14d4a308e67be7a12e47ae6',ramdisk_id='',reservation_id='r-0p926s0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:03Z,user_data=None,user_id='0c6b76de1f054ca0973f2f9ba2eafaed',uuid=22d78096-bc6c-4d6b-93b6-845d596ed24b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a618325-862e-4c54-a654-6d3284cb8bf3", "address": "fa:16:3e:e2:bf:e1", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a618325-86", "ovs_interfaceid": "3a618325-862e-4c54-a654-6d3284cb8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converting VIF {"id": "3a618325-862e-4c54-a654-6d3284cb8bf3", "address": "fa:16:3e:e2:bf:e1", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a618325-86", "ovs_interfaceid": "3a618325-862e-4c54-a654-6d3284cb8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:bf:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a618325-862e-4c54-a654-6d3284cb8bf3,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a618325-86') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG os_vif [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:bf:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a618325-862e-4c54-a654-6d3284cb8bf3,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a618325-86') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk 1073741824" returned: 0 in 0.085s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Created schema index Interface.name {{(pid=74311) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Created schema index Port.name {{(pid=74311) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Created schema index Bridge.name {{(pid=74311) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [POLLOUT] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85f8cf34-fdcf-545b-bcf9-7e7fd0ada7b9', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:09 user nova-compute[74311]: INFO oslo.privsep.daemon [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpx854i88u/privsep.sock']
Oct 20 10:12:09 user sudo[83634]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpx854i88u/privsep.sock
Oct 20 10:12:09 user sudo[83634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.168s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Cannot resize image /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Ensure instance console log exists: /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Successfully updated port: 3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "refresh_cache-47a30844-242f-4a7f-ad9f-232a6e76b4ec" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquired lock "refresh_cache-47a30844-242f-4a7f-ad9f-232a6e76b4ec" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-53f54a19-5dea-4cf7-85fa-4107c2dcd068 req-b8061ba0-050b-4500-b3ab-e626cf41179c service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received event network-changed-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-53f54a19-5dea-4cf7-85fa-4107c2dcd068 req-b8061ba0-050b-4500-b3ab-e626cf41179c service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Refreshing instance network info cache due to event network-changed-3547e076-2273-41d1-829e-062952da0e37. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:12:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-53f54a19-5dea-4cf7-85fa-4107c2dcd068 req-b8061ba0-050b-4500-b3ab-e626cf41179c service nova] Acquiring lock "refresh_cache-47a30844-242f-4a7f-ad9f-232a6e76b4ec" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.network.neutron [req-571c8c20-f47b-4e09-bf1e-8a2a3bb258c2 req-c5a5bd23-403c-4c70-8e33-1226bd195030 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Updated VIF entry in instance network info cache for port 3a618325-862e-4c54-a654-6d3284cb8bf3. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.network.neutron [req-571c8c20-f47b-4e09-bf1e-8a2a3bb258c2 req-c5a5bd23-403c-4c70-8e33-1226bd195030 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Updating instance_info_cache with network_info: [{"id": "3a618325-862e-4c54-a654-6d3284cb8bf3", "address": "fa:16:3e:e2:bf:e1", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a618325-86", "ovs_interfaceid": "3a618325-862e-4c54-a654-6d3284cb8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-571c8c20-f47b-4e09-bf1e-8a2a3bb258c2 req-c5a5bd23-403c-4c70-8e33-1226bd195030 service nova] Releasing lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "b0b457b8-159b-4533-ac97-dab7ffe0945e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:12:10 user nova-compute[74311]: INFO nova.compute.claims [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Claim successful on node user
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Updating instance_info_cache with network_info: [{"id": "3547e076-2273-41d1-829e-062952da0e37", "address": "fa:16:3e:e8:4a:24", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547e076-22", "ovs_interfaceid": "3547e076-2273-41d1-829e-062952da0e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Releasing lock "refresh_cache-47a30844-242f-4a7f-ad9f-232a6e76b4ec" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Instance network_info: |[{"id": "3547e076-2273-41d1-829e-062952da0e37", "address": "fa:16:3e:e8:4a:24", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547e076-22", "ovs_interfaceid": "3547e076-2273-41d1-829e-062952da0e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-53f54a19-5dea-4cf7-85fa-4107c2dcd068 req-b8061ba0-050b-4500-b3ab-e626cf41179c service nova] Acquired lock "refresh_cache-47a30844-242f-4a7f-ad9f-232a6e76b4ec" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.network.neutron [req-53f54a19-5dea-4cf7-85fa-4107c2dcd068 req-b8061ba0-050b-4500-b3ab-e626cf41179c service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Refreshing network info cache for port 3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Start _get_guest_xml network_info=[{"id": "3547e076-2273-41d1-829e-062952da0e37", "address": "fa:16:3e:e8:4a:24", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547e076-22", "ovs_interfaceid": "3547e076-2273-41d1-829e-062952da0e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:12:10 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:10 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:12:10 user sudo[83634]: pam_unix(sudo:session): session closed for user root
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-855673579',display_name='tempest-ServersNegativeTestJSON-server-855673579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-855673579',id=1,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbc9455e6a754bafb33349644f579988',ramdisk_id='',reservation_id='r-xvinicnh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1307260612',owner_user_name='tempest-ServersNegativeTestJSON-1307260612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:03Z,user_data=None,user_id='6c40e8a363dd4eaf862c0b61de171130',uuid=47a30844-242f-4a7f-ad9f-232a6e76b4ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3547e076-2273-41d1-829e-062952da0e37", "address": "fa:16:3e:e8:4a:24", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547e076-22", "ovs_interfaceid": "3547e076-2273-41d1-829e-062952da0e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Converting VIF {"id": "3547e076-2273-41d1-829e-062952da0e37", "address": "fa:16:3e:e8:4a:24", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547e076-22", "ovs_interfaceid": "3547e076-2273-41d1-829e-062952da0e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4a:24,bridge_name='br-int',has_traffic_filtering=True,id=3547e076-2273-41d1-829e-062952da0e37,network=Network(5253925b-fda9-426d-8a82-bc8924961ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3547e076-22') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.objects.instance [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lazy-loading 'pci_devices' on Instance uuid 47a30844-242f-4a7f-ad9f-232a6e76b4ec {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Successfully created port: ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:12:10 user nova-compute[74311]: INFO oslo.privsep.daemon [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Spawned new privsep daemon via rootwrap
Oct 20 10:12:10 user nova-compute[74311]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 10:12:10 user nova-compute[74311]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 10:12:10 user nova-compute[74311]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 20 10:12:10 user nova-compute[74311]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83642
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:12:10 user nova-compute[74311]:   <uuid>47a30844-242f-4a7f-ad9f-232a6e76b4ec</uuid>
Oct 20 10:12:10 user nova-compute[74311]:   <name>instance-00000001</name>
Oct 20 10:12:10 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:12:10 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:12:10 user nova-compute[74311]:   <metadata>
Oct 20 10:12:10 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:12:10 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:12:10 user nova-compute[74311]:       <nova:name>tempest-ServersNegativeTestJSON-server-855673579</nova:name>
Oct 20 10:12:10 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:12:10</nova:creationTime>
Oct 20 10:12:10 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:12:10 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:12:10 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:12:10 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:12:10 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:12:10 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:12:10 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:12:10 user nova-compute[74311]:       <nova:owner>
Oct 20 10:12:10 user nova-compute[74311]:         <nova:user uuid="6c40e8a363dd4eaf862c0b61de171130">tempest-ServersNegativeTestJSON-1307260612-project-member</nova:user>
Oct 20 10:12:10 user nova-compute[74311]:         <nova:project uuid="cbc9455e6a754bafb33349644f579988">tempest-ServersNegativeTestJSON-1307260612</nova:project>
Oct 20 10:12:10 user nova-compute[74311]:       </nova:owner>
Oct 20 10:12:10 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:12:10 user nova-compute[74311]:       <nova:ports>
Oct 20 10:12:10 user nova-compute[74311]:         <nova:port uuid="3547e076-2273-41d1-829e-062952da0e37">
Oct 20 10:12:10 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 10:12:10 user nova-compute[74311]:         </nova:port>
Oct 20 10:12:10 user nova-compute[74311]:       </nova:ports>
Oct 20 10:12:10 user nova-compute[74311]:     </nova:instance>
Oct 20 10:12:10 user nova-compute[74311]:   </metadata>
Oct 20 10:12:10 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:12:10 user nova-compute[74311]:     <system>
Oct 20 10:12:10 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:12:10 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:12:10 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:12:10 user nova-compute[74311]:       <entry name="serial">47a30844-242f-4a7f-ad9f-232a6e76b4ec</entry>
Oct 20 10:12:10 user nova-compute[74311]:       <entry name="uuid">47a30844-242f-4a7f-ad9f-232a6e76b4ec</entry>
Oct 20 10:12:10 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:12:10 user nova-compute[74311]:     </system>
Oct 20 10:12:10 user nova-compute[74311]:   </sysinfo>
Oct 20 10:12:10 user nova-compute[74311]:   <os>
Oct 20 10:12:10 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:12:10 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:12:10 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:12:10 user nova-compute[74311]:   </os>
Oct 20 10:12:10 user nova-compute[74311]:   <features>
Oct 20 10:12:10 user nova-compute[74311]:     <acpi/>
Oct 20 10:12:10 user nova-compute[74311]:     <apic/>
Oct 20 10:12:10 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:12:10 user nova-compute[74311]:   </features>
Oct 20 10:12:10 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:12:10 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:12:10 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:12:10 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:12:10 user nova-compute[74311]:   </clock>
Oct 20 10:12:10 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:12:10 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:12:10 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:12:10 user nova-compute[74311]:   </cpu>
Oct 20 10:12:10 user nova-compute[74311]:   <devices>
Oct 20 10:12:10 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:12:10 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:12:10 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk"/>
Oct 20 10:12:10 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:12:10 user nova-compute[74311]:     </disk>
Oct 20 10:12:10 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:12:10 user nova-compute[74311]:       <mac address="fa:16:3e:e8:4a:24"/>
Oct 20 10:12:10 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:10 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:12:10 user nova-compute[74311]:       <target dev="tap3547e076-22"/>
Oct 20 10:12:10 user nova-compute[74311]:     </interface>
Oct 20 10:12:10 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:12:10 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/console.log" append="off"/>
Oct 20 10:12:10 user nova-compute[74311]:     </serial>
Oct 20 10:12:10 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:12:10 user nova-compute[74311]:     <video>
Oct 20 10:12:10 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:10 user nova-compute[74311]:     </video>
Oct 20 10:12:10 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:12:10 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:12:10 user nova-compute[74311]:     </rng>
Oct 20 10:12:10 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:12:10 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:12:10 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:12:10 user nova-compute[74311]:     </memballoon>
Oct 20 10:12:10 user nova-compute[74311]:   </devices>
Oct 20 10:12:10 user nova-compute[74311]: </domain>
Oct 20 10:12:10 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-855673579',display_name='tempest-ServersNegativeTestJSON-server-855673579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-855673579',id=1,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbc9455e6a754bafb33349644f579988',ramdisk_id='',reservation_id='r-xvinicnh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1307260612',owner_user_name='tempest-ServersNegativeTestJSON-1307260612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:03Z,user_data=None,user_id='6c40e8a363dd4eaf862c0b61de171130',uuid=47a30844-242f-4a7f-ad9f-232a6e76b4ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3547e076-2273-41d1-829e-062952da0e37", "address": "fa:16:3e:e8:4a:24", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547e076-22", "ovs_interfaceid": "3547e076-2273-41d1-829e-062952da0e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Converting VIF {"id": "3547e076-2273-41d1-829e-062952da0e37", "address": "fa:16:3e:e8:4a:24", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547e076-22", "ovs_interfaceid": "3547e076-2273-41d1-829e-062952da0e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4a:24,bridge_name='br-int',has_traffic_filtering=True,id=3547e076-2273-41d1-829e-062952da0e37,network=Network(5253925b-fda9-426d-8a82-bc8924961ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3547e076-22') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG os_vif [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4a:24,bridge_name='br-int',has_traffic_filtering=True,id=3547e076-2273-41d1-829e-062952da0e37,network=Network(5253925b-fda9-426d-8a82-bc8924961ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3547e076-22') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7365fa0b-9d4a-5758-8e7c-1b4a38c51316', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:12:10 user nova-compute[74311]: WARNING oslo_privsep.priv_context [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] privsep daemon already running
Oct 20 10:12:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.network.neutron [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:12:10 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:12:10 user nova-compute[74311]: DEBUG nova.network.neutron [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Successfully created port: a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG nova.compute.manager [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:12:11 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Creating image(s)
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "/opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "/opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG nova.policy [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5eb8db6bee87451f95e4bfdc61854bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f61456f02bc4688b8cd9d66a2b1868d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3547e076-22, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3547e076-22, col_values=(('qos', UUID('e0521497-9c20-4fcd-9689-1b82ccc8b965')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3547e076-22, col_values=(('external_ids', {'iface-id': '3547e076-2273-41d1-829e-062952da0e37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:4a:24', 'vm-uuid': '47a30844-242f-4a7f-ad9f-232a6e76b4ec'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:11 user nova-compute[74311]: INFO os_vif [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:4a:24,bridge_name='br-int',has_traffic_filtering=True,id=3547e076-2273-41d1-829e-062952da0e37,network=Network(5253925b-fda9-426d-8a82-bc8924961ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3547e076-22')
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a618325-86, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a618325-86, col_values=(('qos', UUID('e92f45bf-6084-435d-a069-43e6e2bfb05d')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a618325-86, col_values=(('external_ids', {'iface-id': '3a618325-862e-4c54-a654-6d3284cb8bf3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:bf:e1', 'vm-uuid': '22d78096-bc6c-4d6b-93b6-845d596ed24b'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:11 user nova-compute[74311]: INFO os_vif [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:bf:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a618325-862e-4c54-a654-6d3284cb8bf3,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a618325-86')
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.187s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] No VIF found with MAC fa:16:3e:e8:4a:24, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk 1073741824" returned: 0 in 0.048s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] No VIF found with MAC fa:16:3e:e2:bf:e1, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.154s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Cannot resize image /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Ensure instance console log exists: /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG nova.network.neutron [req-53f54a19-5dea-4cf7-85fa-4107c2dcd068 req-b8061ba0-050b-4500-b3ab-e626cf41179c service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Updated VIF entry in instance network info cache for port 3547e076-2273-41d1-829e-062952da0e37. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG nova.network.neutron [req-53f54a19-5dea-4cf7-85fa-4107c2dcd068 req-b8061ba0-050b-4500-b3ab-e626cf41179c service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Updating instance_info_cache with network_info: [{"id": "3547e076-2273-41d1-829e-062952da0e37", "address": "fa:16:3e:e8:4a:24", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547e076-22", "ovs_interfaceid": "3547e076-2273-41d1-829e-062952da0e37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-53f54a19-5dea-4cf7-85fa-4107c2dcd068 req-b8061ba0-050b-4500-b3ab-e626cf41179c service nova] Releasing lock "refresh_cache-47a30844-242f-4a7f-ad9f-232a6e76b4ec" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:13 user nova-compute[74311]: DEBUG nova.network.neutron [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Successfully updated port: a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:12:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquired lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:13 user nova-compute[74311]: DEBUG nova.network.neutron [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:12:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.network.neutron [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.compute.manager [req-f3134f1c-ef7d-452c-a884-858be5ca7426 req-2e4008f3-162b-4b7d-89ca-9ade289a796e service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-changed-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.compute.manager [req-f3134f1c-ef7d-452c-a884-858be5ca7426 req-2e4008f3-162b-4b7d-89ca-9ade289a796e service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Refreshing instance network info cache due to event network-changed-a042b1af-3064-4133-97dc-eaf5e3bf4859. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f3134f1c-ef7d-452c-a884-858be5ca7426 req-2e4008f3-162b-4b7d-89ca-9ade289a796e service nova] Acquiring lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Successfully updated port: ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquired lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.compute.manager [req-0ce239a1-b8ad-45b1-b8dc-306f66fecf98 req-33f95eec-5e44-42be-a610-8b58514be414 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received event network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0ce239a1-b8ad-45b1-b8dc-306f66fecf98 req-33f95eec-5e44-42be-a610-8b58514be414 service nova] Acquiring lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0ce239a1-b8ad-45b1-b8dc-306f66fecf98 req-33f95eec-5e44-42be-a610-8b58514be414 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0ce239a1-b8ad-45b1-b8dc-306f66fecf98 req-33f95eec-5e44-42be-a610-8b58514be414 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.compute.manager [req-0ce239a1-b8ad-45b1-b8dc-306f66fecf98 req-33f95eec-5e44-42be-a610-8b58514be414 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] No waiting events found dispatching network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:14 user nova-compute[74311]: WARNING nova.compute.manager [req-0ce239a1-b8ad-45b1-b8dc-306f66fecf98 req-33f95eec-5e44-42be-a610-8b58514be414 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received unexpected event network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 for instance with vm_state building and task_state spawning.
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.compute.manager [req-478a7c47-138a-43ab-93e8-3613a5358213 req-584f061f-7645-4f1b-aa8f-15300409a2f1 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Received event network-changed-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.compute.manager [req-478a7c47-138a-43ab-93e8-3613a5358213 req-584f061f-7645-4f1b-aa8f-15300409a2f1 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Refreshing instance network info cache due to event network-changed-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-478a7c47-138a-43ab-93e8-3613a5358213 req-584f061f-7645-4f1b-aa8f-15300409a2f1 service nova] Acquiring lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.network.neutron [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Successfully created port: 097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.network.neutron [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating instance_info_cache with network_info: [{"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Releasing lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.compute.manager [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Instance network_info: |[{"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f3134f1c-ef7d-452c-a884-858be5ca7426 req-2e4008f3-162b-4b7d-89ca-9ade289a796e service nova] Acquired lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.network.neutron [req-f3134f1c-ef7d-452c-a884-858be5ca7426 req-2e4008f3-162b-4b7d-89ca-9ade289a796e service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Refreshing network info cache for port a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Start _get_guest_xml network_info=[{"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:12:14 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:14 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1040491951',display_name='tempest-ServerActionsTestOtherB-server-1040491951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1040491951',id=3,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYMmO8U1tJG2uyGm7rRRFIfa2RGpjFLZUdepKCTj1HHDZcXkXVS7OOg3Lk+mu44EcWQu9Fu9KdlNYR4A7PzrCGtqSSIRfDMJT14TIDOTSonr8dNWJPGqynHBYamRxl9rg==',key_name='tempest-keypair-849637715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d174f4a262b044e58e8f211b06a41d40',ramdisk_id='',reservation_id='r-z4cepc28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1319179529',owner_user_name='tempest-ServerActionsTestOtherB-1319179529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b357b019ce2a4153af47b9e4c5586148',uuid=2fed360b-584a-4e1a-8e27-9189de7f5007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converting VIF {"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.objects.instance [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fed360b-584a-4e1a-8e27-9189de7f5007 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:12:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:12:14 user nova-compute[74311]:   <uuid>2fed360b-584a-4e1a-8e27-9189de7f5007</uuid>
Oct 20 10:12:14 user nova-compute[74311]:   <name>instance-00000003</name>
Oct 20 10:12:14 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:12:14 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:12:14 user nova-compute[74311]:   <metadata>
Oct 20 10:12:14 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:12:14 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:12:14 user nova-compute[74311]:       <nova:name>tempest-ServerActionsTestOtherB-server-1040491951</nova:name>
Oct 20 10:12:14 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:12:14</nova:creationTime>
Oct 20 10:12:14 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:12:14 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:12:14 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:12:14 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:12:14 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:12:14 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:12:14 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:12:14 user nova-compute[74311]:       <nova:owner>
Oct 20 10:12:14 user nova-compute[74311]:         <nova:user uuid="b357b019ce2a4153af47b9e4c5586148">tempest-ServerActionsTestOtherB-1319179529-project-member</nova:user>
Oct 20 10:12:14 user nova-compute[74311]:         <nova:project uuid="d174f4a262b044e58e8f211b06a41d40">tempest-ServerActionsTestOtherB-1319179529</nova:project>
Oct 20 10:12:14 user nova-compute[74311]:       </nova:owner>
Oct 20 10:12:14 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:12:14 user nova-compute[74311]:       <nova:ports>
Oct 20 10:12:14 user nova-compute[74311]:         <nova:port uuid="a042b1af-3064-4133-97dc-eaf5e3bf4859">
Oct 20 10:12:14 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 10:12:14 user nova-compute[74311]:         </nova:port>
Oct 20 10:12:14 user nova-compute[74311]:       </nova:ports>
Oct 20 10:12:14 user nova-compute[74311]:     </nova:instance>
Oct 20 10:12:14 user nova-compute[74311]:   </metadata>
Oct 20 10:12:14 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:12:14 user nova-compute[74311]:     <system>
Oct 20 10:12:14 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:12:14 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:12:14 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:12:14 user nova-compute[74311]:       <entry name="serial">2fed360b-584a-4e1a-8e27-9189de7f5007</entry>
Oct 20 10:12:14 user nova-compute[74311]:       <entry name="uuid">2fed360b-584a-4e1a-8e27-9189de7f5007</entry>
Oct 20 10:12:14 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:12:14 user nova-compute[74311]:     </system>
Oct 20 10:12:14 user nova-compute[74311]:   </sysinfo>
Oct 20 10:12:14 user nova-compute[74311]:   <os>
Oct 20 10:12:14 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:12:14 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:12:14 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:12:14 user nova-compute[74311]:   </os>
Oct 20 10:12:14 user nova-compute[74311]:   <features>
Oct 20 10:12:14 user nova-compute[74311]:     <acpi/>
Oct 20 10:12:14 user nova-compute[74311]:     <apic/>
Oct 20 10:12:14 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:12:14 user nova-compute[74311]:   </features>
Oct 20 10:12:14 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:12:14 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:12:14 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:12:14 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:12:14 user nova-compute[74311]:   </clock>
Oct 20 10:12:14 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:12:14 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:12:14 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:12:14 user nova-compute[74311]:   </cpu>
Oct 20 10:12:14 user nova-compute[74311]:   <devices>
Oct 20 10:12:14 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:12:14 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:12:14 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk"/>
Oct 20 10:12:14 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:12:14 user nova-compute[74311]:     </disk>
Oct 20 10:12:14 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:12:14 user nova-compute[74311]:       <mac address="fa:16:3e:08:6f:b2"/>
Oct 20 10:12:14 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:14 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:12:14 user nova-compute[74311]:       <target dev="tapa042b1af-30"/>
Oct 20 10:12:14 user nova-compute[74311]:     </interface>
Oct 20 10:12:14 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:12:14 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/console.log" append="off"/>
Oct 20 10:12:14 user nova-compute[74311]:     </serial>
Oct 20 10:12:14 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:12:14 user nova-compute[74311]:     <video>
Oct 20 10:12:14 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:14 user nova-compute[74311]:     </video>
Oct 20 10:12:14 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:12:14 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:12:14 user nova-compute[74311]:     </rng>
Oct 20 10:12:14 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:12:14 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:12:14 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:12:14 user nova-compute[74311]:     </memballoon>
Oct 20 10:12:14 user nova-compute[74311]:   </devices>
Oct 20 10:12:14 user nova-compute[74311]: </domain>
Oct 20 10:12:14 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1040491951',display_name='tempest-ServerActionsTestOtherB-server-1040491951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1040491951',id=3,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYMmO8U1tJG2uyGm7rRRFIfa2RGpjFLZUdepKCTj1HHDZcXkXVS7OOg3Lk+mu44EcWQu9Fu9KdlNYR4A7PzrCGtqSSIRfDMJT14TIDOTSonr8dNWJPGqynHBYamRxl9rg==',key_name='tempest-keypair-849637715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d174f4a262b044e58e8f211b06a41d40',ramdisk_id='',reservation_id='r-z4cepc28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1319179529',owner_user_name='tempest-ServerActionsTestOtherB-1319179529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b357b019ce2a4153af47b9e4c5586148',uuid=2fed360b-584a-4e1a-8e27-9189de7f5007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converting VIF {"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG os_vif [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '952d5d0e-0445-5182-8a21-eafe36663d7b', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa042b1af-30, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa042b1af-30, col_values=(('qos', UUID('d5fa8f30-5136-4ac8-8624-1980fd11b5c5')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa042b1af-30, col_values=(('external_ids', {'iface-id': 'a042b1af-3064-4133-97dc-eaf5e3bf4859', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:6f:b2', 'vm-uuid': '2fed360b-584a-4e1a-8e27-9189de7f5007'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:15 user nova-compute[74311]: INFO os_vif [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30')
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] No VIF found with MAC fa:16:3e:08:6f:b2, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.compute.manager [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Updating instance_info_cache with network_info: [{"id": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "address": "fa:16:3e:f0:04:5d", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6f8ece-93", "ovs_interfaceid": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Releasing lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Instance network_info: |[{"id": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "address": "fa:16:3e:f0:04:5d", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6f8ece-93", "ovs_interfaceid": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-478a7c47-138a-43ab-93e8-3613a5358213 req-584f061f-7645-4f1b-aa8f-15300409a2f1 service nova] Acquired lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.network.neutron [req-478a7c47-138a-43ab-93e8-3613a5358213 req-584f061f-7645-4f1b-aa8f-15300409a2f1 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Refreshing network info cache for port ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Start _get_guest_xml network_info=[{"id": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "address": "fa:16:3e:f0:04:5d", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6f8ece-93", "ovs_interfaceid": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:12:15 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Instance spawned successfully.
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:12:15 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Instance spawned successfully.
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:12:15 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:15 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1356530268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1356530268',id=4,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZB0aNKe9kIku87IHJMADK/Nv8kbo9imDtLDPEWE+5/w6MENrwCSIxG0oLe5qq4fzJKiP0k+N7KImFqQXguRcxoJN9XA+mJYToiupaLKAll/R1UTOUN0lJQABMvnWdt+w==',key_name='tempest-keypair-214066121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61fab5f8b38b490985cc614ade80f25a',ramdisk_id='',reservation_id='r-7i400o0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1592971712',owner_user_name='tempest-AttachVolumeShelveTestJSON-1592971712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1aad9aa1e64a9db4f78c0c12779300',uuid=560c41a4-79a3-461d-976d-f260bc9086f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "address": "fa:16:3e:f0:04:5d", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6f8ece-93", "ovs_interfaceid": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converting VIF {"id": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "address": "fa:16:3e:f0:04:5d", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6f8ece-93", "ovs_interfaceid": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:04:5d,bridge_name='br-int',has_traffic_filtering=True,id=ba6f8ece-930b-4fda-bfb7-3b96f8339bfa,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6f8ece-93') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.objects.instance [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lazy-loading 'pci_devices' on Instance uuid 560c41a4-79a3-461d-976d-f260bc9086f8 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:12:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:12:15 user nova-compute[74311]:   <uuid>560c41a4-79a3-461d-976d-f260bc9086f8</uuid>
Oct 20 10:12:15 user nova-compute[74311]:   <name>instance-00000004</name>
Oct 20 10:12:15 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:12:15 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:12:15 user nova-compute[74311]:   <metadata>
Oct 20 10:12:15 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:12:15 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:12:15 user nova-compute[74311]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1356530268</nova:name>
Oct 20 10:12:15 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:12:15</nova:creationTime>
Oct 20 10:12:15 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:12:15 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:12:15 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:12:15 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:12:15 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:12:15 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:12:15 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:12:15 user nova-compute[74311]:       <nova:owner>
Oct 20 10:12:15 user nova-compute[74311]:         <nova:user uuid="fe1aad9aa1e64a9db4f78c0c12779300">tempest-AttachVolumeShelveTestJSON-1592971712-project-member</nova:user>
Oct 20 10:12:15 user nova-compute[74311]:         <nova:project uuid="61fab5f8b38b490985cc614ade80f25a">tempest-AttachVolumeShelveTestJSON-1592971712</nova:project>
Oct 20 10:12:15 user nova-compute[74311]:       </nova:owner>
Oct 20 10:12:15 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:12:15 user nova-compute[74311]:       <nova:ports>
Oct 20 10:12:15 user nova-compute[74311]:         <nova:port uuid="ba6f8ece-930b-4fda-bfb7-3b96f8339bfa">
Oct 20 10:12:15 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 10:12:15 user nova-compute[74311]:         </nova:port>
Oct 20 10:12:15 user nova-compute[74311]:       </nova:ports>
Oct 20 10:12:15 user nova-compute[74311]:     </nova:instance>
Oct 20 10:12:15 user nova-compute[74311]:   </metadata>
Oct 20 10:12:15 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:12:15 user nova-compute[74311]:     <system>
Oct 20 10:12:15 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:12:15 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:12:15 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:12:15 user nova-compute[74311]:       <entry name="serial">560c41a4-79a3-461d-976d-f260bc9086f8</entry>
Oct 20 10:12:15 user nova-compute[74311]:       <entry name="uuid">560c41a4-79a3-461d-976d-f260bc9086f8</entry>
Oct 20 10:12:15 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:12:15 user nova-compute[74311]:     </system>
Oct 20 10:12:15 user nova-compute[74311]:   </sysinfo>
Oct 20 10:12:15 user nova-compute[74311]:   <os>
Oct 20 10:12:15 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:12:15 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:12:15 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:12:15 user nova-compute[74311]:   </os>
Oct 20 10:12:15 user nova-compute[74311]:   <features>
Oct 20 10:12:15 user nova-compute[74311]:     <acpi/>
Oct 20 10:12:15 user nova-compute[74311]:     <apic/>
Oct 20 10:12:15 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:12:15 user nova-compute[74311]:   </features>
Oct 20 10:12:15 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:12:15 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:12:15 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:12:15 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:12:15 user nova-compute[74311]:   </clock>
Oct 20 10:12:15 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:12:15 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:12:15 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:12:15 user nova-compute[74311]:   </cpu>
Oct 20 10:12:15 user nova-compute[74311]:   <devices>
Oct 20 10:12:15 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:12:15 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:12:15 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk"/>
Oct 20 10:12:15 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:12:15 user nova-compute[74311]:     </disk>
Oct 20 10:12:15 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:12:15 user nova-compute[74311]:       <mac address="fa:16:3e:f0:04:5d"/>
Oct 20 10:12:15 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:15 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:12:15 user nova-compute[74311]:       <target dev="tapba6f8ece-93"/>
Oct 20 10:12:15 user nova-compute[74311]:     </interface>
Oct 20 10:12:15 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:12:15 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/console.log" append="off"/>
Oct 20 10:12:15 user nova-compute[74311]:     </serial>
Oct 20 10:12:15 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:12:15 user nova-compute[74311]:     <video>
Oct 20 10:12:15 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:15 user nova-compute[74311]:     </video>
Oct 20 10:12:15 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:12:15 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:12:15 user nova-compute[74311]:     </rng>
Oct 20 10:12:15 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:12:15 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:12:15 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:12:15 user nova-compute[74311]:     </memballoon>
Oct 20 10:12:15 user nova-compute[74311]:   </devices>
Oct 20 10:12:15 user nova-compute[74311]: </domain>
Oct 20 10:12:15 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1356530268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1356530268',id=4,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZB0aNKe9kIku87IHJMADK/Nv8kbo9imDtLDPEWE+5/w6MENrwCSIxG0oLe5qq4fzJKiP0k+N7KImFqQXguRcxoJN9XA+mJYToiupaLKAll/R1UTOUN0lJQABMvnWdt+w==',key_name='tempest-keypair-214066121',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61fab5f8b38b490985cc614ade80f25a',ramdisk_id='',reservation_id='r-7i400o0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1592971712',owner_user_name='tempest-AttachVolumeShelveTestJSON-1592971712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1aad9aa1e64a9db4f78c0c12779300',uuid=560c41a4-79a3-461d-976d-f260bc9086f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "address": "fa:16:3e:f0:04:5d", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6f8ece-93", "ovs_interfaceid": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converting VIF {"id": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "address": "fa:16:3e:f0:04:5d", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6f8ece-93", "ovs_interfaceid": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:04:5d,bridge_name='br-int',has_traffic_filtering=True,id=ba6f8ece-930b-4fda-bfb7-3b96f8339bfa,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6f8ece-93') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG os_vif [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:04:5d,bridge_name='br-int',has_traffic_filtering=True,id=ba6f8ece-930b-4fda-bfb7-3b96f8339bfa,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6f8ece-93') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '012b85d4-6c66-5182-9508-3e9e24344d11', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:16 user nova-compute[74311]: INFO nova.compute.manager [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Took 13.10 seconds to spawn the instance on the hypervisor.
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba6f8ece-93, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba6f8ece-93, col_values=(('qos', UUID('177f13a2-f796-49a9-9fef-da116478b23c')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba6f8ece-93, col_values=(('external_ids', {'iface-id': 'ba6f8ece-930b-4fda-bfb7-3b96f8339bfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:04:5d', 'vm-uuid': '560c41a4-79a3-461d-976d-f260bc9086f8'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:16 user nova-compute[74311]: INFO os_vif [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:04:5d,bridge_name='br-int',has_traffic_filtering=True,id=ba6f8ece-930b-4fda-bfb7-3b96f8339bfa,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6f8ece-93')
Oct 20 10:12:16 user nova-compute[74311]: INFO nova.compute.manager [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Took 12.64 seconds to spawn the instance on the hypervisor.
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.compute.manager [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:12:16 user nova-compute[74311]: INFO nova.compute.manager [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Took 14.12 seconds to build instance.
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] No VIF found with MAC fa:16:3e:f0:04:5d, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ebbfcc52-e2e2-48aa-a815-034ba44206fe tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.576s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:16 user nova-compute[74311]: INFO nova.compute.manager [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Took 13.53 seconds to build instance.
Oct 20 10:12:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-eb2116d8-71cc-460a-a79e-0d09ffaa21a3 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.666s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received event network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] Acquiring lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] No waiting events found dispatching network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:16 user nova-compute[74311]: WARNING nova.compute.manager [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received unexpected event network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 for instance with vm_state active and task_state None.
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Received event network-vif-plugged-3a618325-862e-4c54-a654-6d3284cb8bf3 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] Acquiring lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] No waiting events found dispatching network-vif-plugged-3a618325-862e-4c54-a654-6d3284cb8bf3 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:16 user nova-compute[74311]: WARNING nova.compute.manager [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Received unexpected event network-vif-plugged-3a618325-862e-4c54-a654-6d3284cb8bf3 for instance with vm_state active and task_state None.
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Received event network-vif-plugged-3a618325-862e-4c54-a654-6d3284cb8bf3 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] Acquiring lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] No waiting events found dispatching network-vif-plugged-3a618325-862e-4c54-a654-6d3284cb8bf3 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:16 user nova-compute[74311]: WARNING nova.compute.manager [req-9ae92215-e1b4-42fd-af8a-07a75b255c18 req-119d674f-a7bc-4ea6-8c07-167c8664fb35 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Received unexpected event network-vif-plugged-3a618325-862e-4c54-a654-6d3284cb8bf3 for instance with vm_state active and task_state None.
Oct 20 10:12:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.network.neutron [req-f3134f1c-ef7d-452c-a884-858be5ca7426 req-2e4008f3-162b-4b7d-89ca-9ade289a796e service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updated VIF entry in instance network info cache for port a042b1af-3064-4133-97dc-eaf5e3bf4859. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG nova.network.neutron [req-f3134f1c-ef7d-452c-a884-858be5ca7426 req-2e4008f3-162b-4b7d-89ca-9ade289a796e service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating instance_info_cache with network_info: [{"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f3134f1c-ef7d-452c-a884-858be5ca7426 req-2e4008f3-162b-4b7d-89ca-9ade289a796e service nova] Releasing lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:17 user nova-compute[74311]: DEBUG nova.network.neutron [req-478a7c47-138a-43ab-93e8-3613a5358213 req-584f061f-7645-4f1b-aa8f-15300409a2f1 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Updated VIF entry in instance network info cache for port ba6f8ece-930b-4fda-bfb7-3b96f8339bfa. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:12:17 user nova-compute[74311]: DEBUG nova.network.neutron [req-478a7c47-138a-43ab-93e8-3613a5358213 req-584f061f-7645-4f1b-aa8f-15300409a2f1 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Updating instance_info_cache with network_info: [{"id": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "address": "fa:16:3e:f0:04:5d", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6f8ece-93", "ovs_interfaceid": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-478a7c47-138a-43ab-93e8-3613a5358213 req-584f061f-7645-4f1b-aa8f-15300409a2f1 service nova] Releasing lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:18 user nova-compute[74311]: DEBUG nova.network.neutron [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Successfully updated port: 097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:12:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquired lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:18 user nova-compute[74311]: DEBUG nova.network.neutron [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:12:18 user nova-compute[74311]: DEBUG nova.compute.manager [req-0cea2a50-d139-41cb-bafd-431135e4990b req-da1b764d-3b76-40be-9213-086237b39551 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Received event network-changed-097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:18 user nova-compute[74311]: DEBUG nova.compute.manager [req-0cea2a50-d139-41cb-bafd-431135e4990b req-da1b764d-3b76-40be-9213-086237b39551 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Refreshing instance network info cache due to event network-changed-097b3196-1731-46ef-a752-fcc882c73dfd. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:12:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0cea2a50-d139-41cb-bafd-431135e4990b req-da1b764d-3b76-40be-9213-086237b39551 service nova] Acquiring lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:18 user nova-compute[74311]: DEBUG nova.network.neutron [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:12:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Updating instance_info_cache with network_info: [{"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Releasing lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Instance network_info: |[{"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0cea2a50-d139-41cb-bafd-431135e4990b req-da1b764d-3b76-40be-9213-086237b39551 service nova] Acquired lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.network.neutron [req-0cea2a50-d139-41cb-bafd-431135e4990b req-da1b764d-3b76-40be-9213-086237b39551 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Refreshing network info cache for port 097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Start _get_guest_xml network_info=[{"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:12:20 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:20 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2112979492',display_name='tempest-ServerActionsTestOtherA-server-2112979492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2112979492',id=5,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrV3Ete25j/fWp9se4mxMWH8BlUBzypkEKDQ+cEJ4VP8hCjsvoAfM2JugNca5+qdBC1FO7G9hMianDZcBDCqTf2/GGIFqvMCvoR42Lgy+aDjy2Ay+qKFAL51raC0WY1Gw==',key_name='tempest-keypair-317846828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-89k3vm79',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=b0b457b8-159b-4533-ac97-dab7ffe0945e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4b:ed,bridge_name='br-int',has_traffic_filtering=True,id=097b3196-1731-46ef-a752-fcc882c73dfd,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097b3196-17') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.objects.instance [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lazy-loading 'pci_devices' on Instance uuid b0b457b8-159b-4533-ac97-dab7ffe0945e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:12:20 user nova-compute[74311]:   <uuid>b0b457b8-159b-4533-ac97-dab7ffe0945e</uuid>
Oct 20 10:12:20 user nova-compute[74311]:   <name>instance-00000005</name>
Oct 20 10:12:20 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:12:20 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:12:20 user nova-compute[74311]:   <metadata>
Oct 20 10:12:20 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:12:20 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:12:20 user nova-compute[74311]:       <nova:name>tempest-ServerActionsTestOtherA-server-2112979492</nova:name>
Oct 20 10:12:20 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:12:20</nova:creationTime>
Oct 20 10:12:20 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:12:20 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:12:20 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:12:20 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:12:20 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:12:20 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:12:20 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:12:20 user nova-compute[74311]:       <nova:owner>
Oct 20 10:12:20 user nova-compute[74311]:         <nova:user uuid="5eb8db6bee87451f95e4bfdc61854bc5">tempest-ServerActionsTestOtherA-2000022938-project-member</nova:user>
Oct 20 10:12:20 user nova-compute[74311]:         <nova:project uuid="2f61456f02bc4688b8cd9d66a2b1868d">tempest-ServerActionsTestOtherA-2000022938</nova:project>
Oct 20 10:12:20 user nova-compute[74311]:       </nova:owner>
Oct 20 10:12:20 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:12:20 user nova-compute[74311]:       <nova:ports>
Oct 20 10:12:20 user nova-compute[74311]:         <nova:port uuid="097b3196-1731-46ef-a752-fcc882c73dfd">
Oct 20 10:12:20 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 10:12:20 user nova-compute[74311]:         </nova:port>
Oct 20 10:12:20 user nova-compute[74311]:       </nova:ports>
Oct 20 10:12:20 user nova-compute[74311]:     </nova:instance>
Oct 20 10:12:20 user nova-compute[74311]:   </metadata>
Oct 20 10:12:20 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:12:20 user nova-compute[74311]:     <system>
Oct 20 10:12:20 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:12:20 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:12:20 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:12:20 user nova-compute[74311]:       <entry name="serial">b0b457b8-159b-4533-ac97-dab7ffe0945e</entry>
Oct 20 10:12:20 user nova-compute[74311]:       <entry name="uuid">b0b457b8-159b-4533-ac97-dab7ffe0945e</entry>
Oct 20 10:12:20 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:12:20 user nova-compute[74311]:     </system>
Oct 20 10:12:20 user nova-compute[74311]:   </sysinfo>
Oct 20 10:12:20 user nova-compute[74311]:   <os>
Oct 20 10:12:20 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:12:20 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:12:20 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:12:20 user nova-compute[74311]:   </os>
Oct 20 10:12:20 user nova-compute[74311]:   <features>
Oct 20 10:12:20 user nova-compute[74311]:     <acpi/>
Oct 20 10:12:20 user nova-compute[74311]:     <apic/>
Oct 20 10:12:20 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:12:20 user nova-compute[74311]:   </features>
Oct 20 10:12:20 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:12:20 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:12:20 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:12:20 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:12:20 user nova-compute[74311]:   </clock>
Oct 20 10:12:20 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:12:20 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:12:20 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:12:20 user nova-compute[74311]:   </cpu>
Oct 20 10:12:20 user nova-compute[74311]:   <devices>
Oct 20 10:12:20 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:12:20 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:12:20 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk"/>
Oct 20 10:12:20 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:12:20 user nova-compute[74311]:     </disk>
Oct 20 10:12:20 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:12:20 user nova-compute[74311]:       <mac address="fa:16:3e:eb:4b:ed"/>
Oct 20 10:12:20 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:20 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:12:20 user nova-compute[74311]:       <target dev="tap097b3196-17"/>
Oct 20 10:12:20 user nova-compute[74311]:     </interface>
Oct 20 10:12:20 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:12:20 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/console.log" append="off"/>
Oct 20 10:12:20 user nova-compute[74311]:     </serial>
Oct 20 10:12:20 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:12:20 user nova-compute[74311]:     <video>
Oct 20 10:12:20 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:20 user nova-compute[74311]:     </video>
Oct 20 10:12:20 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:12:20 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:12:20 user nova-compute[74311]:     </rng>
Oct 20 10:12:20 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:12:20 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:12:20 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:12:20 user nova-compute[74311]:     </memballoon>
Oct 20 10:12:20 user nova-compute[74311]:   </devices>
Oct 20 10:12:20 user nova-compute[74311]: </domain>
Oct 20 10:12:20 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2112979492',display_name='tempest-ServerActionsTestOtherA-server-2112979492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2112979492',id=5,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrV3Ete25j/fWp9se4mxMWH8BlUBzypkEKDQ+cEJ4VP8hCjsvoAfM2JugNca5+qdBC1FO7G9hMianDZcBDCqTf2/GGIFqvMCvoR42Lgy+aDjy2Ay+qKFAL51raC0WY1Gw==',key_name='tempest-keypair-317846828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-89k3vm79',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=b0b457b8-159b-4533-ac97-dab7ffe0945e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4b:ed,bridge_name='br-int',has_traffic_filtering=True,id=097b3196-1731-46ef-a752-fcc882c73dfd,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097b3196-17') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG os_vif [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4b:ed,bridge_name='br-int',has_traffic_filtering=True,id=097b3196-1731-46ef-a752-fcc882c73dfd,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097b3196-17') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '708aca8d-a9e0-5b0c-a465-d9b396901369', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap097b3196-17, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap097b3196-17, col_values=(('qos', UUID('4560bfac-0fae-4981-b0c7-2ba6594b84b5')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap097b3196-17, col_values=(('external_ids', {'iface-id': '097b3196-1731-46ef-a752-fcc882c73dfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:4b:ed', 'vm-uuid': 'b0b457b8-159b-4533-ac97-dab7ffe0945e'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:20 user nova-compute[74311]: INFO os_vif [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4b:ed,bridge_name='br-int',has_traffic_filtering=True,id=097b3196-1731-46ef-a752-fcc882c73dfd,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097b3196-17')
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] No VIF found with MAC fa:16:3e:eb:4b:ed, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:12:20 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Instance spawned successfully.
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:21 user nova-compute[74311]: INFO nova.compute.manager [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Took 13.09 seconds to spawn the instance on the hypervisor.
Oct 20 10:12:21 user nova-compute[74311]: DEBUG nova.compute.manager [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:12:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:21 user nova-compute[74311]: INFO nova.compute.manager [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Took 14.00 seconds to build instance.
Oct 20 10:12:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-354fceec-2427-4927-bfb6-42cc6846c26d tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.180s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:22 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Instance spawned successfully.
Oct 20 10:12:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:22 user nova-compute[74311]: INFO nova.compute.manager [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Took 14.05 seconds to spawn the instance on the hypervisor.
Oct 20 10:12:22 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:22 user nova-compute[74311]: INFO nova.compute.manager [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Took 14.98 seconds to build instance.
Oct 20 10:12:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4f5e9f5b-4231-4daa-b12a-9e68937691a5 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "560c41a4-79a3-461d-976d-f260bc9086f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.151s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:23 user nova-compute[74311]: DEBUG nova.network.neutron [req-0cea2a50-d139-41cb-bafd-431135e4990b req-da1b764d-3b76-40be-9213-086237b39551 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Updated VIF entry in instance network info cache for port 097b3196-1731-46ef-a752-fcc882c73dfd. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:12:23 user nova-compute[74311]: DEBUG nova.network.neutron [req-0cea2a50-d139-41cb-bafd-431135e4990b req-da1b764d-3b76-40be-9213-086237b39551 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Updating instance_info_cache with network_info: [{"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0cea2a50-d139-41cb-bafd-431135e4990b req-da1b764d-3b76-40be-9213-086237b39551 service nova] Releasing lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:12:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:12:26 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Instance spawned successfully.
Oct 20 10:12:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:12:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:26 user nova-compute[74311]: INFO nova.compute.manager [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Took 15.37 seconds to spawn the instance on the hypervisor.
Oct 20 10:12:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:12:26 user nova-compute[74311]: INFO nova.compute.manager [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Took 16.24 seconds to build instance.
Oct 20 10:12:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29795ee3-3b5a-4a61-95a6-946d444178a4 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.356s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:12:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:12:30 user nova-compute[74311]: INFO nova.compute.claims [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Claim successful on node user
Oct 20 10:12:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:31 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:12:31 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:12:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.056s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:12:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:12:32 user nova-compute[74311]: DEBUG nova.network.neutron [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:12:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 20 10:12:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:12:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:32 user nova-compute[74311]: DEBUG nova.policy [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1e26ba3870d4546b18d45cd4f83c5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63abe0204d114b75b7c2eff41b6fbb19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:12:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:12:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:12:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Creating image(s)
Oct 20 10:12:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "/opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "/opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "/opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "1dd8a5351d36f0b71969628a045ad413e2085427" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "1dd8a5351d36f0b71969628a045ad413e2085427" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427.part --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "ed823684-5b31-4b43-a601-bb5e303e0863" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "ed823684-5b31-4b43-a601-bb5e303e0863" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:33 user nova-compute[74311]: DEBUG nova.compute.manager [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:12:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427.part --force-share --output=json" returned: 0 in 0.304s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:33 user nova-compute[74311]: DEBUG nova.virt.images [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] 8427a028-b2d7-45cd-b32f-9d113bc32b3b was qcow2, converting to raw {{(pid=74311) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 10:12:33 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:12:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427.part /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427.converted {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:12:33 user nova-compute[74311]: INFO nova.compute.claims [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Claim successful on node user
Oct 20 10:12:33 user nova-compute[74311]: DEBUG nova.network.neutron [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Successfully created port: c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:12:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427.part /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427.converted" returned: 0 in 0.385s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427.converted --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427.converted --force-share --output=json" returned: 0 in 0.305s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "1dd8a5351d36f0b71969628a045ad413e2085427" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.737s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427 --force-share --output=json" returned: 0 in 0.281s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "1dd8a5351d36f0b71969628a045ad413e2085427" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "1dd8a5351d36f0b71969628a045ad413e2085427" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.152s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG nova.compute.manager [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427 --force-share --output=json" returned: 0 in 0.387s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427,backing_fmt=raw /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427,backing_fmt=raw /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk 1073741824" returned: 0 in 0.125s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "1dd8a5351d36f0b71969628a045ad413e2085427" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.520s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG nova.compute.manager [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:12:34 user nova-compute[74311]: DEBUG nova.network.neutron [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:12:34 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:12:35 user nova-compute[74311]: DEBUG nova.compute.manager [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427 --force-share --output=json" returned: 0 in 0.221s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG nova.compute.manager [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:12:35 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Creating image(s)
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "/opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "/opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Cannot resize image /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Ensure instance console log exists: /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG nova.policy [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f53d41e3e16e47198a9a0381fd683244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6afc4c55cdc4c01ab172638b262a976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.219s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG nova.network.neutron [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Successfully updated port: c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "refresh_cache-4dd0bb76-160a-4247-8bf7-5e28745fe4e5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquired lock "refresh_cache-4dd0bb76-160a-4247-8bf7-5e28745fe4e5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG nova.network.neutron [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-33793a09-ac4f-4820-a0aa-d9b8592293a2 req-f24e1b4c-3451-4636-8b1e-88dc61f807e2 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Received event network-changed-c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-33793a09-ac4f-4820-a0aa-d9b8592293a2 req-f24e1b4c-3451-4636-8b1e-88dc61f807e2 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Refreshing instance network info cache due to event network-changed-c02afa9c-c54e-4894-a7ee-568784a07d55. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-33793a09-ac4f-4820-a0aa-d9b8592293a2 req-f24e1b4c-3451-4636-8b1e-88dc61f807e2 service nova] Acquiring lock "refresh_cache-4dd0bb76-160a-4247-8bf7-5e28745fe4e5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG nova.network.neutron [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.256s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk 1073741824" returned: 0 in 0.060s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.218s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Cannot resize image /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Ensure instance console log exists: /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.network.neutron [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Updating instance_info_cache with network_info: [{"id": "c02afa9c-c54e-4894-a7ee-568784a07d55", "address": "fa:16:3e:4c:e0:96", "network": {"id": "e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-705302433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abe0204d114b75b7c2eff41b6fbb19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02afa9c-c5", "ovs_interfaceid": "c02afa9c-c54e-4894-a7ee-568784a07d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Releasing lock "refresh_cache-4dd0bb76-160a-4247-8bf7-5e28745fe4e5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.compute.manager [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Instance network_info: |[{"id": "c02afa9c-c54e-4894-a7ee-568784a07d55", "address": "fa:16:3e:4c:e0:96", "network": {"id": "e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-705302433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abe0204d114b75b7c2eff41b6fbb19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02afa9c-c5", "ovs_interfaceid": "c02afa9c-c54e-4894-a7ee-568784a07d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-33793a09-ac4f-4820-a0aa-d9b8592293a2 req-f24e1b4c-3451-4636-8b1e-88dc61f807e2 service nova] Acquired lock "refresh_cache-4dd0bb76-160a-4247-8bf7-5e28745fe4e5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.network.neutron [req-33793a09-ac4f-4820-a0aa-d9b8592293a2 req-f24e1b4c-3451-4636-8b1e-88dc61f807e2 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Refreshing network info cache for port c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Start _get_guest_xml network_info=[{"id": "c02afa9c-c54e-4894-a7ee-568784a07d55", "address": "fa:16:3e:4c:e0:96", "network": {"id": "e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-705302433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abe0204d114b75b7c2eff41b6fbb19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02afa9c-c5", "ovs_interfaceid": "c02afa9c-c54e-4894-a7ee-568784a07d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:12:19Z,direct_url=<?>,disk_format='qcow2',id=8427a028-b2d7-45cd-b32f-9d113bc32b3b,min_disk=0,min_ram=0,name='',owner='2a61c36d3fbf4eebaaf9dc04e489efda',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:12:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'guest_format': None, 'disk_bus': 'scsi', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '8427a028-b2d7-45cd-b32f-9d113bc32b3b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:12:36 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:36 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:12:19Z,direct_url=<?>,disk_format='qcow2',id=8427a028-b2d7-45cd-b32f-9d113bc32b3b,min_disk=0,min_ram=0,name='',owner='2a61c36d3fbf4eebaaf9dc04e489efda',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:12:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1624968394',display_name='tempest-AttachSCSIVolumeTestJSON-server-1624968394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1624968394',id=6,image_ref='8427a028-b2d7-45cd-b32f-9d113bc32b3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBI8lRuL7ft6Q6GowooTedPfc6tPy6eyW1QfkTrwa/VM14hNb2kAl5g/XZfqFPqw3+dxmlgNd8laduw+kqVqbN9e8UXs+jifTHvgjkSOeeR3SnhSN2xZ8IlE9S+7NnvfYg==',key_name='tempest-keypair-1263924815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63abe0204d114b75b7c2eff41b6fbb19',ramdisk_id='',reservation_id='r-7wo13m0t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8427a028-b2d7-45cd-b32f-9d113bc32b3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1945506651',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1945506651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1e26ba3870d4546b18d45cd4f83c5fb',uuid=4dd0bb76-160a-4247-8bf7-5e28745fe4e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c02afa9c-c54e-4894-a7ee-568784a07d55", "address": "fa:16:3e:4c:e0:96", "network": {"id": "e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-705302433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abe0204d114b75b7c2eff41b6fbb19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02afa9c-c5", "ovs_interfaceid": "c02afa9c-c54e-4894-a7ee-568784a07d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Converting VIF {"id": "c02afa9c-c54e-4894-a7ee-568784a07d55", "address": "fa:16:3e:4c:e0:96", "network": {"id": "e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-705302433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abe0204d114b75b7c2eff41b6fbb19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02afa9c-c5", "ovs_interfaceid": "c02afa9c-c54e-4894-a7ee-568784a07d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e0:96,bridge_name='br-int',has_traffic_filtering=True,id=c02afa9c-c54e-4894-a7ee-568784a07d55,network=Network(e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02afa9c-c5') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.objects.instance [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dd0bb76-160a-4247-8bf7-5e28745fe4e5 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:12:36 user nova-compute[74311]:   <uuid>4dd0bb76-160a-4247-8bf7-5e28745fe4e5</uuid>
Oct 20 10:12:36 user nova-compute[74311]:   <name>instance-00000006</name>
Oct 20 10:12:36 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:12:36 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:12:36 user nova-compute[74311]:   <metadata>
Oct 20 10:12:36 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:12:36 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:12:36 user nova-compute[74311]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1624968394</nova:name>
Oct 20 10:12:36 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:12:36</nova:creationTime>
Oct 20 10:12:36 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:12:36 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:12:36 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:12:36 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:12:36 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:12:36 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:12:36 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:12:36 user nova-compute[74311]:       <nova:owner>
Oct 20 10:12:36 user nova-compute[74311]:         <nova:user uuid="d1e26ba3870d4546b18d45cd4f83c5fb">tempest-AttachSCSIVolumeTestJSON-1945506651-project-member</nova:user>
Oct 20 10:12:36 user nova-compute[74311]:         <nova:project uuid="63abe0204d114b75b7c2eff41b6fbb19">tempest-AttachSCSIVolumeTestJSON-1945506651</nova:project>
Oct 20 10:12:36 user nova-compute[74311]:       </nova:owner>
Oct 20 10:12:36 user nova-compute[74311]:       <nova:root type="image" uuid="8427a028-b2d7-45cd-b32f-9d113bc32b3b"/>
Oct 20 10:12:36 user nova-compute[74311]:       <nova:ports>
Oct 20 10:12:36 user nova-compute[74311]:         <nova:port uuid="c02afa9c-c54e-4894-a7ee-568784a07d55">
Oct 20 10:12:36 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 10:12:36 user nova-compute[74311]:         </nova:port>
Oct 20 10:12:36 user nova-compute[74311]:       </nova:ports>
Oct 20 10:12:36 user nova-compute[74311]:     </nova:instance>
Oct 20 10:12:36 user nova-compute[74311]:   </metadata>
Oct 20 10:12:36 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:12:36 user nova-compute[74311]:     <system>
Oct 20 10:12:36 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:12:36 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:12:36 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:12:36 user nova-compute[74311]:       <entry name="serial">4dd0bb76-160a-4247-8bf7-5e28745fe4e5</entry>
Oct 20 10:12:36 user nova-compute[74311]:       <entry name="uuid">4dd0bb76-160a-4247-8bf7-5e28745fe4e5</entry>
Oct 20 10:12:36 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:12:36 user nova-compute[74311]:     </system>
Oct 20 10:12:36 user nova-compute[74311]:   </sysinfo>
Oct 20 10:12:36 user nova-compute[74311]:   <os>
Oct 20 10:12:36 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:12:36 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:12:36 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:12:36 user nova-compute[74311]:   </os>
Oct 20 10:12:36 user nova-compute[74311]:   <features>
Oct 20 10:12:36 user nova-compute[74311]:     <acpi/>
Oct 20 10:12:36 user nova-compute[74311]:     <apic/>
Oct 20 10:12:36 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:12:36 user nova-compute[74311]:   </features>
Oct 20 10:12:36 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:12:36 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:12:36 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:12:36 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:12:36 user nova-compute[74311]:   </clock>
Oct 20 10:12:36 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:12:36 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:12:36 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:12:36 user nova-compute[74311]:   </cpu>
Oct 20 10:12:36 user nova-compute[74311]:   <devices>
Oct 20 10:12:36 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:12:36 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:12:36 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk"/>
Oct 20 10:12:36 user nova-compute[74311]:       <target dev="sda" bus="scsi"/>
Oct 20 10:12:36 user nova-compute[74311]:       <address type="drive" controller="0" unit="0"/>
Oct 20 10:12:36 user nova-compute[74311]:     </disk>
Oct 20 10:12:36 user nova-compute[74311]:     <disk type="file" device="cdrom">
Oct 20 10:12:36 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 10:12:36 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk.config"/>
Oct 20 10:12:36 user nova-compute[74311]:       <target dev="sdb" bus="scsi"/>
Oct 20 10:12:36 user nova-compute[74311]:       <address type="drive" controller="0" unit="1"/>
Oct 20 10:12:36 user nova-compute[74311]:     </disk>
Oct 20 10:12:36 user nova-compute[74311]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 20 10:12:36 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:12:36 user nova-compute[74311]:       <mac address="fa:16:3e:4c:e0:96"/>
Oct 20 10:12:36 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:36 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:12:36 user nova-compute[74311]:       <target dev="tapc02afa9c-c5"/>
Oct 20 10:12:36 user nova-compute[74311]:     </interface>
Oct 20 10:12:36 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:12:36 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/console.log" append="off"/>
Oct 20 10:12:36 user nova-compute[74311]:     </serial>
Oct 20 10:12:36 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:12:36 user nova-compute[74311]:     <video>
Oct 20 10:12:36 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:36 user nova-compute[74311]:     </video>
Oct 20 10:12:36 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:12:36 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:12:36 user nova-compute[74311]:     </rng>
Oct 20 10:12:36 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:12:36 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:12:36 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:12:36 user nova-compute[74311]:     </memballoon>
Oct 20 10:12:36 user nova-compute[74311]:   </devices>
Oct 20 10:12:36 user nova-compute[74311]: </domain>
Oct 20 10:12:36 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1624968394',display_name='tempest-AttachSCSIVolumeTestJSON-server-1624968394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1624968394',id=6,image_ref='8427a028-b2d7-45cd-b32f-9d113bc32b3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBI8lRuL7ft6Q6GowooTedPfc6tPy6eyW1QfkTrwa/VM14hNb2kAl5g/XZfqFPqw3+dxmlgNd8laduw+kqVqbN9e8UXs+jifTHvgjkSOeeR3SnhSN2xZ8IlE9S+7NnvfYg==',key_name='tempest-keypair-1263924815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63abe0204d114b75b7c2eff41b6fbb19',ramdisk_id='',reservation_id='r-7wo13m0t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8427a028-b2d7-45cd-b32f-9d113bc32b3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1945506651',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1945506651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1e26ba3870d4546b18d45cd4f83c5fb',uuid=4dd0bb76-160a-4247-8bf7-5e28745fe4e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c02afa9c-c54e-4894-a7ee-568784a07d55", "address": "fa:16:3e:4c:e0:96", "network": {"id": "e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-705302433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abe0204d114b75b7c2eff41b6fbb19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02afa9c-c5", "ovs_interfaceid": "c02afa9c-c54e-4894-a7ee-568784a07d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Converting VIF {"id": "c02afa9c-c54e-4894-a7ee-568784a07d55", "address": "fa:16:3e:4c:e0:96", "network": {"id": "e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-705302433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abe0204d114b75b7c2eff41b6fbb19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02afa9c-c5", "ovs_interfaceid": "c02afa9c-c54e-4894-a7ee-568784a07d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e0:96,bridge_name='br-int',has_traffic_filtering=True,id=c02afa9c-c54e-4894-a7ee-568784a07d55,network=Network(e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02afa9c-c5') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG os_vif [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e0:96,bridge_name='br-int',has_traffic_filtering=True,id=c02afa9c-c54e-4894-a7ee-568784a07d55,network=Network(e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02afa9c-c5') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8243af4e-8830-5605-be32-0907bfe51010', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc02afa9c-c5, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc02afa9c-c5, col_values=(('qos', UUID('a048534c-97eb-456f-ae7f-7e368882c37f')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc02afa9c-c5, col_values=(('external_ids', {'iface-id': 'c02afa9c-c54e-4894-a7ee-568784a07d55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:e0:96', 'vm-uuid': '4dd0bb76-160a-4247-8bf7-5e28745fe4e5'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:36 user nova-compute[74311]: INFO os_vif [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:e0:96,bridge_name='br-int',has_traffic_filtering=True,id=c02afa9c-c54e-4894-a7ee-568784a07d55,network=Network(e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02afa9c-c5')
Oct 20 10:12:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] No BDM found with device name sda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:12:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:12:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] No VIF found with MAC fa:16:3e:4c:e0:96, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:12:37 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Using config drive
Oct 20 10:12:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:37 user nova-compute[74311]: DEBUG nova.network.neutron [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Successfully created port: 24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:12:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "023498fa-b18b-4947-9b09-e9f6caafa931" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "023498fa-b18b-4947-9b09-e9f6caafa931" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:37 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:12:37 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Creating config drive at /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk.config
Oct 20 10:12:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1togqxry {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:37 user nova-compute[74311]: DEBUG nova.network.neutron [req-33793a09-ac4f-4820-a0aa-d9b8592293a2 req-f24e1b4c-3451-4636-8b1e-88dc61f807e2 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Updated VIF entry in instance network info cache for port c02afa9c-c54e-4894-a7ee-568784a07d55. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:12:37 user nova-compute[74311]: DEBUG nova.network.neutron [req-33793a09-ac4f-4820-a0aa-d9b8592293a2 req-f24e1b4c-3451-4636-8b1e-88dc61f807e2 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Updating instance_info_cache with network_info: [{"id": "c02afa9c-c54e-4894-a7ee-568784a07d55", "address": "fa:16:3e:4c:e0:96", "network": {"id": "e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-705302433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abe0204d114b75b7c2eff41b6fbb19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02afa9c-c5", "ovs_interfaceid": "c02afa9c-c54e-4894-a7ee-568784a07d55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:12:37 user nova-compute[74311]: INFO nova.compute.claims [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Claim successful on node user
Oct 20 10:12:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1togqxry" returned: 0 in 0.074s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-33793a09-ac4f-4820-a0aa-d9b8592293a2 req-f24e1b4c-3451-4636-8b1e-88dc61f807e2 service nova] Releasing lock "refresh_cache-4dd0bb76-160a-4247-8bf7-5e28745fe4e5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.627s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG nova.network.neutron [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Successfully updated port: 24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "refresh_cache-ed823684-5b31-4b43-a601-bb5e303e0863" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquired lock "refresh_cache-ed823684-5b31-4b43-a601-bb5e303e0863" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG nova.network.neutron [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG nova.compute.manager [req-28e6b004-f3c2-4daa-be33-6861786b54a4 req-1dd8cc5d-4556-4c8b-9055-d81c646edf17 service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Received event network-changed-24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG nova.compute.manager [req-28e6b004-f3c2-4daa-be33-6861786b54a4 req-1dd8cc5d-4556-4c8b-9055-d81c646edf17 service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Refreshing instance network info cache due to event network-changed-24cefeda-ceaf-460b-b902-a5895a6bb394. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-28e6b004-f3c2-4daa-be33-6861786b54a4 req-1dd8cc5d-4556-4c8b-9055-d81c646edf17 service nova] Acquiring lock "refresh_cache-ed823684-5b31-4b43-a601-bb5e303e0863" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:12:38 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:12:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG nova.network.neutron [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG nova.policy [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ba84b7bf6a7418a821a22bbd3b0569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b3aaaa066740fa913e22537f799e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:12:38 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Creating image(s)
Oct 20 10:12:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.216s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.233s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.network.neutron [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Updating instance_info_cache with network_info: [{"id": "24cefeda-ceaf-460b-b902-a5895a6bb394", "address": "fa:16:3e:08:f0:9b", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cefeda-ce", "ovs_interfaceid": "24cefeda-ceaf-460b-b902-a5895a6bb394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk 1073741824" returned: 0 in 0.083s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Releasing lock "refresh_cache-ed823684-5b31-4b43-a601-bb5e303e0863" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Instance network_info: |[{"id": "24cefeda-ceaf-460b-b902-a5895a6bb394", "address": "fa:16:3e:08:f0:9b", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cefeda-ce", "ovs_interfaceid": "24cefeda-ceaf-460b-b902-a5895a6bb394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-28e6b004-f3c2-4daa-be33-6861786b54a4 req-1dd8cc5d-4556-4c8b-9055-d81c646edf17 service nova] Acquired lock "refresh_cache-ed823684-5b31-4b43-a601-bb5e303e0863" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.network.neutron [req-28e6b004-f3c2-4daa-be33-6861786b54a4 req-1dd8cc5d-4556-4c8b-9055-d81c646edf17 service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Refreshing network info cache for port 24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Start _get_guest_xml network_info=[{"id": "24cefeda-ceaf-460b-b902-a5895a6bb394", "address": "fa:16:3e:08:f0:9b", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cefeda-ce", "ovs_interfaceid": "24cefeda-ceaf-460b-b902-a5895a6bb394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:12:39 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:39 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1489093091',display_name='tempest-VolumesAdminNegativeTest-server-1489093091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1489093091',id=7,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExeqd9Ke//Vk7oETXDip59BSJafFEINeMl4IlWBHmg9MXb83KGCEQB8vYFGYPXs5LpBPWlexLGDZorm0rO1xICUUWSUB/OTzZTGdZFeDPjH/EOC+NTIriR8Z6sGYG1btw==',key_name='tempest-keypair-1852808818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6afc4c55cdc4c01ab172638b262a976',ramdisk_id='',reservation_id='r-5c0csvyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-230171363',owner_user_name='tempest-VolumesAdminNegativeTest-230171363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f53d41e3e16e47198a9a0381fd683244',uuid=ed823684-5b31-4b43-a601-bb5e303e0863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24cefeda-ceaf-460b-b902-a5895a6bb394", "address": "fa:16:3e:08:f0:9b", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cefeda-ce", "ovs_interfaceid": "24cefeda-ceaf-460b-b902-a5895a6bb394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Converting VIF {"id": "24cefeda-ceaf-460b-b902-a5895a6bb394", "address": "fa:16:3e:08:f0:9b", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cefeda-ce", "ovs_interfaceid": "24cefeda-ceaf-460b-b902-a5895a6bb394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:f0:9b,bridge_name='br-int',has_traffic_filtering=True,id=24cefeda-ceaf-460b-b902-a5895a6bb394,network=Network(b8fa77f6-0c71-4754-a562-9f147defb87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cefeda-ce') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.objects.instance [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lazy-loading 'pci_devices' on Instance uuid ed823684-5b31-4b43-a601-bb5e303e0863 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:12:39 user nova-compute[74311]:   <uuid>ed823684-5b31-4b43-a601-bb5e303e0863</uuid>
Oct 20 10:12:39 user nova-compute[74311]:   <name>instance-00000007</name>
Oct 20 10:12:39 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:12:39 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:12:39 user nova-compute[74311]:   <metadata>
Oct 20 10:12:39 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:12:39 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:12:39 user nova-compute[74311]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1489093091</nova:name>
Oct 20 10:12:39 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:12:39</nova:creationTime>
Oct 20 10:12:39 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:12:39 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:12:39 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:12:39 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:12:39 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:12:39 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:12:39 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:12:39 user nova-compute[74311]:       <nova:owner>
Oct 20 10:12:39 user nova-compute[74311]:         <nova:user uuid="f53d41e3e16e47198a9a0381fd683244">tempest-VolumesAdminNegativeTest-230171363-project-member</nova:user>
Oct 20 10:12:39 user nova-compute[74311]:         <nova:project uuid="b6afc4c55cdc4c01ab172638b262a976">tempest-VolumesAdminNegativeTest-230171363</nova:project>
Oct 20 10:12:39 user nova-compute[74311]:       </nova:owner>
Oct 20 10:12:39 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:12:39 user nova-compute[74311]:       <nova:ports>
Oct 20 10:12:39 user nova-compute[74311]:         <nova:port uuid="24cefeda-ceaf-460b-b902-a5895a6bb394">
Oct 20 10:12:39 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 10:12:39 user nova-compute[74311]:         </nova:port>
Oct 20 10:12:39 user nova-compute[74311]:       </nova:ports>
Oct 20 10:12:39 user nova-compute[74311]:     </nova:instance>
Oct 20 10:12:39 user nova-compute[74311]:   </metadata>
Oct 20 10:12:39 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:12:39 user nova-compute[74311]:     <system>
Oct 20 10:12:39 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:12:39 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:12:39 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:12:39 user nova-compute[74311]:       <entry name="serial">ed823684-5b31-4b43-a601-bb5e303e0863</entry>
Oct 20 10:12:39 user nova-compute[74311]:       <entry name="uuid">ed823684-5b31-4b43-a601-bb5e303e0863</entry>
Oct 20 10:12:39 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:12:39 user nova-compute[74311]:     </system>
Oct 20 10:12:39 user nova-compute[74311]:   </sysinfo>
Oct 20 10:12:39 user nova-compute[74311]:   <os>
Oct 20 10:12:39 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:12:39 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:12:39 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:12:39 user nova-compute[74311]:   </os>
Oct 20 10:12:39 user nova-compute[74311]:   <features>
Oct 20 10:12:39 user nova-compute[74311]:     <acpi/>
Oct 20 10:12:39 user nova-compute[74311]:     <apic/>
Oct 20 10:12:39 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:12:39 user nova-compute[74311]:   </features>
Oct 20 10:12:39 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:12:39 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:12:39 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:12:39 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:12:39 user nova-compute[74311]:   </clock>
Oct 20 10:12:39 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:12:39 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:12:39 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:12:39 user nova-compute[74311]:   </cpu>
Oct 20 10:12:39 user nova-compute[74311]:   <devices>
Oct 20 10:12:39 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:12:39 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:12:39 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk"/>
Oct 20 10:12:39 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:12:39 user nova-compute[74311]:     </disk>
Oct 20 10:12:39 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:12:39 user nova-compute[74311]:       <mac address="fa:16:3e:08:f0:9b"/>
Oct 20 10:12:39 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:39 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:12:39 user nova-compute[74311]:       <target dev="tap24cefeda-ce"/>
Oct 20 10:12:39 user nova-compute[74311]:     </interface>
Oct 20 10:12:39 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:12:39 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/console.log" append="off"/>
Oct 20 10:12:39 user nova-compute[74311]:     </serial>
Oct 20 10:12:39 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:12:39 user nova-compute[74311]:     <video>
Oct 20 10:12:39 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:39 user nova-compute[74311]:     </video>
Oct 20 10:12:39 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:12:39 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:12:39 user nova-compute[74311]:     </rng>
Oct 20 10:12:39 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:12:39 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:12:39 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:12:39 user nova-compute[74311]:     </memballoon>
Oct 20 10:12:39 user nova-compute[74311]:   </devices>
Oct 20 10:12:39 user nova-compute[74311]: </domain>
Oct 20 10:12:39 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1489093091',display_name='tempest-VolumesAdminNegativeTest-server-1489093091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1489093091',id=7,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExeqd9Ke//Vk7oETXDip59BSJafFEINeMl4IlWBHmg9MXb83KGCEQB8vYFGYPXs5LpBPWlexLGDZorm0rO1xICUUWSUB/OTzZTGdZFeDPjH/EOC+NTIriR8Z6sGYG1btw==',key_name='tempest-keypair-1852808818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6afc4c55cdc4c01ab172638b262a976',ramdisk_id='',reservation_id='r-5c0csvyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-230171363',owner_user_name='tempest-VolumesAdminNegativeTest-230171363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f53d41e3e16e47198a9a0381fd683244',uuid=ed823684-5b31-4b43-a601-bb5e303e0863,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24cefeda-ceaf-460b-b902-a5895a6bb394", "address": "fa:16:3e:08:f0:9b", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cefeda-ce", "ovs_interfaceid": "24cefeda-ceaf-460b-b902-a5895a6bb394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Converting VIF {"id": "24cefeda-ceaf-460b-b902-a5895a6bb394", "address": "fa:16:3e:08:f0:9b", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cefeda-ce", "ovs_interfaceid": "24cefeda-ceaf-460b-b902-a5895a6bb394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:f0:9b,bridge_name='br-int',has_traffic_filtering=True,id=24cefeda-ceaf-460b-b902-a5895a6bb394,network=Network(b8fa77f6-0c71-4754-a562-9f147defb87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cefeda-ce') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG os_vif [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:f0:9b,bridge_name='br-int',has_traffic_filtering=True,id=24cefeda-ceaf-460b-b902-a5895a6bb394,network=Network(b8fa77f6-0c71-4754-a562-9f147defb87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cefeda-ce') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51a248f8-61bd-5d0f-aebb-578ad54b70ae', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24cefeda-ce, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24cefeda-ce, col_values=(('qos', UUID('dbbfe0ea-dc04-4083-ae5a-b0d35f7a5041')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24cefeda-ce, col_values=(('external_ids', {'iface-id': '24cefeda-ceaf-460b-b902-a5895a6bb394', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:f0:9b', 'vm-uuid': 'ed823684-5b31-4b43-a601-bb5e303e0863'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:39 user nova-compute[74311]: INFO os_vif [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:f0:9b,bridge_name='br-int',has_traffic_filtering=True,id=24cefeda-ceaf-460b-b902-a5895a6bb394,network=Network(b8fa77f6-0c71-4754-a562-9f147defb87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cefeda-ce')
Oct 20 10:12:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.220s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Checking if we can resize image /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] No VIF found with MAC fa:16:3e:08:f0:9b, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Cannot resize image /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Ensure instance console log exists: /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Successfully created port: 465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:40 user nova-compute[74311]: DEBUG nova.network.neutron [req-28e6b004-f3c2-4daa-be33-6861786b54a4 req-1dd8cc5d-4556-4c8b-9055-d81c646edf17 service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Updated VIF entry in instance network info cache for port 24cefeda-ceaf-460b-b902-a5895a6bb394. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:12:40 user nova-compute[74311]: DEBUG nova.network.neutron [req-28e6b004-f3c2-4daa-be33-6861786b54a4 req-1dd8cc5d-4556-4c8b-9055-d81c646edf17 service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Updating instance_info_cache with network_info: [{"id": "24cefeda-ceaf-460b-b902-a5895a6bb394", "address": "fa:16:3e:08:f0:9b", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cefeda-ce", "ovs_interfaceid": "24cefeda-ceaf-460b-b902-a5895a6bb394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-28e6b004-f3c2-4daa-be33-6861786b54a4 req-1dd8cc5d-4556-4c8b-9055-d81c646edf17 service nova] Releasing lock "refresh_cache-ed823684-5b31-4b43-a601-bb5e303e0863" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-1d2983ae-d42a-44e9-9a5b-80542037e1af req-09606fb0-ecd5-431d-9336-a9b5894d83b7 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Received event network-vif-plugged-c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1d2983ae-d42a-44e9-9a5b-80542037e1af req-09606fb0-ecd5-431d-9336-a9b5894d83b7 service nova] Acquiring lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1d2983ae-d42a-44e9-9a5b-80542037e1af req-09606fb0-ecd5-431d-9336-a9b5894d83b7 service nova] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1d2983ae-d42a-44e9-9a5b-80542037e1af req-09606fb0-ecd5-431d-9336-a9b5894d83b7 service nova] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-1d2983ae-d42a-44e9-9a5b-80542037e1af req-09606fb0-ecd5-431d-9336-a9b5894d83b7 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] No waiting events found dispatching network-vif-plugged-c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:40 user nova-compute[74311]: WARNING nova.compute.manager [req-1d2983ae-d42a-44e9-9a5b-80542037e1af req-09606fb0-ecd5-431d-9336-a9b5894d83b7 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Received unexpected event network-vif-plugged-c02afa9c-c54e-4894-a7ee-568784a07d55 for instance with vm_state building and task_state spawning.
Oct 20 10:12:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Successfully updated port: 465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquired lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-9ced28ad-af99-4a4a-a287-bb9d7a12fd3f req-aaf0c7c1-197d-4192-b9f7-b57fe5e28c38 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received event network-changed-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-9ced28ad-af99-4a4a-a287-bb9d7a12fd3f req-aaf0c7c1-197d-4192-b9f7-b57fe5e28c38 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Refreshing instance network info cache due to event network-changed-465bad7c-bd36-492a-bd18-a8fcbd8bfd42. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9ced28ad-af99-4a4a-a287-bb9d7a12fd3f req-aaf0c7c1-197d-4192-b9f7-b57fe5e28c38 service nova] Acquiring lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Updating instance_info_cache with network_info: [{"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Releasing lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Instance network_info: |[{"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9ced28ad-af99-4a4a-a287-bb9d7a12fd3f req-aaf0c7c1-197d-4192-b9f7-b57fe5e28c38 service nova] Acquired lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.network.neutron [req-9ced28ad-af99-4a4a-a287-bb9d7a12fd3f req-aaf0c7c1-197d-4192-b9f7-b57fe5e28c38 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Refreshing network info cache for port 465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Start _get_guest_xml network_info=[{"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:12:41 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:41 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-683979222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-683979222',id=8,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAka0fGmXxuri5svjkz2HGnAAMwNmV/IgeCY0qqOdRgNIDrai8wjXmgODQlUjDOkNgT+vtqR0NIIR/7gHXjzK406sjo8EG1oh8DP0FT7lElr/8iMYNu2UdW9vM5ZOr2qnw==',key_name='tempest-keypair-2115206596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16b3aaaa066740fa913e22537f799e86',ramdisk_id='',reservation_id='r-4t98aki2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-340750198',owner_user_name='tempest-TaggedAttachmentsTest-340750198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ba84b7bf6a7418a821a22bbd3b0569c',uuid=023498fa-b18b-4947-9b09-e9f6caafa931,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Converting VIF {"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:29:a6,bridge_name='br-int',has_traffic_filtering=True,id=465bad7c-bd36-492a-bd18-a8fcbd8bfd42,network=Network(181b9e45-9e42-4c1f-a95a-aecf69bc252d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465bad7c-bd') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.objects.instance [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lazy-loading 'pci_devices' on Instance uuid 023498fa-b18b-4947-9b09-e9f6caafa931 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:12:41 user nova-compute[74311]:   <uuid>023498fa-b18b-4947-9b09-e9f6caafa931</uuid>
Oct 20 10:12:41 user nova-compute[74311]:   <name>instance-00000008</name>
Oct 20 10:12:41 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:12:41 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:12:41 user nova-compute[74311]:   <metadata>
Oct 20 10:12:41 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:12:41 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:12:41 user nova-compute[74311]:       <nova:name>tempest-device-tagging-server-683979222</nova:name>
Oct 20 10:12:41 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:12:41</nova:creationTime>
Oct 20 10:12:41 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:12:41 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:12:41 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:12:41 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:12:41 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:12:41 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:12:41 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:12:41 user nova-compute[74311]:       <nova:owner>
Oct 20 10:12:41 user nova-compute[74311]:         <nova:user uuid="6ba84b7bf6a7418a821a22bbd3b0569c">tempest-TaggedAttachmentsTest-340750198-project-member</nova:user>
Oct 20 10:12:41 user nova-compute[74311]:         <nova:project uuid="16b3aaaa066740fa913e22537f799e86">tempest-TaggedAttachmentsTest-340750198</nova:project>
Oct 20 10:12:41 user nova-compute[74311]:       </nova:owner>
Oct 20 10:12:41 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:12:41 user nova-compute[74311]:       <nova:ports>
Oct 20 10:12:41 user nova-compute[74311]:         <nova:port uuid="465bad7c-bd36-492a-bd18-a8fcbd8bfd42">
Oct 20 10:12:41 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 10:12:41 user nova-compute[74311]:         </nova:port>
Oct 20 10:12:41 user nova-compute[74311]:       </nova:ports>
Oct 20 10:12:41 user nova-compute[74311]:     </nova:instance>
Oct 20 10:12:41 user nova-compute[74311]:   </metadata>
Oct 20 10:12:41 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:12:41 user nova-compute[74311]:     <system>
Oct 20 10:12:41 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:12:41 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:12:41 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:12:41 user nova-compute[74311]:       <entry name="serial">023498fa-b18b-4947-9b09-e9f6caafa931</entry>
Oct 20 10:12:41 user nova-compute[74311]:       <entry name="uuid">023498fa-b18b-4947-9b09-e9f6caafa931</entry>
Oct 20 10:12:41 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:12:41 user nova-compute[74311]:     </system>
Oct 20 10:12:41 user nova-compute[74311]:   </sysinfo>
Oct 20 10:12:41 user nova-compute[74311]:   <os>
Oct 20 10:12:41 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:12:41 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:12:41 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:12:41 user nova-compute[74311]:   </os>
Oct 20 10:12:41 user nova-compute[74311]:   <features>
Oct 20 10:12:41 user nova-compute[74311]:     <acpi/>
Oct 20 10:12:41 user nova-compute[74311]:     <apic/>
Oct 20 10:12:41 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:12:41 user nova-compute[74311]:   </features>
Oct 20 10:12:41 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:12:41 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:12:41 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:12:41 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:12:41 user nova-compute[74311]:   </clock>
Oct 20 10:12:41 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:12:41 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:12:41 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:12:41 user nova-compute[74311]:   </cpu>
Oct 20 10:12:41 user nova-compute[74311]:   <devices>
Oct 20 10:12:41 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:12:41 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:12:41 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk"/>
Oct 20 10:12:41 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:12:41 user nova-compute[74311]:     </disk>
Oct 20 10:12:41 user nova-compute[74311]:     <disk type="file" device="cdrom">
Oct 20 10:12:41 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 10:12:41 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk.config"/>
Oct 20 10:12:41 user nova-compute[74311]:       <target dev="hda" bus="ide"/>
Oct 20 10:12:41 user nova-compute[74311]:     </disk>
Oct 20 10:12:41 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:12:41 user nova-compute[74311]:       <mac address="fa:16:3e:6e:29:a6"/>
Oct 20 10:12:41 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:41 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:12:41 user nova-compute[74311]:       <target dev="tap465bad7c-bd"/>
Oct 20 10:12:41 user nova-compute[74311]:     </interface>
Oct 20 10:12:41 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:12:41 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/console.log" append="off"/>
Oct 20 10:12:41 user nova-compute[74311]:     </serial>
Oct 20 10:12:41 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:12:41 user nova-compute[74311]:     <video>
Oct 20 10:12:41 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:41 user nova-compute[74311]:     </video>
Oct 20 10:12:41 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:12:41 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:12:41 user nova-compute[74311]:     </rng>
Oct 20 10:12:41 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:12:41 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:12:41 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:12:41 user nova-compute[74311]:     </memballoon>
Oct 20 10:12:41 user nova-compute[74311]:   </devices>
Oct 20 10:12:41 user nova-compute[74311]: </domain>
Oct 20 10:12:41 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-683979222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-683979222',id=8,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAka0fGmXxuri5svjkz2HGnAAMwNmV/IgeCY0qqOdRgNIDrai8wjXmgODQlUjDOkNgT+vtqR0NIIR/7gHXjzK406sjo8EG1oh8DP0FT7lElr/8iMYNu2UdW9vM5ZOr2qnw==',key_name='tempest-keypair-2115206596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16b3aaaa066740fa913e22537f799e86',ramdisk_id='',reservation_id='r-4t98aki2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-340750198',owner_user_name='tempest-TaggedAttachmentsTest-340750198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ba84b7bf6a7418a821a22bbd3b0569c',uuid=023498fa-b18b-4947-9b09-e9f6caafa931,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Converting VIF {"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:29:a6,bridge_name='br-int',has_traffic_filtering=True,id=465bad7c-bd36-492a-bd18-a8fcbd8bfd42,network=Network(181b9e45-9e42-4c1f-a95a-aecf69bc252d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465bad7c-bd') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG os_vif [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:29:a6,bridge_name='br-int',has_traffic_filtering=True,id=465bad7c-bd36-492a-bd18-a8fcbd8bfd42,network=Network(181b9e45-9e42-4c1f-a95a-aecf69bc252d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465bad7c-bd') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c203030e-4a55-5c3d-ae34-52a9d3a5f002', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap465bad7c-bd, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap465bad7c-bd, col_values=(('qos', UUID('94a41260-dfff-4bb5-b76a-654a6bef4e99')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap465bad7c-bd, col_values=(('external_ids', {'iface-id': '465bad7c-bd36-492a-bd18-a8fcbd8bfd42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:29:a6', 'vm-uuid': '023498fa-b18b-4947-9b09-e9f6caafa931'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:41 user nova-compute[74311]: INFO os_vif [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:29:a6,bridge_name='br-int',has_traffic_filtering=True,id=465bad7c-bd36-492a-bd18-a8fcbd8bfd42,network=Network(181b9e45-9e42-4c1f-a95a-aecf69bc252d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465bad7c-bd')
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] No BDM found with device name hda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] No VIF found with MAC fa:16:3e:6e:29:a6, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:12:41 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Using config drive
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:42 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Creating config drive at /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk.config
Oct 20 10:12:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz2402hd8 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpz2402hd8" returned: 0 in 0.072s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG nova.network.neutron [req-9ced28ad-af99-4a4a-a287-bb9d7a12fd3f req-aaf0c7c1-197d-4192-b9f7-b57fe5e28c38 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Updated VIF entry in instance network info cache for port 465bad7c-bd36-492a-bd18-a8fcbd8bfd42. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG nova.network.neutron [req-9ced28ad-af99-4a4a-a287-bb9d7a12fd3f req-aaf0c7c1-197d-4192-b9f7-b57fe5e28c38 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Updating instance_info_cache with network_info: [{"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9ced28ad-af99-4a4a-a287-bb9d7a12fd3f req-aaf0c7c1-197d-4192-b9f7-b57fe5e28c38 service nova] Releasing lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-29f1f7a4-b50d-43cf-982f-db93c8f87ba6 req-75331646-3669-4c2d-8d0e-393fabd98379 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Received event network-vif-plugged-c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-29f1f7a4-b50d-43cf-982f-db93c8f87ba6 req-75331646-3669-4c2d-8d0e-393fabd98379 service nova] Acquiring lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-29f1f7a4-b50d-43cf-982f-db93c8f87ba6 req-75331646-3669-4c2d-8d0e-393fabd98379 service nova] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-29f1f7a4-b50d-43cf-982f-db93c8f87ba6 req-75331646-3669-4c2d-8d0e-393fabd98379 service nova] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-29f1f7a4-b50d-43cf-982f-db93c8f87ba6 req-75331646-3669-4c2d-8d0e-393fabd98379 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] No waiting events found dispatching network-vif-plugged-c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:42 user nova-compute[74311]: WARNING nova.compute.manager [req-29f1f7a4-b50d-43cf-982f-db93c8f87ba6 req-75331646-3669-4c2d-8d0e-393fabd98379 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Received unexpected event network-vif-plugged-c02afa9c-c54e-4894-a7ee-568784a07d55 for instance with vm_state building and task_state spawning.
Oct 20 10:12:42 user nova-compute[74311]: DEBUG nova.compute.manager [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:12:42 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Instance spawned successfully.
Oct 20 10:12:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:42 user nova-compute[74311]: INFO nova.compute.manager [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Took 10.36 seconds to spawn the instance on the hypervisor.
Oct 20 10:12:42 user nova-compute[74311]: DEBUG nova.compute.manager [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:12:42 user nova-compute[74311]: INFO nova.compute.manager [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Took 12.08 seconds to build instance.
Oct 20 10:12:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-862eead2-941c-4f5d-904d-80d792c3825b tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.337s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:43 user nova-compute[74311]: DEBUG nova.compute.manager [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:12:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:12:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:43 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Instance spawned successfully.
Oct 20 10:12:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:12:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:44 user nova-compute[74311]: INFO nova.compute.manager [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Took 8.74 seconds to spawn the instance on the hypervisor.
Oct 20 10:12:44 user nova-compute[74311]: DEBUG nova.compute.manager [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:12:44 user nova-compute[74311]: INFO nova.compute.manager [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Took 10.72 seconds to build instance.
Oct 20 10:12:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-33155e9f-f53f-41ca-8e52-cebce0b9fb0f tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "ed823684-5b31-4b43-a601-bb5e303e0863" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.145s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-2135e8d2-ec9f-49fa-b20f-b279dc34425a req-53e76e5d-8df0-43bb-933e-bd942a924459 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received event network-vif-plugged-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2135e8d2-ec9f-49fa-b20f-b279dc34425a req-53e76e5d-8df0-43bb-933e-bd942a924459 service nova] Acquiring lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2135e8d2-ec9f-49fa-b20f-b279dc34425a req-53e76e5d-8df0-43bb-933e-bd942a924459 service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2135e8d2-ec9f-49fa-b20f-b279dc34425a req-53e76e5d-8df0-43bb-933e-bd942a924459 service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-2135e8d2-ec9f-49fa-b20f-b279dc34425a req-53e76e5d-8df0-43bb-933e-bd942a924459 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] No waiting events found dispatching network-vif-plugged-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:44 user nova-compute[74311]: WARNING nova.compute.manager [req-2135e8d2-ec9f-49fa-b20f-b279dc34425a req-53e76e5d-8df0-43bb-933e-bd942a924459 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received unexpected event network-vif-plugged-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 for instance with vm_state building and task_state spawning.
Oct 20 10:12:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:46 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:12:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:12:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-9f77db6f-6c51-4ef4-ab3f-f2e5aadcec8a req-dddfbfbf-d2f2-412d-b831-89291b7bf749 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received event network-vif-plugged-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9f77db6f-6c51-4ef4-ab3f-f2e5aadcec8a req-dddfbfbf-d2f2-412d-b831-89291b7bf749 service nova] Acquiring lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9f77db6f-6c51-4ef4-ab3f-f2e5aadcec8a req-dddfbfbf-d2f2-412d-b831-89291b7bf749 service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9f77db6f-6c51-4ef4-ab3f-f2e5aadcec8a req-dddfbfbf-d2f2-412d-b831-89291b7bf749 service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-9f77db6f-6c51-4ef4-ab3f-f2e5aadcec8a req-dddfbfbf-d2f2-412d-b831-89291b7bf749 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] No waiting events found dispatching network-vif-plugged-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:46 user nova-compute[74311]: WARNING nova.compute.manager [req-9f77db6f-6c51-4ef4-ab3f-f2e5aadcec8a req-dddfbfbf-d2f2-412d-b831-89291b7bf749 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received unexpected event network-vif-plugged-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 for instance with vm_state building and task_state spawning.
Oct 20 10:12:46 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Instance spawned successfully.
Oct 20 10:12:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:12:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:46 user nova-compute[74311]: INFO nova.compute.manager [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Took 8.16 seconds to spawn the instance on the hypervisor.
Oct 20 10:12:46 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:12:46 user nova-compute[74311]: INFO nova.compute.manager [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Took 9.44 seconds to build instance.
Oct 20 10:12:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4b6f1de9-be70-464d-b388-2d310ce3e70b tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "023498fa-b18b-4947-9b09-e9f6caafa931" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.578s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:50 user nova-compute[74311]: DEBUG nova.compute.manager [req-f4508c79-e490-4877-8cfb-ffe505956670 req-a6cc3a0c-4235-4d73-be1e-857eb8e90cf3 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Received event network-vif-plugged-097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f4508c79-e490-4877-8cfb-ffe505956670 req-a6cc3a0c-4235-4d73-be1e-857eb8e90cf3 service nova] Acquiring lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f4508c79-e490-4877-8cfb-ffe505956670 req-a6cc3a0c-4235-4d73-be1e-857eb8e90cf3 service nova] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f4508c79-e490-4877-8cfb-ffe505956670 req-a6cc3a0c-4235-4d73-be1e-857eb8e90cf3 service nova] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:50 user nova-compute[74311]: DEBUG nova.compute.manager [req-f4508c79-e490-4877-8cfb-ffe505956670 req-a6cc3a0c-4235-4d73-be1e-857eb8e90cf3 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] No waiting events found dispatching network-vif-plugged-097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:50 user nova-compute[74311]: WARNING nova.compute.manager [req-f4508c79-e490-4877-8cfb-ffe505956670 req-a6cc3a0c-4235-4d73-be1e-857eb8e90cf3 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Received unexpected event network-vif-plugged-097b3196-1731-46ef-a752-fcc882c73dfd for instance with vm_state active and task_state None.
Oct 20 10:12:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Acquiring lock "12bfda49-ce9d-4806-a982-08ce670faeb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:12:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:51 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:12:51 user nova-compute[74311]: INFO nova.compute.claims [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Claim successful on node user
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Skipping network cache update for instance because it is Building. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-47a30844-242f-4a7f-ad9f-232a6e76b4ec" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-47a30844-242f-4a7f-ad9f-232a6e76b4ec" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.objects.instance [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lazy-loading 'info_cache' on Instance uuid 47a30844-242f-4a7f-ad9f-232a6e76b4ec {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.network.neutron [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:12:52 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Received event network-vif-plugged-097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] Acquiring lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] No waiting events found dispatching network-vif-plugged-097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:52 user nova-compute[74311]: WARNING nova.compute.manager [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Received unexpected event network-vif-plugged-097b3196-1731-46ef-a752-fcc882c73dfd for instance with vm_state active and task_state None.
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Received event network-vif-plugged-24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] Acquiring lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] Lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] Lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] No waiting events found dispatching network-vif-plugged-24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:52 user nova-compute[74311]: WARNING nova.compute.manager [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Received unexpected event network-vif-plugged-24cefeda-ceaf-460b-b902-a5895a6bb394 for instance with vm_state active and task_state None.
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Received event network-vif-plugged-24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] Acquiring lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] Lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] Lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] No waiting events found dispatching network-vif-plugged-24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:52 user nova-compute[74311]: WARNING nova.compute.manager [req-15ea58ba-3830-4319-8df7-4a24df3f973e req-864242d6-328c-4c7e-bc19-74fd4eda327d service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Received unexpected event network-vif-plugged-24cefeda-ceaf-460b-b902-a5895a6bb394 for instance with vm_state active and task_state None.
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.policy [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fb29689c6d448fe9c5e848415511394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb286be870f14bc89403febfdb4bff45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:12:52 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Creating image(s)
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Acquiring lock "/opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "/opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "/opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.225s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG nova.compute.manager [req-1dc2e937-8fd9-4b94-a6da-a99db41dad33 req-acbdd7ab-703a-4704-9fbc-2c6d429152de service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1dc2e937-8fd9-4b94-a6da-a99db41dad33 req-acbdd7ab-703a-4704-9fbc-2c6d429152de service nova] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1dc2e937-8fd9-4b94-a6da-a99db41dad33 req-acbdd7ab-703a-4704-9fbc-2c6d429152de service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1dc2e937-8fd9-4b94-a6da-a99db41dad33 req-acbdd7ab-703a-4704-9fbc-2c6d429152de service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG nova.compute.manager [req-1dc2e937-8fd9-4b94-a6da-a99db41dad33 req-acbdd7ab-703a-4704-9fbc-2c6d429152de service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] No waiting events found dispatching network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:53 user nova-compute[74311]: WARNING nova.compute.manager [req-1dc2e937-8fd9-4b94-a6da-a99db41dad33 req-acbdd7ab-703a-4704-9fbc-2c6d429152de service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received unexpected event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 for instance with vm_state active and task_state None.
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.227s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Updating instance_info_cache with network_info: [{"id": "3547e076-2273-41d1-829e-062952da0e37", "address": "fa:16:3e:e8:4a:24", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547e076-22", "ovs_interfaceid": "3547e076-2273-41d1-829e-062952da0e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk 1073741824" returned: 0 in 0.065s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-47a30844-242f-4a7f-ad9f-232a6e76b4ec" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] There are 0 instances to clean {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74311) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.226s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Cannot resize image /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Ensure instance console log exists: /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:53 user nova-compute[74311]: DEBUG nova.network.neutron [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Successfully created port: 9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:12:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Successfully updated port: 9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:12:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Acquiring lock "refresh_cache-12bfda49-ce9d-4806-a982-08ce670faeb6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Acquired lock "refresh_cache-12bfda49-ce9d-4806-a982-08ce670faeb6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:12:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-cb6c981e-6e65-419b-a459-ff7b6e69907d req-bfb652fe-5941-46e8-8f3d-6c983690ac56 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Received event network-changed-9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-cb6c981e-6e65-419b-a459-ff7b6e69907d req-bfb652fe-5941-46e8-8f3d-6c983690ac56 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Refreshing instance network info cache due to event network-changed-9610009e-e341-4814-a3c3-523081eb0c8b. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:12:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cb6c981e-6e65-419b-a459-ff7b6e69907d req-bfb652fe-5941-46e8-8f3d-6c983690ac56 service nova] Acquiring lock "refresh_cache-12bfda49-ce9d-4806-a982-08ce670faeb6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.network.neutron [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.compute.manager [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.compute.manager [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] No waiting events found dispatching network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:55 user nova-compute[74311]: WARNING nova.compute.manager [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received unexpected event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 for instance with vm_state active and task_state None.
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.compute.manager [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Received event network-vif-plugged-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] Acquiring lock "560c41a4-79a3-461d-976d-f260bc9086f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] Lock "560c41a4-79a3-461d-976d-f260bc9086f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] Lock "560c41a4-79a3-461d-976d-f260bc9086f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.compute.manager [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] No waiting events found dispatching network-vif-plugged-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:55 user nova-compute[74311]: WARNING nova.compute.manager [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Received unexpected event network-vif-plugged-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa for instance with vm_state active and task_state None.
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.compute.manager [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Received event network-vif-plugged-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] Acquiring lock "560c41a4-79a3-461d-976d-f260bc9086f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] Lock "560c41a4-79a3-461d-976d-f260bc9086f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] Lock "560c41a4-79a3-461d-976d-f260bc9086f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.compute.manager [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] No waiting events found dispatching network-vif-plugged-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:12:55 user nova-compute[74311]: WARNING nova.compute.manager [req-e9df92fd-ac43-435c-8575-bab765d155b2 req-1a914dbf-1148-4eae-aa07-2d4f0c95f6ad service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Received unexpected event network-vif-plugged-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa for instance with vm_state active and task_state None.
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.network.neutron [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Updating instance_info_cache with network_info: [{"id": "9610009e-e341-4814-a3c3-523081eb0c8b", "address": "fa:16:3e:8b:94:00", "network": {"id": "b7d019f1-b3d9-472b-b369-db22786af195", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2011103604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb286be870f14bc89403febfdb4bff45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9610009e-e3", "ovs_interfaceid": "9610009e-e341-4814-a3c3-523081eb0c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Releasing lock "refresh_cache-12bfda49-ce9d-4806-a982-08ce670faeb6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.compute.manager [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Instance network_info: |[{"id": "9610009e-e341-4814-a3c3-523081eb0c8b", "address": "fa:16:3e:8b:94:00", "network": {"id": "b7d019f1-b3d9-472b-b369-db22786af195", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2011103604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb286be870f14bc89403febfdb4bff45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9610009e-e3", "ovs_interfaceid": "9610009e-e341-4814-a3c3-523081eb0c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cb6c981e-6e65-419b-a459-ff7b6e69907d req-bfb652fe-5941-46e8-8f3d-6c983690ac56 service nova] Acquired lock "refresh_cache-12bfda49-ce9d-4806-a982-08ce670faeb6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.network.neutron [req-cb6c981e-6e65-419b-a459-ff7b6e69907d req-bfb652fe-5941-46e8-8f3d-6c983690ac56 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Refreshing network info cache for port 9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Start _get_guest_xml network_info=[{"id": "9610009e-e341-4814-a3c3-523081eb0c8b", "address": "fa:16:3e:8b:94:00", "network": {"id": "b7d019f1-b3d9-472b-b369-db22786af195", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2011103604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb286be870f14bc89403febfdb4bff45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9610009e-e3", "ovs_interfaceid": "9610009e-e341-4814-a3c3-523081eb0c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:12:55 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:55 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1968721568',display_name='tempest-VolumesAssistedSnapshotsTest-server-1968721568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1968721568',id=9,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmxf0U5l/9UCpnIsZGpfk0uEuvtIh81UGGvaN1MxelxoAcvWpERQkTx3l1hHmIHU7ss7q+XBZuf+0ghSR08MtV80NAs/Fhr4owGoYyvp0faI26PAAGVHPRTrW316ve9Qg==',key_name='tempest-keypair-1030875735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb286be870f14bc89403febfdb4bff45',ramdisk_id='',reservation_id='r-59njym3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1587958436',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1587958436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb29689c6d448fe9c5e848415511394',uuid=12bfda49-ce9d-4806-a982-08ce670faeb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9610009e-e341-4814-a3c3-523081eb0c8b", "address": "fa:16:3e:8b:94:00", "network": {"id": "b7d019f1-b3d9-472b-b369-db22786af195", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2011103604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb286be870f14bc89403febfdb4bff45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9610009e-e3", "ovs_interfaceid": "9610009e-e341-4814-a3c3-523081eb0c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Converting VIF {"id": "9610009e-e341-4814-a3c3-523081eb0c8b", "address": "fa:16:3e:8b:94:00", "network": {"id": "b7d019f1-b3d9-472b-b369-db22786af195", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2011103604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb286be870f14bc89403febfdb4bff45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9610009e-e3", "ovs_interfaceid": "9610009e-e341-4814-a3c3-523081eb0c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:94:00,bridge_name='br-int',has_traffic_filtering=True,id=9610009e-e341-4814-a3c3-523081eb0c8b,network=Network(b7d019f1-b3d9-472b-b369-db22786af195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9610009e-e3') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.objects.instance [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lazy-loading 'pci_devices' on Instance uuid 12bfda49-ce9d-4806-a982-08ce670faeb6 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:12:55 user nova-compute[74311]:   <uuid>12bfda49-ce9d-4806-a982-08ce670faeb6</uuid>
Oct 20 10:12:55 user nova-compute[74311]:   <name>instance-00000009</name>
Oct 20 10:12:55 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:12:55 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:12:55 user nova-compute[74311]:   <metadata>
Oct 20 10:12:55 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:12:55 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:12:55 user nova-compute[74311]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1968721568</nova:name>
Oct 20 10:12:55 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:12:55</nova:creationTime>
Oct 20 10:12:55 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:12:55 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:12:55 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:12:55 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:12:55 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:12:55 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:12:55 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:12:55 user nova-compute[74311]:       <nova:owner>
Oct 20 10:12:55 user nova-compute[74311]:         <nova:user uuid="8fb29689c6d448fe9c5e848415511394">tempest-VolumesAssistedSnapshotsTest-1587958436-project-member</nova:user>
Oct 20 10:12:55 user nova-compute[74311]:         <nova:project uuid="bb286be870f14bc89403febfdb4bff45">tempest-VolumesAssistedSnapshotsTest-1587958436</nova:project>
Oct 20 10:12:55 user nova-compute[74311]:       </nova:owner>
Oct 20 10:12:55 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:12:55 user nova-compute[74311]:       <nova:ports>
Oct 20 10:12:55 user nova-compute[74311]:         <nova:port uuid="9610009e-e341-4814-a3c3-523081eb0c8b">
Oct 20 10:12:55 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 10:12:55 user nova-compute[74311]:         </nova:port>
Oct 20 10:12:55 user nova-compute[74311]:       </nova:ports>
Oct 20 10:12:55 user nova-compute[74311]:     </nova:instance>
Oct 20 10:12:55 user nova-compute[74311]:   </metadata>
Oct 20 10:12:55 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:12:55 user nova-compute[74311]:     <system>
Oct 20 10:12:55 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:12:55 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:12:55 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:12:55 user nova-compute[74311]:       <entry name="serial">12bfda49-ce9d-4806-a982-08ce670faeb6</entry>
Oct 20 10:12:55 user nova-compute[74311]:       <entry name="uuid">12bfda49-ce9d-4806-a982-08ce670faeb6</entry>
Oct 20 10:12:55 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:12:55 user nova-compute[74311]:     </system>
Oct 20 10:12:55 user nova-compute[74311]:   </sysinfo>
Oct 20 10:12:55 user nova-compute[74311]:   <os>
Oct 20 10:12:55 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:12:55 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:12:55 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:12:55 user nova-compute[74311]:   </os>
Oct 20 10:12:55 user nova-compute[74311]:   <features>
Oct 20 10:12:55 user nova-compute[74311]:     <acpi/>
Oct 20 10:12:55 user nova-compute[74311]:     <apic/>
Oct 20 10:12:55 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:12:55 user nova-compute[74311]:   </features>
Oct 20 10:12:55 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:12:55 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:12:55 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:12:55 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:12:55 user nova-compute[74311]:   </clock>
Oct 20 10:12:55 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:12:55 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:12:55 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:12:55 user nova-compute[74311]:   </cpu>
Oct 20 10:12:55 user nova-compute[74311]:   <devices>
Oct 20 10:12:55 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:12:55 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:12:55 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk"/>
Oct 20 10:12:55 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:12:55 user nova-compute[74311]:     </disk>
Oct 20 10:12:55 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:12:55 user nova-compute[74311]:       <mac address="fa:16:3e:8b:94:00"/>
Oct 20 10:12:55 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:55 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:12:55 user nova-compute[74311]:       <target dev="tap9610009e-e3"/>
Oct 20 10:12:55 user nova-compute[74311]:     </interface>
Oct 20 10:12:55 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:12:55 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/console.log" append="off"/>
Oct 20 10:12:55 user nova-compute[74311]:     </serial>
Oct 20 10:12:55 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:12:55 user nova-compute[74311]:     <video>
Oct 20 10:12:55 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:55 user nova-compute[74311]:     </video>
Oct 20 10:12:55 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:12:55 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:12:55 user nova-compute[74311]:     </rng>
Oct 20 10:12:55 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:12:55 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:12:55 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:12:55 user nova-compute[74311]:     </memballoon>
Oct 20 10:12:55 user nova-compute[74311]:   </devices>
Oct 20 10:12:55 user nova-compute[74311]: </domain>
Oct 20 10:12:55 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1968721568',display_name='tempest-VolumesAssistedSnapshotsTest-server-1968721568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1968721568',id=9,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmxf0U5l/9UCpnIsZGpfk0uEuvtIh81UGGvaN1MxelxoAcvWpERQkTx3l1hHmIHU7ss7q+XBZuf+0ghSR08MtV80NAs/Fhr4owGoYyvp0faI26PAAGVHPRTrW316ve9Qg==',key_name='tempest-keypair-1030875735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb286be870f14bc89403febfdb4bff45',ramdisk_id='',reservation_id='r-59njym3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1587958436',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1587958436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb29689c6d448fe9c5e848415511394',uuid=12bfda49-ce9d-4806-a982-08ce670faeb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9610009e-e341-4814-a3c3-523081eb0c8b", "address": "fa:16:3e:8b:94:00", "network": {"id": "b7d019f1-b3d9-472b-b369-db22786af195", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2011103604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb286be870f14bc89403febfdb4bff45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9610009e-e3", "ovs_interfaceid": "9610009e-e341-4814-a3c3-523081eb0c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Converting VIF {"id": "9610009e-e341-4814-a3c3-523081eb0c8b", "address": "fa:16:3e:8b:94:00", "network": {"id": "b7d019f1-b3d9-472b-b369-db22786af195", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2011103604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb286be870f14bc89403febfdb4bff45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9610009e-e3", "ovs_interfaceid": "9610009e-e341-4814-a3c3-523081eb0c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:94:00,bridge_name='br-int',has_traffic_filtering=True,id=9610009e-e341-4814-a3c3-523081eb0c8b,network=Network(b7d019f1-b3d9-472b-b369-db22786af195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9610009e-e3') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG os_vif [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:94:00,bridge_name='br-int',has_traffic_filtering=True,id=9610009e-e341-4814-a3c3-523081eb0c8b,network=Network(b7d019f1-b3d9-472b-b369-db22786af195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9610009e-e3') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c516ac43-73db-582d-8095-05d6498d0c90', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9610009e-e3, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9610009e-e3, col_values=(('qos', UUID('2ed1c98a-d614-4732-bca6-ad87672ce37f')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9610009e-e3, col_values=(('external_ids', {'iface-id': '9610009e-e341-4814-a3c3-523081eb0c8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:94:00', 'vm-uuid': '12bfda49-ce9d-4806-a982-08ce670faeb6'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:55 user nova-compute[74311]: INFO os_vif [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:94:00,bridge_name='br-int',has_traffic_filtering=True,id=9610009e-e341-4814-a3c3-523081eb0c8b,network=Network(b7d019f1-b3d9-472b-b369-db22786af195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9610009e-e3')
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:12:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] No VIF found with MAC fa:16:3e:8b:94:00, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG nova.network.neutron [req-cb6c981e-6e65-419b-a459-ff7b6e69907d req-bfb652fe-5941-46e8-8f3d-6c983690ac56 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Updated VIF entry in instance network info cache for port 9610009e-e341-4814-a3c3-523081eb0c8b. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG nova.network.neutron [req-cb6c981e-6e65-419b-a459-ff7b6e69907d req-bfb652fe-5941-46e8-8f3d-6c983690ac56 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Updating instance_info_cache with network_info: [{"id": "9610009e-e341-4814-a3c3-523081eb0c8b", "address": "fa:16:3e:8b:94:00", "network": {"id": "b7d019f1-b3d9-472b-b369-db22786af195", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2011103604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb286be870f14bc89403febfdb4bff45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9610009e-e3", "ovs_interfaceid": "9610009e-e341-4814-a3c3-523081eb0c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cb6c981e-6e65-419b-a459-ff7b6e69907d req-bfb652fe-5941-46e8-8f3d-6c983690ac56 service nova] Releasing lock "refresh_cache-12bfda49-ce9d-4806-a982-08ce670faeb6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:12:56 user nova-compute[74311]: INFO nova.compute.claims [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Claim successful on node user
Oct 20 10:12:56 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG nova.network.neutron [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:12:56 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:12:56 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG nova.policy [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbf471485c5947698b36ed81a4b784ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abab5999f8db4c76b520f5988643941f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:12:56 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Creating image(s)
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "/opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "/opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.228s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.191s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk 1073741824" returned: 0 in 0.085s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.220s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG nova.network.neutron [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Successfully created port: e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Cannot resize image /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Ensure instance console log exists: /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG nova.network.neutron [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Successfully updated port: e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "refresh_cache-d5d019ce-3f5d-422c-b278-2b3cb3fd594a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquired lock "refresh_cache-d5d019ce-3f5d-422c-b278-2b3cb3fd594a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG nova.network.neutron [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-9b0a5d3a-a89a-4687-bb29-891eff5478ca req-30ec5a67-a043-4347-b35a-429b0386883a service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Received event network-changed-e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-9b0a5d3a-a89a-4687-bb29-891eff5478ca req-30ec5a67-a043-4347-b35a-429b0386883a service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Refreshing instance network info cache due to event network-changed-e147adef-a22c-42a1-918d-12fcf3203eb7. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9b0a5d3a-a89a-4687-bb29-891eff5478ca req-30ec5a67-a043-4347-b35a-429b0386883a service nova] Acquiring lock "refresh_cache-d5d019ce-3f5d-422c-b278-2b3cb3fd594a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:58 user nova-compute[74311]: DEBUG nova.network.neutron [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.network.neutron [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Updating instance_info_cache with network_info: [{"id": "e147adef-a22c-42a1-918d-12fcf3203eb7", "address": "fa:16:3e:05:ab:49", "network": {"id": "f43a19cd-be0a-44a9-9e9d-4710422e489e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942278319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abab5999f8db4c76b520f5988643941f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape147adef-a2", "ovs_interfaceid": "e147adef-a22c-42a1-918d-12fcf3203eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Releasing lock "refresh_cache-d5d019ce-3f5d-422c-b278-2b3cb3fd594a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Instance network_info: |[{"id": "e147adef-a22c-42a1-918d-12fcf3203eb7", "address": "fa:16:3e:05:ab:49", "network": {"id": "f43a19cd-be0a-44a9-9e9d-4710422e489e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942278319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abab5999f8db4c76b520f5988643941f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape147adef-a2", "ovs_interfaceid": "e147adef-a22c-42a1-918d-12fcf3203eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9b0a5d3a-a89a-4687-bb29-891eff5478ca req-30ec5a67-a043-4347-b35a-429b0386883a service nova] Acquired lock "refresh_cache-d5d019ce-3f5d-422c-b278-2b3cb3fd594a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.network.neutron [req-9b0a5d3a-a89a-4687-bb29-891eff5478ca req-30ec5a67-a043-4347-b35a-429b0386883a service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Refreshing network info cache for port e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Start _get_guest_xml network_info=[{"id": "e147adef-a22c-42a1-918d-12fcf3203eb7", "address": "fa:16:3e:05:ab:49", "network": {"id": "f43a19cd-be0a-44a9-9e9d-4710422e489e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942278319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abab5999f8db4c76b520f5988643941f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape147adef-a2", "ovs_interfaceid": "e147adef-a22c-42a1-918d-12fcf3203eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:12:59 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:59 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1208823009',display_name='tempest-TestVolumeSwap-server-1208823009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1208823009',id=10,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8HCBfT+LhLY/EWh5/L1zh3OI6zildNojXskaKWO27zVxcHxuSVHV1Iscr5cNp2N+R0Jy9qm4n5eKtkf2voufStnvoOZwddUuRjz2v5ZJ5UVDLM73IWm8CWZPG83uCAIw==',key_name='tempest-keypair-1478848687',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abab5999f8db4c76b520f5988643941f',ramdisk_id='',reservation_id='r-9g192dr2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-72109064',owner_user_name='tempest-TestVolumeSwap-72109064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf471485c5947698b36ed81a4b784ad',uuid=d5d019ce-3f5d-422c-b278-2b3cb3fd594a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e147adef-a22c-42a1-918d-12fcf3203eb7", "address": "fa:16:3e:05:ab:49", "network": {"id": "f43a19cd-be0a-44a9-9e9d-4710422e489e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942278319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abab5999f8db4c76b520f5988643941f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape147adef-a2", "ovs_interfaceid": "e147adef-a22c-42a1-918d-12fcf3203eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Converting VIF {"id": "e147adef-a22c-42a1-918d-12fcf3203eb7", "address": "fa:16:3e:05:ab:49", "network": {"id": "f43a19cd-be0a-44a9-9e9d-4710422e489e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942278319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abab5999f8db4c76b520f5988643941f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape147adef-a2", "ovs_interfaceid": "e147adef-a22c-42a1-918d-12fcf3203eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:ab:49,bridge_name='br-int',has_traffic_filtering=True,id=e147adef-a22c-42a1-918d-12fcf3203eb7,network=Network(f43a19cd-be0a-44a9-9e9d-4710422e489e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape147adef-a2') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.objects.instance [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lazy-loading 'pci_devices' on Instance uuid d5d019ce-3f5d-422c-b278-2b3cb3fd594a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:12:59 user nova-compute[74311]:   <uuid>d5d019ce-3f5d-422c-b278-2b3cb3fd594a</uuid>
Oct 20 10:12:59 user nova-compute[74311]:   <name>instance-0000000a</name>
Oct 20 10:12:59 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:12:59 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:12:59 user nova-compute[74311]:   <metadata>
Oct 20 10:12:59 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:12:59 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:12:59 user nova-compute[74311]:       <nova:name>tempest-TestVolumeSwap-server-1208823009</nova:name>
Oct 20 10:12:59 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:12:59</nova:creationTime>
Oct 20 10:12:59 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:12:59 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:12:59 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:12:59 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:12:59 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:12:59 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:12:59 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:12:59 user nova-compute[74311]:       <nova:owner>
Oct 20 10:12:59 user nova-compute[74311]:         <nova:user uuid="dbf471485c5947698b36ed81a4b784ad">tempest-TestVolumeSwap-72109064-project-member</nova:user>
Oct 20 10:12:59 user nova-compute[74311]:         <nova:project uuid="abab5999f8db4c76b520f5988643941f">tempest-TestVolumeSwap-72109064</nova:project>
Oct 20 10:12:59 user nova-compute[74311]:       </nova:owner>
Oct 20 10:12:59 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:12:59 user nova-compute[74311]:       <nova:ports>
Oct 20 10:12:59 user nova-compute[74311]:         <nova:port uuid="e147adef-a22c-42a1-918d-12fcf3203eb7">
Oct 20 10:12:59 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 10:12:59 user nova-compute[74311]:         </nova:port>
Oct 20 10:12:59 user nova-compute[74311]:       </nova:ports>
Oct 20 10:12:59 user nova-compute[74311]:     </nova:instance>
Oct 20 10:12:59 user nova-compute[74311]:   </metadata>
Oct 20 10:12:59 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:12:59 user nova-compute[74311]:     <system>
Oct 20 10:12:59 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:12:59 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:12:59 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:12:59 user nova-compute[74311]:       <entry name="serial">d5d019ce-3f5d-422c-b278-2b3cb3fd594a</entry>
Oct 20 10:12:59 user nova-compute[74311]:       <entry name="uuid">d5d019ce-3f5d-422c-b278-2b3cb3fd594a</entry>
Oct 20 10:12:59 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:12:59 user nova-compute[74311]:     </system>
Oct 20 10:12:59 user nova-compute[74311]:   </sysinfo>
Oct 20 10:12:59 user nova-compute[74311]:   <os>
Oct 20 10:12:59 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:12:59 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:12:59 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:12:59 user nova-compute[74311]:   </os>
Oct 20 10:12:59 user nova-compute[74311]:   <features>
Oct 20 10:12:59 user nova-compute[74311]:     <acpi/>
Oct 20 10:12:59 user nova-compute[74311]:     <apic/>
Oct 20 10:12:59 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:12:59 user nova-compute[74311]:   </features>
Oct 20 10:12:59 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:12:59 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:12:59 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:12:59 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:12:59 user nova-compute[74311]:   </clock>
Oct 20 10:12:59 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:12:59 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:12:59 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:12:59 user nova-compute[74311]:   </cpu>
Oct 20 10:12:59 user nova-compute[74311]:   <devices>
Oct 20 10:12:59 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:12:59 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:12:59 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk"/>
Oct 20 10:12:59 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:12:59 user nova-compute[74311]:     </disk>
Oct 20 10:12:59 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:12:59 user nova-compute[74311]:       <mac address="fa:16:3e:05:ab:49"/>
Oct 20 10:12:59 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:59 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:12:59 user nova-compute[74311]:       <target dev="tape147adef-a2"/>
Oct 20 10:12:59 user nova-compute[74311]:     </interface>
Oct 20 10:12:59 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:12:59 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/console.log" append="off"/>
Oct 20 10:12:59 user nova-compute[74311]:     </serial>
Oct 20 10:12:59 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:12:59 user nova-compute[74311]:     <video>
Oct 20 10:12:59 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:12:59 user nova-compute[74311]:     </video>
Oct 20 10:12:59 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:12:59 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:12:59 user nova-compute[74311]:     </rng>
Oct 20 10:12:59 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:12:59 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:12:59 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:12:59 user nova-compute[74311]:     </memballoon>
Oct 20 10:12:59 user nova-compute[74311]:   </devices>
Oct 20 10:12:59 user nova-compute[74311]: </domain>
Oct 20 10:12:59 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1208823009',display_name='tempest-TestVolumeSwap-server-1208823009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1208823009',id=10,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8HCBfT+LhLY/EWh5/L1zh3OI6zildNojXskaKWO27zVxcHxuSVHV1Iscr5cNp2N+R0Jy9qm4n5eKtkf2voufStnvoOZwddUuRjz2v5ZJ5UVDLM73IWm8CWZPG83uCAIw==',key_name='tempest-keypair-1478848687',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abab5999f8db4c76b520f5988643941f',ramdisk_id='',reservation_id='r-9g192dr2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-72109064',owner_user_name='tempest-TestVolumeSwap-72109064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf471485c5947698b36ed81a4b784ad',uuid=d5d019ce-3f5d-422c-b278-2b3cb3fd594a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e147adef-a22c-42a1-918d-12fcf3203eb7", "address": "fa:16:3e:05:ab:49", "network": {"id": "f43a19cd-be0a-44a9-9e9d-4710422e489e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942278319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abab5999f8db4c76b520f5988643941f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape147adef-a2", "ovs_interfaceid": "e147adef-a22c-42a1-918d-12fcf3203eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Converting VIF {"id": "e147adef-a22c-42a1-918d-12fcf3203eb7", "address": "fa:16:3e:05:ab:49", "network": {"id": "f43a19cd-be0a-44a9-9e9d-4710422e489e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942278319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abab5999f8db4c76b520f5988643941f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape147adef-a2", "ovs_interfaceid": "e147adef-a22c-42a1-918d-12fcf3203eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:ab:49,bridge_name='br-int',has_traffic_filtering=True,id=e147adef-a22c-42a1-918d-12fcf3203eb7,network=Network(f43a19cd-be0a-44a9-9e9d-4710422e489e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape147adef-a2') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG os_vif [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:ab:49,bridge_name='br-int',has_traffic_filtering=True,id=e147adef-a22c-42a1-918d-12fcf3203eb7,network=Network(f43a19cd-be0a-44a9-9e9d-4710422e489e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape147adef-a2') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5741212d-b368-5375-979d-ba2858613aff', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape147adef-a2, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape147adef-a2, col_values=(('qos', UUID('115d2efd-5f03-447d-aa22-f15f8548abc2')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape147adef-a2, col_values=(('external_ids', {'iface-id': 'e147adef-a22c-42a1-918d-12fcf3203eb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:ab:49', 'vm-uuid': 'd5d019ce-3f5d-422c-b278-2b3cb3fd594a'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:12:59 user nova-compute[74311]: INFO os_vif [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:ab:49,bridge_name='br-int',has_traffic_filtering=True,id=e147adef-a22c-42a1-918d-12fcf3203eb7,network=Network(f43a19cd-be0a-44a9-9e9d-4710422e489e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape147adef-a2')
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] No VIF found with MAC fa:16:3e:05:ab:49, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:12:59 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Instance spawned successfully.
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:12:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:13:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:00 user nova-compute[74311]: DEBUG nova.network.neutron [req-9b0a5d3a-a89a-4687-bb29-891eff5478ca req-30ec5a67-a043-4347-b35a-429b0386883a service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Updated VIF entry in instance network info cache for port e147adef-a22c-42a1-918d-12fcf3203eb7. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:13:00 user nova-compute[74311]: DEBUG nova.network.neutron [req-9b0a5d3a-a89a-4687-bb29-891eff5478ca req-30ec5a67-a043-4347-b35a-429b0386883a service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Updating instance_info_cache with network_info: [{"id": "e147adef-a22c-42a1-918d-12fcf3203eb7", "address": "fa:16:3e:05:ab:49", "network": {"id": "f43a19cd-be0a-44a9-9e9d-4710422e489e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942278319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abab5999f8db4c76b520f5988643941f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape147adef-a2", "ovs_interfaceid": "e147adef-a22c-42a1-918d-12fcf3203eb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:13:00 user nova-compute[74311]: INFO nova.compute.manager [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Took 7.40 seconds to spawn the instance on the hypervisor.
Oct 20 10:13:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:13:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9b0a5d3a-a89a-4687-bb29-891eff5478ca req-30ec5a67-a043-4347-b35a-429b0386883a service nova] Releasing lock "refresh_cache-d5d019ce-3f5d-422c-b278-2b3cb3fd594a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:13:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:00 user nova-compute[74311]: INFO nova.compute.manager [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Took 8.48 seconds to build instance.
Oct 20 10:13:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-805b9a6b-8be2-488e-9d0b-993870a1302f tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.654s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-6cfefe1c-e614-4733-9079-d5fa9d381928 req-df1cddfe-8368-492c-8e08-2d04db05cab9 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Received event network-vif-plugged-e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6cfefe1c-e614-4733-9079-d5fa9d381928 req-df1cddfe-8368-492c-8e08-2d04db05cab9 service nova] Acquiring lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6cfefe1c-e614-4733-9079-d5fa9d381928 req-df1cddfe-8368-492c-8e08-2d04db05cab9 service nova] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6cfefe1c-e614-4733-9079-d5fa9d381928 req-df1cddfe-8368-492c-8e08-2d04db05cab9 service nova] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-6cfefe1c-e614-4733-9079-d5fa9d381928 req-df1cddfe-8368-492c-8e08-2d04db05cab9 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] No waiting events found dispatching network-vif-plugged-e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:13:01 user nova-compute[74311]: WARNING nova.compute.manager [req-6cfefe1c-e614-4733-9079-d5fa9d381928 req-df1cddfe-8368-492c-8e08-2d04db05cab9 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Received unexpected event network-vif-plugged-e147adef-a22c-42a1-918d-12fcf3203eb7 for instance with vm_state building and task_state spawning.
Oct 20 10:13:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.manager [req-2e6d44ae-6fcb-4315-9a18-9c2d6affdbdb req-97913674-ed12-442d-97c1-3ef892367367 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Received event network-vif-plugged-e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e6d44ae-6fcb-4315-9a18-9c2d6affdbdb req-97913674-ed12-442d-97c1-3ef892367367 service nova] Acquiring lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e6d44ae-6fcb-4315-9a18-9c2d6affdbdb req-97913674-ed12-442d-97c1-3ef892367367 service nova] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e6d44ae-6fcb-4315-9a18-9c2d6affdbdb req-97913674-ed12-442d-97c1-3ef892367367 service nova] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.manager [req-2e6d44ae-6fcb-4315-9a18-9c2d6affdbdb req-97913674-ed12-442d-97c1-3ef892367367 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] No waiting events found dispatching network-vif-plugged-e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:13:04 user nova-compute[74311]: WARNING nova.compute.manager [req-2e6d44ae-6fcb-4315-9a18-9c2d6affdbdb req-97913674-ed12-442d-97c1-3ef892367367 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Received unexpected event network-vif-plugged-e147adef-a22c-42a1-918d-12fcf3203eb7 for instance with vm_state building and task_state spawning.
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:13:04 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:13:04 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7425MB free_disk=25.64849853515625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:04 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Instance spawned successfully.
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:13:04 user nova-compute[74311]: INFO nova.compute.manager [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Took 7.63 seconds to spawn the instance on the hypervisor.
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:04 user nova-compute[74311]: INFO nova.compute.manager [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Took 8.53 seconds to build instance.
Oct 20 10:13:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5a4f42be-0986-4dee-883c-736a0cd836b8 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.649s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 47a30844-242f-4a7f-ad9f-232a6e76b4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2fed360b-584a-4e1a-8e27-9189de7f5007 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 4dd0bb76-160a-4247-8bf7-5e28745fe4e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ed823684-5b31-4b43-a601-bb5e303e0863 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 023498fa-b18b-4947-9b09-e9f6caafa931 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 12bfda49-ce9d-4806-a982-08ce670faeb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance d5d019ce-3f5d-422c-b278-2b3cb3fd594a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing inventories for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Updating ProviderTree inventory for provider 77cac819-3c22-4fec-a59d-0525ac40a90b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Updating inventory in ProviderTree for provider 77cac819-3c22-4fec-a59d-0525ac40a90b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 10:13:04 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing aggregate associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, aggregates: None {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 10:13:05 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing trait associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3 {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 10:13:05 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:13:05 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:13:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:13:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.041s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:06 user nova-compute[74311]: DEBUG nova.compute.manager [req-17a44f06-0ec1-4700-8a73-69e59d5a2691 req-d1699136-b7e9-420e-bdef-b9b88b692097 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Received event network-vif-plugged-9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-17a44f06-0ec1-4700-8a73-69e59d5a2691 req-d1699136-b7e9-420e-bdef-b9b88b692097 service nova] Acquiring lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-17a44f06-0ec1-4700-8a73-69e59d5a2691 req-d1699136-b7e9-420e-bdef-b9b88b692097 service nova] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-17a44f06-0ec1-4700-8a73-69e59d5a2691 req-d1699136-b7e9-420e-bdef-b9b88b692097 service nova] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:06 user nova-compute[74311]: DEBUG nova.compute.manager [req-17a44f06-0ec1-4700-8a73-69e59d5a2691 req-d1699136-b7e9-420e-bdef-b9b88b692097 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] No waiting events found dispatching network-vif-plugged-9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:13:06 user nova-compute[74311]: WARNING nova.compute.manager [req-17a44f06-0ec1-4700-8a73-69e59d5a2691 req-d1699136-b7e9-420e-bdef-b9b88b692097 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Received unexpected event network-vif-plugged-9610009e-e341-4814-a3c3-523081eb0c8b for instance with vm_state active and task_state None.
Oct 20 10:13:06 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:13:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:13:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-dfcd7d3b-c5c9-41e7-8c76-1c0d6a59bbeb req-ab5bd24a-cd58-40b6-98d6-e1dffd039fd2 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Received event network-vif-plugged-9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-dfcd7d3b-c5c9-41e7-8c76-1c0d6a59bbeb req-ab5bd24a-cd58-40b6-98d6-e1dffd039fd2 service nova] Acquiring lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-dfcd7d3b-c5c9-41e7-8c76-1c0d6a59bbeb req-ab5bd24a-cd58-40b6-98d6-e1dffd039fd2 service nova] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-dfcd7d3b-c5c9-41e7-8c76-1c0d6a59bbeb req-ab5bd24a-cd58-40b6-98d6-e1dffd039fd2 service nova] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-dfcd7d3b-c5c9-41e7-8c76-1c0d6a59bbeb req-ab5bd24a-cd58-40b6-98d6-e1dffd039fd2 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] No waiting events found dispatching network-vif-plugged-9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:13:08 user nova-compute[74311]: WARNING nova.compute.manager [req-dfcd7d3b-c5c9-41e7-8c76-1c0d6a59bbeb req-ab5bd24a-cd58-40b6-98d6-e1dffd039fd2 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Received unexpected event network-vif-plugged-9610009e-e341-4814-a3c3-523081eb0c8b for instance with vm_state active and task_state None.
Oct 20 10:13:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:13:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:13:38 user nova-compute[74311]: INFO nova.compute.claims [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Claim successful on node user
Oct 20 10:13:38 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:13:38 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:13:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:13:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:13:38 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:13:38 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:13:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:13:38 user nova-compute[74311]: INFO nova.virt.block_device [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Booting with volume 2003efea-b3e5-4085-9290-fecb0dc99d77 at /dev/vda
Oct 20 10:13:38 user nova-compute[74311]: DEBUG os_brick.utils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:13:38 user nova-compute[74311]: INFO oslo.privsep.daemon [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp_fepbdk0/privsep.sock']
Oct 20 10:13:38 user sudo[85569]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp_fepbdk0/privsep.sock
Oct 20 10:13:38 user sudo[85569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 10:13:39 user nova-compute[74311]: DEBUG nova.policy [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e81b9fee1eb946ce98e8f8e9705ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f86d5595c8844db8ccdd70600dde9bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:13:39 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Successfully created port: 1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:13:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:13:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:13:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:13:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:13:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:13:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:39 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Successfully created port: f9e19dda-eda1-4115-9028-3d814859462c {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:13:40 user sudo[85569]: pam_unix(sudo:session): session closed for user root
Oct 20 10:13:40 user nova-compute[74311]: INFO oslo.privsep.daemon [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Spawned new privsep daemon via rootwrap
Oct 20 10:13:40 user nova-compute[74311]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 10:13:40 user nova-compute[74311]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 10:13:40 user nova-compute[74311]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 20 10:13:40 user nova-compute[74311]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85589
Oct 20 10:13:40 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Successfully created port: d6213339-1858-41a4-b0ed-db8897a2dca7 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1146e9a1-1638-4893-9eed-97c7c038d626]: (2,) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d7e47f-7ae2-4501-8eab-8702871b81ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:13:40 user nova-compute[74311]: WARNING os_brick.initiator.connectors.nvmeof [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fb83d5-61dd-4e0a-9029-65739b29dfb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b7d0a8-374f-48f7-8dee-9bf23372ad23]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[58219dcc-5511-445e-9cd4-d96521127ba0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:13:40 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:13:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a3326d-19d5-4257-a214-ea3eaeafc7a0]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG os_brick.utils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] <== get_connector_properties: return (1757ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updating existing volume attachment record: cc2cad30-171a-49fd-9ed0-ed36daa519a5 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:13:40 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Successfully created port: 45f7fdb4-ccdf-488d-9725-c15f461af479 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:13:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Successfully created port: 84d098d4-3ea0-41bf-8abc-c6d340094630 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:13:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Successfully updated port: 1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:13:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-bb2ed0e7-de9b-4f4f-ae92-1fc259935746 req-bbe3a6ef-4fe2-40f0-9d72-53fad5f772b1 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-changed-1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-bb2ed0e7-de9b-4f4f-ae92-1fc259935746 req-bbe3a6ef-4fe2-40f0-9d72-53fad5f772b1 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing instance network info cache due to event network-changed-1945a62d-3b78-4092-92cf-3609131863fd. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:13:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bb2ed0e7-de9b-4f4f-ae92-1fc259935746 req-bbe3a6ef-4fe2-40f0-9d72-53fad5f772b1 service nova] Acquiring lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:13:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bb2ed0e7-de9b-4f4f-ae92-1fc259935746 req-bbe3a6ef-4fe2-40f0-9d72-53fad5f772b1 service nova] Acquired lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:13:42 user nova-compute[74311]: DEBUG nova.network.neutron [req-bb2ed0e7-de9b-4f4f-ae92-1fc259935746 req-bbe3a6ef-4fe2-40f0-9d72-53fad5f772b1 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing network info cache for port 1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:13:42 user nova-compute[74311]: DEBUG nova.network.neutron [req-bb2ed0e7-de9b-4f4f-ae92-1fc259935746 req-bbe3a6ef-4fe2-40f0-9d72-53fad5f772b1 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:13:42 user nova-compute[74311]: DEBUG nova.network.neutron [req-bb2ed0e7-de9b-4f4f-ae92-1fc259935746 req-bbe3a6ef-4fe2-40f0-9d72-53fad5f772b1 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:13:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bb2ed0e7-de9b-4f4f-ae92-1fc259935746 req-bbe3a6ef-4fe2-40f0-9d72-53fad5f772b1 service nova] Releasing lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:13:42 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Successfully updated port: 51b06e65-3d65-4b26-9f2c-9b1098f034f4 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:13:43 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Successfully updated port: 2d4b55ba-9c6e-4784-a967-8b0ab34053a7 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-changed-51b06e65-3d65-4b26-9f2c-9b1098f034f4 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing instance network info cache due to event network-changed-51b06e65-3d65-4b26-9f2c-9b1098f034f4. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] Acquiring lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] Acquired lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG nova.network.neutron [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing network info cache for port 51b06e65-3d65-4b26-9f2c-9b1098f034f4 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG nova.network.neutron [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG nova.network.neutron [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] Releasing lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-changed-2d4b55ba-9c6e-4784-a967-8b0ab34053a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing instance network info cache due to event network-changed-2d4b55ba-9c6e-4784-a967-8b0ab34053a7. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] Acquiring lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] Acquired lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG nova.network.neutron [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing network info cache for port 2d4b55ba-9c6e-4784-a967-8b0ab34053a7 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG nova.network.neutron [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Successfully updated port: f9e19dda-eda1-4115-9028-3d814859462c {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG nova.network.neutron [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:13:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5f0fc7ba-5c64-48c4-84e1-0a17e8a55280 req-773c3318-80cf-457c-a0cf-c3eddc85c419 service nova] Releasing lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:13:45 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Successfully updated port: d6213339-1858-41a4-b0ed-db8897a2dca7 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:13:45 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Successfully updated port: 45f7fdb4-ccdf-488d-9725-c15f461af479 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-changed-f9e19dda-eda1-4115-9028-3d814859462c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing instance network info cache due to event network-changed-f9e19dda-eda1-4115-9028-3d814859462c. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] Acquiring lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] Acquired lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.network.neutron [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing network info cache for port f9e19dda-eda1-4115-9028-3d814859462c {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.network.neutron [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.network.neutron [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] Releasing lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-changed-d6213339-1858-41a4-b0ed-db8897a2dca7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing instance network info cache due to event network-changed-d6213339-1858-41a4-b0ed-db8897a2dca7. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] Acquiring lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] Acquired lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.network.neutron [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing network info cache for port d6213339-1858-41a4-b0ed-db8897a2dca7 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.network.neutron [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Successfully updated port: 84d098d4-3ea0-41bf-8abc-c6d340094630 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.network.neutron [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] Releasing lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-changed-45f7fdb4-ccdf-488d-9725-c15f461af479 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing instance network info cache due to event network-changed-45f7fdb4-ccdf-488d-9725-c15f461af479. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] Acquiring lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] Acquired lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.network.neutron [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing network info cache for port 45f7fdb4-ccdf-488d-9725-c15f461af479 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.network.neutron [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.network.neutron [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c8255520-24ed-4562-8a27-711fbcf35d0c req-cd72a9e1-4d3e-4903-a8f0-12467948f129 service nova] Releasing lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquired lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:13:46 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:13:47 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:13:48 user nova-compute[74311]: DEBUG nova.compute.manager [req-d562e9f6-845f-48c9-a41e-add30dad79bc req-3916542d-8be7-4044-add3-3e9064b9693d service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-changed-84d098d4-3ea0-41bf-8abc-c6d340094630 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:48 user nova-compute[74311]: DEBUG nova.compute.manager [req-d562e9f6-845f-48c9-a41e-add30dad79bc req-3916542d-8be7-4044-add3-3e9064b9693d service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing instance network info cache due to event network-changed-84d098d4-3ea0-41bf-8abc-c6d340094630. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:13:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d562e9f6-845f-48c9-a41e-add30dad79bc req-3916542d-8be7-4044-add3-3e9064b9693d service nova] Acquiring lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:13:48 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updating instance_info_cache with network_info: [{"id": "1945a62d-3b78-4092-92cf-3609131863fd", "address": "fa:16:3e:88:e7:48", "network": {"id": "37a1d6c5-3fc8-482c-bdf2-08694d929f66", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1387148929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1945a62d-3b", "ovs_interfaceid": "1945a62d-3b78-4092-92cf-3609131863fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "address": "fa:16:3e:a4:4c:e3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b06e65-3d", "ovs_interfaceid": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "address": "fa:16:3e:58:d3:49", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4b55ba-9c", "ovs_interfaceid": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9e19dda-eda1-4115-9028-3d814859462c", "address": "fa:16:3e:d8:03:d3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e19dda-ed", "ovs_interfaceid": "f9e19dda-eda1-4115-9028-3d814859462c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6213339-1858-41a4-b0ed-db8897a2dca7", "address": "fa:16:3e:1e:ef:d4", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6213339-18", "ovs_interfaceid": "d6213339-1858-41a4-b0ed-db8897a2dca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f7fdb4-ccdf-488d-9725-c15f461af479", "address": "fa:16:3e:f7:27:e0", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f7fdb4-cc", "ovs_interfaceid": "45f7fdb4-ccdf-488d-9725-c15f461af479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84d098d4-3ea0-41bf-8abc-c6d340094630", "address": "fa:16:3e:e2:ae:b4", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d098d4-3e", "ovs_interfaceid": "84d098d4-3ea0-41bf-8abc-c6d340094630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:13:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Releasing lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:13:48 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Instance network_info: |[{"id": "1945a62d-3b78-4092-92cf-3609131863fd", "address": "fa:16:3e:88:e7:48", "network": {"id": "37a1d6c5-3fc8-482c-bdf2-08694d929f66", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1387148929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1945a62d-3b", "ovs_interfaceid": "1945a62d-3b78-4092-92cf-3609131863fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "address": "fa:16:3e:a4:4c:e3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b06e65-3d", "ovs_interfaceid": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "address": "fa:16:3e:58:d3:49", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4b55ba-9c", "ovs_interfaceid": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9e19dda-eda1-4115-9028-3d814859462c", "address": "fa:16:3e:d8:03:d3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e19dda-ed", "ovs_interfaceid": "f9e19dda-eda1-4115-9028-3d814859462c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6213339-1858-41a4-b0ed-db8897a2dca7", "address": "fa:16:3e:1e:ef:d4", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6213339-18", "ovs_interfaceid": "d6213339-1858-41a4-b0ed-db8897a2dca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f7fdb4-ccdf-488d-9725-c15f461af479", "address": "fa:16:3e:f7:27:e0", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f7fdb4-cc", "ovs_interfaceid": "45f7fdb4-ccdf-488d-9725-c15f461af479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84d098d4-3ea0-41bf-8abc-c6d340094630", "address": "fa:16:3e:e2:ae:b4", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d098d4-3e", "ovs_interfaceid": "84d098d4-3ea0-41bf-8abc-c6d340094630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:13:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d562e9f6-845f-48c9-a41e-add30dad79bc req-3916542d-8be7-4044-add3-3e9064b9693d service nova] Acquired lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:13:48 user nova-compute[74311]: DEBUG nova.network.neutron [req-d562e9f6-845f-48c9-a41e-add30dad79bc req-3916542d-8be7-4044-add3-3e9064b9693d service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing network info cache for port 84d098d4-3ea0-41bf-8abc-c6d340094630 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:13:49 user nova-compute[74311]: DEBUG nova.network.neutron [req-d562e9f6-845f-48c9-a41e-add30dad79bc req-3916542d-8be7-4044-add3-3e9064b9693d service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updated VIF entry in instance network info cache for port 84d098d4-3ea0-41bf-8abc-c6d340094630. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:13:49 user nova-compute[74311]: DEBUG nova.network.neutron [req-d562e9f6-845f-48c9-a41e-add30dad79bc req-3916542d-8be7-4044-add3-3e9064b9693d service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updating instance_info_cache with network_info: [{"id": "1945a62d-3b78-4092-92cf-3609131863fd", "address": "fa:16:3e:88:e7:48", "network": {"id": "37a1d6c5-3fc8-482c-bdf2-08694d929f66", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1387148929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1945a62d-3b", "ovs_interfaceid": "1945a62d-3b78-4092-92cf-3609131863fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "address": "fa:16:3e:a4:4c:e3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b06e65-3d", "ovs_interfaceid": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "address": "fa:16:3e:58:d3:49", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4b55ba-9c", "ovs_interfaceid": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9e19dda-eda1-4115-9028-3d814859462c", "address": "fa:16:3e:d8:03:d3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e19dda-ed", "ovs_interfaceid": "f9e19dda-eda1-4115-9028-3d814859462c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6213339-1858-41a4-b0ed-db8897a2dca7", "address": "fa:16:3e:1e:ef:d4", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6213339-18", "ovs_interfaceid": "d6213339-1858-41a4-b0ed-db8897a2dca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f7fdb4-ccdf-488d-9725-c15f461af479", "address": "fa:16:3e:f7:27:e0", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f7fdb4-cc", "ovs_interfaceid": "45f7fdb4-ccdf-488d-9725-c15f461af479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84d098d4-3ea0-41bf-8abc-c6d340094630", "address": "fa:16:3e:e2:ae:b4", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d098d4-3e", "ovs_interfaceid": "84d098d4-3ea0-41bf-8abc-c6d340094630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:13:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d562e9f6-845f-48c9-a41e-add30dad79bc req-3916542d-8be7-4044-add3-3e9064b9693d service nova] Releasing lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:13:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:13:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:13:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:13:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:13:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:13:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:13:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:13:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:13:52 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:13:52 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Updating instance_info_cache with network_info: [{"id": "3a618325-862e-4c54-a654-6d3284cb8bf3", "address": "fa:16:3e:e2:bf:e1", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a618325-86", "ovs_interfaceid": "3a618325-862e-4c54-a654-6d3284cb8bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:13:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:13:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:13:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "7007d024-0a3b-425c-89f5-342728c2397b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "7007d024-0a3b-425c-89f5-342728c2397b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:13:53 user nova-compute[74311]: INFO nova.compute.claims [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Claim successful on node user
Oct 20 10:13:53 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:13:53 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:13:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG nova.policy [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c40e8a363dd4eaf862c0b61de171130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbc9455e6a754bafb33349644f579988', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:13:53 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Creating image(s)
Oct 20 10:13:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "/opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "/opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "/opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG nova.compute.manager [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:13:54 user nova-compute[74311]: INFO nova.compute.manager [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] instance snapshotting
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.204s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:54 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Beginning live snapshot process
Oct 20 10:13:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Successfully created port: 8849f33b-3838-4db8-b284-adf0d69e250e {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.195s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk 1073741824" returned: 0 in 0.053s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json -f qcow2 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.182s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json -f qcow2 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Cannot resize image /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Ensure instance console log exists: /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json -f qcow2" returned: 0 in 0.224s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Successfully updated port: 8849f33b-3838-4db8-b284-adf0d69e250e {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "refresh_cache-7007d024-0a3b-425c-89f5-342728c2397b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquired lock "refresh_cache-7007d024-0a3b-425c-89f5-342728c2397b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-e8e8d2bb-7da4-4796-9ab3-225b72c669c3 req-da1ba12c-8be5-4585-b09e-760428373b51 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Received event network-changed-8849f33b-3838-4db8-b284-adf0d69e250e {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-e8e8d2bb-7da4-4796-9ab3-225b72c669c3 req-da1ba12c-8be5-4585-b09e-760428373b51 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Refreshing instance network info cache due to event network-changed-8849f33b-3838-4db8-b284-adf0d69e250e. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:13:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e8e8d2bb-7da4-4796-9ab3-225b72c669c3 req-da1ba12c-8be5-4585-b09e-760428373b51 service nova] Acquiring lock "refresh_cache-7007d024-0a3b-425c-89f5-342728c2397b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqo_9dsl4/28bfeb65dcae446f81296a070719b860.delta 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqo_9dsl4/28bfeb65dcae446f81296a070719b860.delta 1073741824" returned: 0 in 0.049s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:55 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74311) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 20 10:13:55 user nova-compute[74311]: INFO nova.virt.libvirt.host [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] UEFI support detected
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Updating instance_info_cache with network_info: [{"id": "8849f33b-3838-4db8-b284-adf0d69e250e", "address": "fa:16:3e:67:f7:8a", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8849f33b-38", "ovs_interfaceid": "8849f33b-3838-4db8-b284-adf0d69e250e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Releasing lock "refresh_cache-7007d024-0a3b-425c-89f5-342728c2397b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Instance network_info: |[{"id": "8849f33b-3838-4db8-b284-adf0d69e250e", "address": "fa:16:3e:67:f7:8a", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8849f33b-38", "ovs_interfaceid": "8849f33b-3838-4db8-b284-adf0d69e250e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e8e8d2bb-7da4-4796-9ab3-225b72c669c3 req-da1ba12c-8be5-4585-b09e-760428373b51 service nova] Acquired lock "refresh_cache-7007d024-0a3b-425c-89f5-342728c2397b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.network.neutron [req-e8e8d2bb-7da4-4796-9ab3-225b72c669c3 req-da1ba12c-8be5-4585-b09e-760428373b51 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Refreshing network info cache for port 8849f33b-3838-4db8-b284-adf0d69e250e {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Start _get_guest_xml network_info=[{"id": "8849f33b-3838-4db8-b284-adf0d69e250e", "address": "fa:16:3e:67:f7:8a", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8849f33b-38", "ovs_interfaceid": "8849f33b-3838-4db8-b284-adf0d69e250e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:13:55 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:13:55 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:13:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1254043393',display_name='tempest-ServersNegativeTestJSON-server-1254043393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1254043393',id=12,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbc9455e6a754bafb33349644f579988',ramdisk_id='',reservation_id='r-8a7cv3f1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1307260612',owner_user_name='tempest-ServersNegativeTestJSON-1307260612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:54Z,user_data=None,user_id='6c40e8a363dd4eaf862c0b61de171130',uuid=7007d024-0a3b-425c-89f5-342728c2397b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8849f33b-3838-4db8-b284-adf0d69e250e", "address": "fa:16:3e:67:f7:8a", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8849f33b-38", "ovs_interfaceid": "8849f33b-3838-4db8-b284-adf0d69e250e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Converting VIF {"id": "8849f33b-3838-4db8-b284-adf0d69e250e", "address": "fa:16:3e:67:f7:8a", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8849f33b-38", "ovs_interfaceid": "8849f33b-3838-4db8-b284-adf0d69e250e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:f7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8849f33b-3838-4db8-b284-adf0d69e250e,network=Network(5253925b-fda9-426d-8a82-bc8924961ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8849f33b-38') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.objects.instance [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lazy-loading 'pci_devices' on Instance uuid 7007d024-0a3b-425c-89f5-342728c2397b {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:13:55 user nova-compute[74311]:   <uuid>7007d024-0a3b-425c-89f5-342728c2397b</uuid>
Oct 20 10:13:55 user nova-compute[74311]:   <name>instance-0000000c</name>
Oct 20 10:13:55 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:13:55 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:13:55 user nova-compute[74311]:   <metadata>
Oct 20 10:13:55 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:13:55 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:13:55 user nova-compute[74311]:       <nova:name>tempest-ServersNegativeTestJSON-server-1254043393</nova:name>
Oct 20 10:13:55 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:13:55</nova:creationTime>
Oct 20 10:13:55 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:13:55 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:13:55 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:13:55 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:13:55 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:13:55 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:13:55 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:13:55 user nova-compute[74311]:       <nova:owner>
Oct 20 10:13:55 user nova-compute[74311]:         <nova:user uuid="6c40e8a363dd4eaf862c0b61de171130">tempest-ServersNegativeTestJSON-1307260612-project-member</nova:user>
Oct 20 10:13:55 user nova-compute[74311]:         <nova:project uuid="cbc9455e6a754bafb33349644f579988">tempest-ServersNegativeTestJSON-1307260612</nova:project>
Oct 20 10:13:55 user nova-compute[74311]:       </nova:owner>
Oct 20 10:13:55 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:13:55 user nova-compute[74311]:       <nova:ports>
Oct 20 10:13:55 user nova-compute[74311]:         <nova:port uuid="8849f33b-3838-4db8-b284-adf0d69e250e">
Oct 20 10:13:55 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 10:13:55 user nova-compute[74311]:         </nova:port>
Oct 20 10:13:55 user nova-compute[74311]:       </nova:ports>
Oct 20 10:13:55 user nova-compute[74311]:     </nova:instance>
Oct 20 10:13:55 user nova-compute[74311]:   </metadata>
Oct 20 10:13:55 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:13:55 user nova-compute[74311]:     <system>
Oct 20 10:13:55 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:13:55 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:13:55 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:13:55 user nova-compute[74311]:       <entry name="serial">7007d024-0a3b-425c-89f5-342728c2397b</entry>
Oct 20 10:13:55 user nova-compute[74311]:       <entry name="uuid">7007d024-0a3b-425c-89f5-342728c2397b</entry>
Oct 20 10:13:55 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:13:55 user nova-compute[74311]:     </system>
Oct 20 10:13:55 user nova-compute[74311]:   </sysinfo>
Oct 20 10:13:55 user nova-compute[74311]:   <os>
Oct 20 10:13:55 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:13:55 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:13:55 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:13:55 user nova-compute[74311]:   </os>
Oct 20 10:13:55 user nova-compute[74311]:   <features>
Oct 20 10:13:55 user nova-compute[74311]:     <acpi/>
Oct 20 10:13:55 user nova-compute[74311]:     <apic/>
Oct 20 10:13:55 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:13:55 user nova-compute[74311]:   </features>
Oct 20 10:13:55 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:13:55 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:13:55 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:13:55 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:13:55 user nova-compute[74311]:   </clock>
Oct 20 10:13:55 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:13:55 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:13:55 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:13:55 user nova-compute[74311]:   </cpu>
Oct 20 10:13:55 user nova-compute[74311]:   <devices>
Oct 20 10:13:55 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:13:55 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:13:55 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk"/>
Oct 20 10:13:55 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:13:55 user nova-compute[74311]:     </disk>
Oct 20 10:13:55 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:13:55 user nova-compute[74311]:       <mac address="fa:16:3e:67:f7:8a"/>
Oct 20 10:13:55 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:13:55 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:13:55 user nova-compute[74311]:       <target dev="tap8849f33b-38"/>
Oct 20 10:13:55 user nova-compute[74311]:     </interface>
Oct 20 10:13:55 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:13:55 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/console.log" append="off"/>
Oct 20 10:13:55 user nova-compute[74311]:     </serial>
Oct 20 10:13:55 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:13:55 user nova-compute[74311]:     <video>
Oct 20 10:13:55 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:13:55 user nova-compute[74311]:     </video>
Oct 20 10:13:55 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:13:55 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:13:55 user nova-compute[74311]:     </rng>
Oct 20 10:13:55 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:13:55 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:13:55 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:13:55 user nova-compute[74311]:     </memballoon>
Oct 20 10:13:55 user nova-compute[74311]:   </devices>
Oct 20 10:13:55 user nova-compute[74311]: </domain>
Oct 20 10:13:55 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:13:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1254043393',display_name='tempest-ServersNegativeTestJSON-server-1254043393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1254043393',id=12,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbc9455e6a754bafb33349644f579988',ramdisk_id='',reservation_id='r-8a7cv3f1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1307260612',owner_user_name='tempest-ServersNegativeTestJSON-1307260612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:54Z,user_data=None,user_id='6c40e8a363dd4eaf862c0b61de171130',uuid=7007d024-0a3b-425c-89f5-342728c2397b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8849f33b-3838-4db8-b284-adf0d69e250e", "address": "fa:16:3e:67:f7:8a", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8849f33b-38", "ovs_interfaceid": "8849f33b-3838-4db8-b284-adf0d69e250e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Converting VIF {"id": "8849f33b-3838-4db8-b284-adf0d69e250e", "address": "fa:16:3e:67:f7:8a", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8849f33b-38", "ovs_interfaceid": "8849f33b-3838-4db8-b284-adf0d69e250e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:f7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8849f33b-3838-4db8-b284-adf0d69e250e,network=Network(5253925b-fda9-426d-8a82-bc8924961ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8849f33b-38') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG os_vif [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:f7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8849f33b-3838-4db8-b284-adf0d69e250e,network=Network(5253925b-fda9-426d-8a82-bc8924961ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8849f33b-38') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b233b39c-ce75-539f-a5a3-0c1803bcda97', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8849f33b-38, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8849f33b-38, col_values=(('qos', UUID('1b39f6d7-dfb9-42a2-847f-130a648b7bec')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8849f33b-38, col_values=(('external_ids', {'iface-id': '8849f33b-3838-4db8-b284-adf0d69e250e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:f7:8a', 'vm-uuid': '7007d024-0a3b-425c-89f5-342728c2397b'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:55 user nova-compute[74311]: INFO os_vif [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:f7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8849f33b-3838-4db8-b284-adf0d69e250e,network=Network(5253925b-fda9-426d-8a82-bc8924961ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8849f33b-38')
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] No VIF found with MAC fa:16:3e:67:f7:8a, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.network.neutron [req-e8e8d2bb-7da4-4796-9ab3-225b72c669c3 req-da1ba12c-8be5-4585-b09e-760428373b51 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Updated VIF entry in instance network info cache for port 8849f33b-3838-4db8-b284-adf0d69e250e. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.network.neutron [req-e8e8d2bb-7da4-4796-9ab3-225b72c669c3 req-da1ba12c-8be5-4585-b09e-760428373b51 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Updating instance_info_cache with network_info: [{"id": "8849f33b-3838-4db8-b284-adf0d69e250e", "address": "fa:16:3e:67:f7:8a", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8849f33b-38", "ovs_interfaceid": "8849f33b-3838-4db8-b284-adf0d69e250e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e8e8d2bb-7da4-4796-9ab3-225b72c669c3 req-da1ba12c-8be5-4585-b09e-760428373b51 service nova] Releasing lock "refresh_cache-7007d024-0a3b-425c-89f5-342728c2397b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:13:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:13:56 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:13:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:13:56 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 10:13:56 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:13:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqo_9dsl4/28bfeb65dcae446f81296a070719b860.delta /opt/stack/data/nova/instances/snapshots/tmpqo_9dsl4/28bfeb65dcae446f81296a070719b860 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqo_9dsl4/28bfeb65dcae446f81296a070719b860.delta /opt/stack/data/nova/instances/snapshots/tmpqo_9dsl4/28bfeb65dcae446f81296a070719b860" returned: 0 in 0.263s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:56 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Snapshot extracted, beginning image upload
Oct 20 10:13:57 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:13:57 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:13:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:57 user nova-compute[74311]: DEBUG nova.compute.manager [req-59a892a2-9b17-419d-8207-07cda1abc243 req-3c61293f-c122-4e59-ae37-2057b4786a55 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Received event network-vif-plugged-8849f33b-3838-4db8-b284-adf0d69e250e {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-59a892a2-9b17-419d-8207-07cda1abc243 req-3c61293f-c122-4e59-ae37-2057b4786a55 service nova] Acquiring lock "7007d024-0a3b-425c-89f5-342728c2397b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-59a892a2-9b17-419d-8207-07cda1abc243 req-3c61293f-c122-4e59-ae37-2057b4786a55 service nova] Lock "7007d024-0a3b-425c-89f5-342728c2397b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-59a892a2-9b17-419d-8207-07cda1abc243 req-3c61293f-c122-4e59-ae37-2057b4786a55 service nova] Lock "7007d024-0a3b-425c-89f5-342728c2397b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:57 user nova-compute[74311]: DEBUG nova.compute.manager [req-59a892a2-9b17-419d-8207-07cda1abc243 req-3c61293f-c122-4e59-ae37-2057b4786a55 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] No waiting events found dispatching network-vif-plugged-8849f33b-3838-4db8-b284-adf0d69e250e {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:13:57 user nova-compute[74311]: WARNING nova.compute.manager [req-59a892a2-9b17-419d-8207-07cda1abc243 req-3c61293f-c122-4e59-ae37-2057b4786a55 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Received unexpected event network-vif-plugged-8849f33b-3838-4db8-b284-adf0d69e250e for instance with vm_state building and task_state spawning.
Oct 20 10:13:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:13:57 user nova-compute[74311]: INFO nova.virt.block_device [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Booting with volume b5eb5a5d-f10a-40d2-a8f0-955866b28055 at /dev/vdb
Oct 20 10:13:57 user nova-compute[74311]: DEBUG os_brick.utils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:13:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf1ed61-30c7-4238-947a-b9dc6e743212]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:13:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f353719d-e9e1-495f-80b4-6fcf95e0416b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85e74ad-8cba-4d2b-8eb7-155aac6506ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86b3677-c3d8-4be8-96b2-b5ad383daa7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:13:58 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9038953c-b441-483a-b61a-13a3d9396475]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG os_brick.utils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updating existing volume attachment record: 1d8872d4-752b-4b76-a79c-e6b77b5fbeca {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-f854818a-cfe7-4e29-b1c2-ead65b9ddf89 req-2f06e3a8-c952-40c2-aea1-35ec22a74048 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-changed-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-f854818a-cfe7-4e29-b1c2-ead65b9ddf89 req-2f06e3a8-c952-40c2-aea1-35ec22a74048 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Refreshing instance network info cache due to event network-changed-a042b1af-3064-4133-97dc-eaf5e3bf4859. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f854818a-cfe7-4e29-b1c2-ead65b9ddf89 req-2f06e3a8-c952-40c2-aea1-35ec22a74048 service nova] Acquiring lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f854818a-cfe7-4e29-b1c2-ead65b9ddf89 req-2f06e3a8-c952-40c2-aea1-35ec22a74048 service nova] Acquired lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:13:58 user nova-compute[74311]: DEBUG nova.network.neutron [req-f854818a-cfe7-4e29-b1c2-ead65b9ddf89 req-2f06e3a8-c952-40c2-aea1-35ec22a74048 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Refreshing network info cache for port a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:13:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-5fd4f446-a50a-451e-b1e1-b01d21909534 req-0d2f5c39-901c-4229-a6fd-12d966dff4d4 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Received event network-vif-plugged-8849f33b-3838-4db8-b284-adf0d69e250e {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:13:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5fd4f446-a50a-451e-b1e1-b01d21909534 req-0d2f5c39-901c-4229-a6fd-12d966dff4d4 service nova] Acquiring lock "7007d024-0a3b-425c-89f5-342728c2397b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:13:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5fd4f446-a50a-451e-b1e1-b01d21909534 req-0d2f5c39-901c-4229-a6fd-12d966dff4d4 service nova] Lock "7007d024-0a3b-425c-89f5-342728c2397b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:13:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5fd4f446-a50a-451e-b1e1-b01d21909534 req-0d2f5c39-901c-4229-a6fd-12d966dff4d4 service nova] Lock "7007d024-0a3b-425c-89f5-342728c2397b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:13:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-5fd4f446-a50a-451e-b1e1-b01d21909534 req-0d2f5c39-901c-4229-a6fd-12d966dff4d4 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] No waiting events found dispatching network-vif-plugged-8849f33b-3838-4db8-b284-adf0d69e250e {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:13:59 user nova-compute[74311]: WARNING nova.compute.manager [req-5fd4f446-a50a-451e-b1e1-b01d21909534 req-0d2f5c39-901c-4229-a6fd-12d966dff4d4 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Received unexpected event network-vif-plugged-8849f33b-3838-4db8-b284-adf0d69e250e for instance with vm_state building and task_state spawning.
Oct 20 10:13:59 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Snapshot image upload complete
Oct 20 10:13:59 user nova-compute[74311]: INFO nova.compute.manager [None req-6e86ff6c-a195-4ded-a040-5e98cf187078 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Took 5.54 seconds to snapshot the instance on the hypervisor.
Oct 20 10:13:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:13:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:13:59 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Instance spawned successfully.
Oct 20 10:13:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:13:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:13:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:13:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:13:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:13:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:13:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:13:59 user nova-compute[74311]: INFO nova.compute.manager [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Took 5.92 seconds to spawn the instance on the hypervisor.
Oct 20 10:13:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:13:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:13:59 user nova-compute[74311]: INFO nova.compute.manager [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Took 6.87 seconds to build instance.
Oct 20 10:13:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca738fda-e6e9-4a5e-8406-496b46279e8d tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "7007d024-0a3b-425c-89f5-342728c2397b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.994s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG nova.network.neutron [req-f854818a-cfe7-4e29-b1c2-ead65b9ddf89 req-2f06e3a8-c952-40c2-aea1-35ec22a74048 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updated VIF entry in instance network info cache for port a042b1af-3064-4133-97dc-eaf5e3bf4859. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG nova.network.neutron [req-f854818a-cfe7-4e29-b1c2-ead65b9ddf89 req-2f06e3a8-c952-40c2-aea1-35ec22a74048 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating instance_info_cache with network_info: [{"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f854818a-cfe7-4e29-b1c2-ead65b9ddf89 req-2f06e3a8-c952-40c2-aea1-35ec22a74048 service nova] Releasing lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-46b36200-8596-4c75-916a-90fbbddea879 req-7ce09dde-71a1-420a-b088-bc0651d383a7 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Received event network-changed-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-46b36200-8596-4c75-916a-90fbbddea879 req-7ce09dde-71a1-420a-b088-bc0651d383a7 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Refreshing instance network info cache due to event network-changed-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-46b36200-8596-4c75-916a-90fbbddea879 req-7ce09dde-71a1-420a-b088-bc0651d383a7 service nova] Acquiring lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-46b36200-8596-4c75-916a-90fbbddea879 req-7ce09dde-71a1-420a-b088-bc0651d383a7 service nova] Acquired lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG nova.network.neutron [req-46b36200-8596-4c75-916a-90fbbddea879 req-7ce09dde-71a1-420a-b088-bc0651d383a7 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Refreshing network info cache for port ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG nova.network.neutron [req-46b36200-8596-4c75-916a-90fbbddea879 req-7ce09dde-71a1-420a-b088-bc0651d383a7 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Updated VIF entry in instance network info cache for port ba6f8ece-930b-4fda-bfb7-3b96f8339bfa. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG nova.network.neutron [req-46b36200-8596-4c75-916a-90fbbddea879 req-7ce09dde-71a1-420a-b088-bc0651d383a7 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Updating instance_info_cache with network_info: [{"id": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "address": "fa:16:3e:f0:04:5d", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6f8ece-93", "ovs_interfaceid": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-46b36200-8596-4c75-916a-90fbbddea879 req-7ce09dde-71a1-420a-b088-bc0651d383a7 service nova] Releasing lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-94222861-9ee3-41ed-911f-e53333eb1ab4 req-1a72bc94-fd77-4383-9313-4e377d52b3ff service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Received event network-changed-097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-94222861-9ee3-41ed-911f-e53333eb1ab4 req-1a72bc94-fd77-4383-9313-4e377d52b3ff service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Refreshing instance network info cache due to event network-changed-097b3196-1731-46ef-a752-fcc882c73dfd. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-94222861-9ee3-41ed-911f-e53333eb1ab4 req-1a72bc94-fd77-4383-9313-4e377d52b3ff service nova] Acquiring lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-94222861-9ee3-41ed-911f-e53333eb1ab4 req-1a72bc94-fd77-4383-9313-4e377d52b3ff service nova] Acquired lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG nova.network.neutron [req-94222861-9ee3-41ed-911f-e53333eb1ab4 req-1a72bc94-fd77-4383-9313-4e377d52b3ff service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Refreshing network info cache for port 097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:02 user nova-compute[74311]: DEBUG nova.network.neutron [req-94222861-9ee3-41ed-911f-e53333eb1ab4 req-1a72bc94-fd77-4383-9313-4e377d52b3ff service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Updated VIF entry in instance network info cache for port 097b3196-1731-46ef-a752-fcc882c73dfd. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:14:02 user nova-compute[74311]: DEBUG nova.network.neutron [req-94222861-9ee3-41ed-911f-e53333eb1ab4 req-1a72bc94-fd77-4383-9313-4e377d52b3ff service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Updating instance_info_cache with network_info: [{"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:14:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-94222861-9ee3-41ed-911f-e53333eb1ab4 req-1a72bc94-fd77-4383-9313-4e377d52b3ff service nova] Releasing lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:14:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:04 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:14:04 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:14:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=6978MB free_disk=25.474693298339844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:14:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 47a30844-242f-4a7f-ad9f-232a6e76b4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2fed360b-584a-4e1a-8e27-9189de7f5007 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 4dd0bb76-160a-4247-8bf7-5e28745fe4e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ed823684-5b31-4b43-a601-bb5e303e0863 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 023498fa-b18b-4947-9b09-e9f6caafa931 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 12bfda49-ce9d-4806-a982-08ce670faeb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance d5d019ce-3f5d-422c-b278-2b3cb3fd594a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance d604a60d-cb10-46a9-8b53-adec39a93a84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 7007d024-0a3b-425c-89f5-342728c2397b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:06 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:14:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:14:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "560c41a4-79a3-461d-976d-f260bc9086f8" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "560c41a4-79a3-461d-976d-f260bc9086f8" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:07 user nova-compute[74311]: INFO nova.compute.manager [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Shelving
Oct 20 10:14:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:07 user nova-compute[74311]: DEBUG nova.compute.manager [req-5015aa3b-e163-4b6f-a98c-8d942c519d1b req-62dc40cf-cac5-4d75-b37c-46ec39f8dec3 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Received event network-vif-unplugged-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5015aa3b-e163-4b6f-a98c-8d942c519d1b req-62dc40cf-cac5-4d75-b37c-46ec39f8dec3 service nova] Acquiring lock "560c41a4-79a3-461d-976d-f260bc9086f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5015aa3b-e163-4b6f-a98c-8d942c519d1b req-62dc40cf-cac5-4d75-b37c-46ec39f8dec3 service nova] Lock "560c41a4-79a3-461d-976d-f260bc9086f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5015aa3b-e163-4b6f-a98c-8d942c519d1b req-62dc40cf-cac5-4d75-b37c-46ec39f8dec3 service nova] Lock "560c41a4-79a3-461d-976d-f260bc9086f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:07 user nova-compute[74311]: DEBUG nova.compute.manager [req-5015aa3b-e163-4b6f-a98c-8d942c519d1b req-62dc40cf-cac5-4d75-b37c-46ec39f8dec3 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] No waiting events found dispatching network-vif-unplugged-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:07 user nova-compute[74311]: WARNING nova.compute.manager [req-5015aa3b-e163-4b6f-a98c-8d942c519d1b req-62dc40cf-cac5-4d75-b37c-46ec39f8dec3 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Received unexpected event network-vif-unplugged-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa for instance with vm_state active and task_state shelving.
Oct 20 10:14:08 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Instance destroyed successfully.
Oct 20 10:14:08 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Beginning cold snapshot process
Oct 20 10:14:08 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:14:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk /opt/stack/data/nova/instances/snapshots/tmph_069v7s/551509442b9c4f3b9688b4e8c70d4691 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8/disk /opt/stack/data/nova/instances/snapshots/tmph_069v7s/551509442b9c4f3b9688b4e8c70d4691" returned: 0 in 0.888s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:09 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Snapshot extracted, beginning image upload
Oct 20 10:14:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-c0207389-a508-4eab-96c2-2185f653746e req-da9e25b1-cc37-473d-a3c2-1b46b5cd5eb9 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Received event network-vif-plugged-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c0207389-a508-4eab-96c2-2185f653746e req-da9e25b1-cc37-473d-a3c2-1b46b5cd5eb9 service nova] Acquiring lock "560c41a4-79a3-461d-976d-f260bc9086f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c0207389-a508-4eab-96c2-2185f653746e req-da9e25b1-cc37-473d-a3c2-1b46b5cd5eb9 service nova] Lock "560c41a4-79a3-461d-976d-f260bc9086f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c0207389-a508-4eab-96c2-2185f653746e req-da9e25b1-cc37-473d-a3c2-1b46b5cd5eb9 service nova] Lock "560c41a4-79a3-461d-976d-f260bc9086f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-c0207389-a508-4eab-96c2-2185f653746e req-da9e25b1-cc37-473d-a3c2-1b46b5cd5eb9 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] No waiting events found dispatching network-vif-plugged-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:10 user nova-compute[74311]: WARNING nova.compute.manager [req-c0207389-a508-4eab-96c2-2185f653746e req-da9e25b1-cc37-473d-a3c2-1b46b5cd5eb9 service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Received unexpected event network-vif-plugged-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 10:14:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:12 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Snapshot image upload complete
Oct 20 10:14:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:14:12 user nova-compute[74311]: INFO nova.compute.manager [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Shelve offloading
Oct 20 10:14:12 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Instance destroyed successfully.
Oct 20 10:14:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:14:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:14:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquired lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:14:12 user nova-compute[74311]: DEBUG nova.network.neutron [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:14:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:12 user nova-compute[74311]: DEBUG nova.network.neutron [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Updating instance_info_cache with network_info: [{"id": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "address": "fa:16:3e:f0:04:5d", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6f8ece-93", "ovs_interfaceid": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:14:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Releasing lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:14:13 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Instance destroyed successfully.
Oct 20 10:14:13 user nova-compute[74311]: DEBUG nova.objects.instance [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lazy-loading 'resources' on Instance uuid 560c41a4-79a3-461d-976d-f260bc9086f8 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1356530268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1356530268',id=4,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZB0aNKe9kIku87IHJMADK/Nv8kbo9imDtLDPEWE+5/w6MENrwCSIxG0oLe5qq4fzJKiP0k+N7KImFqQXguRcxoJN9XA+mJYToiupaLKAll/R1UTOUN0lJQABMvnWdt+w==',key_name='tempest-keypair-214066121',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='61fab5f8b38b490985cc614ade80f25a',ramdisk_id='',reservation_id='r-7i400o0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1592971712',owner_user_name='tempest-AttachVolumeShelveTestJSON-1592971712-project-member',shelved_at='2023-10-20T10:14:12.214193',shelved_host='user',shelved_image_id='d7b15930-4dbd-4268-bfbb-58dba6dc1cef'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:14:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1aad9aa1e64a9db4f78c0c12779300',uuid=560c41a4-79a3-461d-976d-f260bc9086f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "address": "fa:16:3e:f0:04:5d", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6f8ece-93", "ovs_interfaceid": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converting VIF {"id": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "address": "fa:16:3e:f0:04:5d", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba6f8ece-93", "ovs_interfaceid": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:04:5d,bridge_name='br-int',has_traffic_filtering=True,id=ba6f8ece-930b-4fda-bfb7-3b96f8339bfa,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6f8ece-93') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG os_vif [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:04:5d,bridge_name='br-int',has_traffic_filtering=True,id=ba6f8ece-930b-4fda-bfb7-3b96f8339bfa,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6f8ece-93') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG nova.compute.manager [req-681a0ebe-1731-4068-868f-6a0933c56380 req-1cffe354-6bac-4370-b109-505656a3a5cc service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Received event network-changed-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG nova.compute.manager [req-681a0ebe-1731-4068-868f-6a0933c56380 req-1cffe354-6bac-4370-b109-505656a3a5cc service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Refreshing instance network info cache due to event network-changed-ba6f8ece-930b-4fda-bfb7-3b96f8339bfa. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-681a0ebe-1731-4068-868f-6a0933c56380 req-1cffe354-6bac-4370-b109-505656a3a5cc service nova] Acquiring lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-681a0ebe-1731-4068-868f-6a0933c56380 req-1cffe354-6bac-4370-b109-505656a3a5cc service nova] Acquired lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG nova.network.neutron [req-681a0ebe-1731-4068-868f-6a0933c56380 req-1cffe354-6bac-4370-b109-505656a3a5cc service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Refreshing network info cache for port ba6f8ece-930b-4fda-bfb7-3b96f8339bfa {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba6f8ece-93, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=177f13a2-f796-49a9-9fef-da116478b23c) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:13 user nova-compute[74311]: INFO os_vif [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:04:5d,bridge_name='br-int',has_traffic_filtering=True,id=ba6f8ece-930b-4fda-bfb7-3b96f8339bfa,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba6f8ece-93')
Oct 20 10:14:13 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Deleting instance files /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8_del
Oct 20 10:14:13 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Deletion of /opt/stack/data/nova/instances/560c41a4-79a3-461d-976d-f260bc9086f8_del complete
Oct 20 10:14:13 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Deleted allocations for instance 560c41a4-79a3-461d-976d-f260bc9086f8
Oct 20 10:14:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG nova.objects.instance [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lazy-loading 'numa_topology' on Instance uuid 560c41a4-79a3-461d-976d-f260bc9086f8 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:14:13 user nova-compute[74311]: DEBUG nova.objects.base [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Object Instance<560c41a4-79a3-461d-976d-f260bc9086f8> lazy-loaded attributes: resources,numa_topology {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:14:14 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:14:14 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:14:14 user nova-compute[74311]: DEBUG nova.network.neutron [req-681a0ebe-1731-4068-868f-6a0933c56380 req-1cffe354-6bac-4370-b109-505656a3a5cc service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Updated VIF entry in instance network info cache for port ba6f8ece-930b-4fda-bfb7-3b96f8339bfa. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:14:14 user nova-compute[74311]: DEBUG nova.network.neutron [req-681a0ebe-1731-4068-868f-6a0933c56380 req-1cffe354-6bac-4370-b109-505656a3a5cc service nova] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Updating instance_info_cache with network_info: [{"id": "ba6f8ece-930b-4fda-bfb7-3b96f8339bfa", "address": "fa:16:3e:f0:04:5d", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapba6f8ece-93", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:14:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-681a0ebe-1731-4068-868f-6a0933c56380 req-1cffe354-6bac-4370-b109-505656a3a5cc service nova] Releasing lock "refresh_cache-560c41a4-79a3-461d-976d-f260bc9086f8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:14:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-11718d2d-bad9-453f-b96a-36b0eff6b1d7 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "560c41a4-79a3-461d-976d-f260bc9086f8" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.598s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:15 user nova-compute[74311]: INFO nova.virt.block_device [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Booting with volume d6744400-dc37-4058-8a21-5f6511e68e16 at /dev/vdc
Oct 20 10:14:15 user nova-compute[74311]: DEBUG os_brick.utils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:14:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bc1d60-d5fa-4176-80d2-06095db694a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[18287a7c-124f-4f33-8bb7-6099d3d262ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00eb987-a8b0-4b02-ba5b-41651fb8460b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a67d88a-997b-40f5-aaab-e8acb77b606d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:14:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:14:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:14:16 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:14:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b84617d-4cb9-49f5-be22-ea010869fca7]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:14:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:14:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:14:16 user nova-compute[74311]: DEBUG os_brick.utils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:14:16 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updating existing volume attachment record: 452d1634-2afa-4e11-8646-a58f3bd9339a {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:14:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-1dea529f-bc03-45e6-a648-c14a075c30af req-234eed19-8653-45c1-9cb5-53a5a74b41f6 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Received event network-changed-c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-1dea529f-bc03-45e6-a648-c14a075c30af req-234eed19-8653-45c1-9cb5-53a5a74b41f6 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Refreshing instance network info cache due to event network-changed-c02afa9c-c54e-4894-a7ee-568784a07d55. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:14:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1dea529f-bc03-45e6-a648-c14a075c30af req-234eed19-8653-45c1-9cb5-53a5a74b41f6 service nova] Acquiring lock "refresh_cache-4dd0bb76-160a-4247-8bf7-5e28745fe4e5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:14:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1dea529f-bc03-45e6-a648-c14a075c30af req-234eed19-8653-45c1-9cb5-53a5a74b41f6 service nova] Acquired lock "refresh_cache-4dd0bb76-160a-4247-8bf7-5e28745fe4e5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:14:22 user nova-compute[74311]: DEBUG nova.network.neutron [req-1dea529f-bc03-45e6-a648-c14a075c30af req-234eed19-8653-45c1-9cb5-53a5a74b41f6 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Refreshing network info cache for port c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:14:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:22 user nova-compute[74311]: DEBUG nova.network.neutron [req-1dea529f-bc03-45e6-a648-c14a075c30af req-234eed19-8653-45c1-9cb5-53a5a74b41f6 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Updated VIF entry in instance network info cache for port c02afa9c-c54e-4894-a7ee-568784a07d55. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:14:22 user nova-compute[74311]: DEBUG nova.network.neutron [req-1dea529f-bc03-45e6-a648-c14a075c30af req-234eed19-8653-45c1-9cb5-53a5a74b41f6 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Updating instance_info_cache with network_info: [{"id": "c02afa9c-c54e-4894-a7ee-568784a07d55", "address": "fa:16:3e:4c:e0:96", "network": {"id": "e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-705302433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abe0204d114b75b7c2eff41b6fbb19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02afa9c-c5", "ovs_interfaceid": "c02afa9c-c54e-4894-a7ee-568784a07d55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:14:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1dea529f-bc03-45e6-a648-c14a075c30af req-234eed19-8653-45c1-9cb5-53a5a74b41f6 service nova] Releasing lock "refresh_cache-4dd0bb76-160a-4247-8bf7-5e28745fe4e5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:14:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-390736de-5211-4a8e-9e4e-5af23ebbf913 req-e3ba81d6-5b73-4bb0-946c-3c1c924dc5ad service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Received event network-changed-24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-390736de-5211-4a8e-9e4e-5af23ebbf913 req-e3ba81d6-5b73-4bb0-946c-3c1c924dc5ad service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Refreshing instance network info cache due to event network-changed-24cefeda-ceaf-460b-b902-a5895a6bb394. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:14:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-390736de-5211-4a8e-9e4e-5af23ebbf913 req-e3ba81d6-5b73-4bb0-946c-3c1c924dc5ad service nova] Acquiring lock "refresh_cache-ed823684-5b31-4b43-a601-bb5e303e0863" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:14:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-390736de-5211-4a8e-9e4e-5af23ebbf913 req-e3ba81d6-5b73-4bb0-946c-3c1c924dc5ad service nova] Acquired lock "refresh_cache-ed823684-5b31-4b43-a601-bb5e303e0863" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:14:23 user nova-compute[74311]: DEBUG nova.network.neutron [req-390736de-5211-4a8e-9e4e-5af23ebbf913 req-e3ba81d6-5b73-4bb0-946c-3c1c924dc5ad service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Refreshing network info cache for port 24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:14:23 user nova-compute[74311]: DEBUG nova.network.neutron [req-390736de-5211-4a8e-9e4e-5af23ebbf913 req-e3ba81d6-5b73-4bb0-946c-3c1c924dc5ad service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Updated VIF entry in instance network info cache for port 24cefeda-ceaf-460b-b902-a5895a6bb394. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:14:23 user nova-compute[74311]: DEBUG nova.network.neutron [req-390736de-5211-4a8e-9e4e-5af23ebbf913 req-e3ba81d6-5b73-4bb0-946c-3c1c924dc5ad service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Updating instance_info_cache with network_info: [{"id": "24cefeda-ceaf-460b-b902-a5895a6bb394", "address": "fa:16:3e:08:f0:9b", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cefeda-ce", "ovs_interfaceid": "24cefeda-ceaf-460b-b902-a5895a6bb394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:14:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-390736de-5211-4a8e-9e4e-5af23ebbf913 req-e3ba81d6-5b73-4bb0-946c-3c1c924dc5ad service nova] Releasing lock "refresh_cache-ed823684-5b31-4b43-a601-bb5e303e0863" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:14:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:27 user nova-compute[74311]: DEBUG nova.objects.instance [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lazy-loading 'flavor' on Instance uuid 4dd0bb76-160a-4247-8bf7-5e28745fe4e5 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:28 user nova-compute[74311]: INFO nova.compute.manager [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Attaching volume a667d8d8-304b-4625-b60c-7d3b28ef5818 to /dev/sdc
Oct 20 10:14:28 user nova-compute[74311]: DEBUG nova.compute.manager [req-bd5b3a18-cf99-4eb4-a977-219ea5dc6266 req-b5819854-33f1-45cb-95f5-88f61f435357 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received event network-changed-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG nova.compute.manager [req-bd5b3a18-cf99-4eb4-a977-219ea5dc6266 req-b5819854-33f1-45cb-95f5-88f61f435357 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Refreshing instance network info cache due to event network-changed-465bad7c-bd36-492a-bd18-a8fcbd8bfd42. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bd5b3a18-cf99-4eb4-a977-219ea5dc6266 req-b5819854-33f1-45cb-95f5-88f61f435357 service nova] Acquiring lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bd5b3a18-cf99-4eb4-a977-219ea5dc6266 req-b5819854-33f1-45cb-95f5-88f61f435357 service nova] Acquired lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG nova.network.neutron [req-bd5b3a18-cf99-4eb4-a977-219ea5dc6266 req-b5819854-33f1-45cb-95f5-88f61f435357 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Refreshing network info cache for port 465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG os_brick.utils [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b09fa2-94cf-4f21-b988-b6f5011bfb9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1550b360-f838-4ae8-bfbc-41b4099dcb09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b73575-5780-4700-80b7-b47469f55ad4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdada05-c47e-402c-b09d-8d5dc13b1bd9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "ed823684-5b31-4b43-a601-bb5e303e0863" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "ed823684-5b31-4b43-a601-bb5e303e0863" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:14:28 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[22102fb7-9a19-4a37-9b8a-1c23ec19bb18]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG os_brick.utils [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Updating existing volume attachment record: b4499227-c1ce-4347-a191-a68a4b509810 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lazy-loading 'flavor' on Instance uuid ed823684-5b31-4b43-a601-bb5e303e0863 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "ed823684-5b31-4b43-a601-bb5e303e0863" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "ed823684-5b31-4b43-a601-bb5e303e0863" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "ed823684-5b31-4b43-a601-bb5e303e0863" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:28 user nova-compute[74311]: INFO nova.compute.manager [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Attaching volume 0b0a4555-7fce-4841-8cb4-6210fff8e637 to /dev/vdb
Oct 20 10:14:28 user nova-compute[74311]: DEBUG nova.network.neutron [req-bd5b3a18-cf99-4eb4-a977-219ea5dc6266 req-b5819854-33f1-45cb-95f5-88f61f435357 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Updated VIF entry in instance network info cache for port 465bad7c-bd36-492a-bd18-a8fcbd8bfd42. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG nova.network.neutron [req-bd5b3a18-cf99-4eb4-a977-219ea5dc6266 req-b5819854-33f1-45cb-95f5-88f61f435357 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Updating instance_info_cache with network_info: [{"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bd5b3a18-cf99-4eb4-a977-219ea5dc6266 req-b5819854-33f1-45cb-95f5-88f61f435357 service nova] Releasing lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "interface-023498fa-b18b-4947-9b09-e9f6caafa931-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "interface-023498fa-b18b-4947-9b09-e9f6caafa931-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG nova.objects.instance [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lazy-loading 'flavor' on Instance uuid 023498fa-b18b-4947-9b09-e9f6caafa931 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG os_brick.utils [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ac1554-ddee-4058-aed0-c8448b12cbe2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.063s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a937e86b-7422-4283-a2f0-6ef6e531e341]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea77e9e2-825e-423b-a869-20e47042fe10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f74b932-aa28-4997-ac0b-c411088a8cae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:14:28 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:14:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19b31d2-3cff-4799-94fc-a5a7b0964034]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG os_brick.utils [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:14:28 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Updating existing volume attachment record: 776a9886-5a4c-4215-baa7-0bea918cc2b2 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:14:29 user nova-compute[74311]: DEBUG nova.objects.instance [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lazy-loading 'pci_requests' on Instance uuid 023498fa-b18b-4947-9b09-e9f6caafa931 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:14:29 user nova-compute[74311]: DEBUG nova.objects.base [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Object Instance<023498fa-b18b-4947-9b09-e9f6caafa931> lazy-loaded attributes: flavor,pci_requests {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:14:29 user nova-compute[74311]: DEBUG nova.network.neutron [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:14:29 user nova-compute[74311]: DEBUG nova.policy [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ba84b7bf6a7418a821a22bbd3b0569c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b3aaaa066740fa913e22537f799e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:14:29 user nova-compute[74311]: DEBUG nova.network.neutron [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Successfully created port: a5b4d272-5273-4469-9a19-733d5bada1cc {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG nova.network.neutron [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Successfully updated port: a5b4d272-5273-4469-9a19-733d5bada1cc {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquired lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG nova.network.neutron [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-a2990afe-6a10-4ff0-8d75-4acc1ba1c0fb req-5d500563-e615-4d2c-ae1e-7b3258350f66 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received event network-changed-a5b4d272-5273-4469-9a19-733d5bada1cc {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-a2990afe-6a10-4ff0-8d75-4acc1ba1c0fb req-5d500563-e615-4d2c-ae1e-7b3258350f66 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Refreshing instance network info cache due to event network-changed-a5b4d272-5273-4469-9a19-733d5bada1cc. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a2990afe-6a10-4ff0-8d75-4acc1ba1c0fb req-5d500563-e615-4d2c-ae1e-7b3258350f66 service nova] Acquiring lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG nova.network.neutron [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Updating instance_info_cache with network_info: [{"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5b4d272-5273-4469-9a19-733d5bada1cc", "address": "fa:16:3e:ad:26:65", "network": {"id": "6fafdbe4-876b-4db5-8d17-ed51c90dc01a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-825674472", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b4d272-52", "ovs_interfaceid": "a5b4d272-5273-4469-9a19-733d5bada1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Releasing lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a2990afe-6a10-4ff0-8d75-4acc1ba1c0fb req-5d500563-e615-4d2c-ae1e-7b3258350f66 service nova] Acquired lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG nova.network.neutron [req-a2990afe-6a10-4ff0-8d75-4acc1ba1c0fb req-5d500563-e615-4d2c-ae1e-7b3258350f66 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Refreshing network info cache for port a5b4d272-5273-4469-9a19-733d5bada1cc {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-683979222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-683979222',id=8,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAka0fGmXxuri5svjkz2HGnAAMwNmV/IgeCY0qqOdRgNIDrai8wjXmgODQlUjDOkNgT+vtqR0NIIR/7gHXjzK406sjo8EG1oh8DP0FT7lElr/8iMYNu2UdW9vM5ZOr2qnw==',key_name='tempest-keypair-2115206596',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='16b3aaaa066740fa913e22537f799e86',ramdisk_id='',reservation_id='r-4t98aki2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-340750198',owner_user_name='tempest-TaggedAttachmentsTest-340750198-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ba84b7bf6a7418a821a22bbd3b0569c',uuid=023498fa-b18b-4947-9b09-e9f6caafa931,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5b4d272-5273-4469-9a19-733d5bada1cc", "address": "fa:16:3e:ad:26:65", "network": {"id": "6fafdbe4-876b-4db5-8d17-ed51c90dc01a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-825674472", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b4d272-52", "ovs_interfaceid": "a5b4d272-5273-4469-9a19-733d5bada1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Converting VIF {"id": "a5b4d272-5273-4469-9a19-733d5bada1cc", "address": "fa:16:3e:ad:26:65", "network": {"id": "6fafdbe4-876b-4db5-8d17-ed51c90dc01a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-825674472", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b4d272-52", "ovs_interfaceid": "a5b4d272-5273-4469-9a19-733d5bada1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:26:65,bridge_name='br-int',has_traffic_filtering=True,id=a5b4d272-5273-4469-9a19-733d5bada1cc,network=Network(6fafdbe4-876b-4db5-8d17-ed51c90dc01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b4d272-52') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG os_vif [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:26:65,bridge_name='br-int',has_traffic_filtering=True,id=a5b4d272-5273-4469-9a19-733d5bada1cc,network=Network(6fafdbe4-876b-4db5-8d17-ed51c90dc01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b4d272-52') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32e03c1e-80a2-59b0-b940-84a62ad1593a', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5b4d272-52, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5b4d272-52, col_values=(('qos', UUID('debc3564-248a-4965-850f-cb013e1558f9')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5b4d272-52, col_values=(('external_ids', {'iface-id': 'a5b4d272-5273-4469-9a19-733d5bada1cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:26:65', 'vm-uuid': '023498fa-b18b-4947-9b09-e9f6caafa931'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:31 user nova-compute[74311]: INFO os_vif [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:26:65,bridge_name='br-int',has_traffic_filtering=True,id=a5b4d272-5273-4469-9a19-733d5bada1cc,network=Network(6fafdbe4-876b-4db5-8d17-ed51c90dc01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b4d272-52')
Oct 20 10:14:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-683979222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-683979222',id=8,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAka0fGmXxuri5svjkz2HGnAAMwNmV/IgeCY0qqOdRgNIDrai8wjXmgODQlUjDOkNgT+vtqR0NIIR/7gHXjzK406sjo8EG1oh8DP0FT7lElr/8iMYNu2UdW9vM5ZOr2qnw==',key_name='tempest-keypair-2115206596',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='16b3aaaa066740fa913e22537f799e86',ramdisk_id='',reservation_id='r-4t98aki2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-340750198',owner_user_name='tempest-TaggedAttachmentsTest-340750198-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ba84b7bf6a7418a821a22bbd3b0569c',uuid=023498fa-b18b-4947-9b09-e9f6caafa931,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5b4d272-5273-4469-9a19-733d5bada1cc", "address": "fa:16:3e:ad:26:65", "network": {"id": "6fafdbe4-876b-4db5-8d17-ed51c90dc01a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-825674472", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b4d272-52", "ovs_interfaceid": "a5b4d272-5273-4469-9a19-733d5bada1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Converting VIF {"id": "a5b4d272-5273-4469-9a19-733d5bada1cc", "address": "fa:16:3e:ad:26:65", "network": {"id": "6fafdbe4-876b-4db5-8d17-ed51c90dc01a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-825674472", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b4d272-52", "ovs_interfaceid": "a5b4d272-5273-4469-9a19-733d5bada1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:26:65,bridge_name='br-int',has_traffic_filtering=True,id=a5b4d272-5273-4469-9a19-733d5bada1cc,network=Network(6fafdbe4-876b-4db5-8d17-ed51c90dc01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b4d272-52') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] attach device xml: <interface type="ethernet">
Oct 20 10:14:31 user nova-compute[74311]:   <mac address="fa:16:3e:ad:26:65"/>
Oct 20 10:14:31 user nova-compute[74311]:   <model type="virtio"/>
Oct 20 10:14:31 user nova-compute[74311]:   <mtu size="1442"/>
Oct 20 10:14:31 user nova-compute[74311]:   <target dev="tapa5b4d272-52"/>
Oct 20 10:14:31 user nova-compute[74311]: </interface>
Oct 20 10:14:31 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG nova.network.neutron [req-a2990afe-6a10-4ff0-8d75-4acc1ba1c0fb req-5d500563-e615-4d2c-ae1e-7b3258350f66 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Updated VIF entry in instance network info cache for port a5b4d272-5273-4469-9a19-733d5bada1cc. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG nova.network.neutron [req-a2990afe-6a10-4ff0-8d75-4acc1ba1c0fb req-5d500563-e615-4d2c-ae1e-7b3258350f66 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Updating instance_info_cache with network_info: [{"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5b4d272-5273-4469-9a19-733d5bada1cc", "address": "fa:16:3e:ad:26:65", "network": {"id": "6fafdbe4-876b-4db5-8d17-ed51c90dc01a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-825674472", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b4d272-52", "ovs_interfaceid": "a5b4d272-5273-4469-9a19-733d5bada1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:14:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a2990afe-6a10-4ff0-8d75-4acc1ba1c0fb req-5d500563-e615-4d2c-ae1e-7b3258350f66 service nova] Releasing lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] No BDM found with device name hda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] No VIF found with MAC fa:16:3e:6e:29:a6, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:14:32 user nova-compute[74311]:   <nova:package version="0.0.0"/>
Oct 20 10:14:32 user nova-compute[74311]:   <nova:name>tempest-device-tagging-server-683979222</nova:name>
Oct 20 10:14:32 user nova-compute[74311]:   <nova:creationTime>2023-10-20 10:14:32</nova:creationTime>
Oct 20 10:14:32 user nova-compute[74311]:   <nova:flavor name="m1.tiny">
Oct 20 10:14:32 user nova-compute[74311]:     <nova:memory>512</nova:memory>
Oct 20 10:14:32 user nova-compute[74311]:     <nova:disk>1</nova:disk>
Oct 20 10:14:32 user nova-compute[74311]:     <nova:swap>0</nova:swap>
Oct 20 10:14:32 user nova-compute[74311]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:14:32 user nova-compute[74311]:     <nova:vcpus>1</nova:vcpus>
Oct 20 10:14:32 user nova-compute[74311]:   </nova:flavor>
Oct 20 10:14:32 user nova-compute[74311]:   <nova:owner>
Oct 20 10:14:32 user nova-compute[74311]:     <nova:user uuid="6ba84b7bf6a7418a821a22bbd3b0569c">tempest-TaggedAttachmentsTest-340750198-project-member</nova:user>
Oct 20 10:14:32 user nova-compute[74311]:     <nova:project uuid="16b3aaaa066740fa913e22537f799e86">tempest-TaggedAttachmentsTest-340750198</nova:project>
Oct 20 10:14:32 user nova-compute[74311]:   </nova:owner>
Oct 20 10:14:32 user nova-compute[74311]:   <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:14:32 user nova-compute[74311]:   <nova:ports>
Oct 20 10:14:32 user nova-compute[74311]:     <nova:port uuid="465bad7c-bd36-492a-bd18-a8fcbd8bfd42">
Oct 20 10:14:32 user nova-compute[74311]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 10:14:32 user nova-compute[74311]:     </nova:port>
Oct 20 10:14:32 user nova-compute[74311]:     <nova:port uuid="a5b4d272-5273-4469-9a19-733d5bada1cc">
Oct 20 10:14:32 user nova-compute[74311]:       <nova:ip type="fixed" address="10.10.10.208" ipVersion="4"/>
Oct 20 10:14:32 user nova-compute[74311]:     </nova:port>
Oct 20 10:14:32 user nova-compute[74311]:   </nova:ports>
Oct 20 10:14:32 user nova-compute[74311]: </nova:instance>
Oct 20 10:14:32 user nova-compute[74311]:  {{(pid=74311) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2d7d0cdb-5ec0-46d8-83c9-d15947552199 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "interface-023498fa-b18b-4947-9b09-e9f6caafa931-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.324s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-2e7a38b4-527b-4d40-98a0-2cb1ecf4d025 req-5a672f8c-752c-41d2-9df4-e077cd5d1ff7 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received event network-vif-plugged-a5b4d272-5273-4469-9a19-733d5bada1cc {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e7a38b4-527b-4d40-98a0-2cb1ecf4d025 req-5a672f8c-752c-41d2-9df4-e077cd5d1ff7 service nova] Acquiring lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e7a38b4-527b-4d40-98a0-2cb1ecf4d025 req-5a672f8c-752c-41d2-9df4-e077cd5d1ff7 service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e7a38b4-527b-4d40-98a0-2cb1ecf4d025 req-5a672f8c-752c-41d2-9df4-e077cd5d1ff7 service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-2e7a38b4-527b-4d40-98a0-2cb1ecf4d025 req-5a672f8c-752c-41d2-9df4-e077cd5d1ff7 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] No waiting events found dispatching network-vif-plugged-a5b4d272-5273-4469-9a19-733d5bada1cc {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:32 user nova-compute[74311]: WARNING nova.compute.manager [req-2e7a38b4-527b-4d40-98a0-2cb1ecf4d025 req-5a672f8c-752c-41d2-9df4-e077cd5d1ff7 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received unexpected event network-vif-plugged-a5b4d272-5273-4469-9a19-733d5bada1cc for instance with vm_state active and task_state None.
Oct 20 10:14:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-2e7a38b4-527b-4d40-98a0-2cb1ecf4d025 req-5a672f8c-752c-41d2-9df4-e077cd5d1ff7 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received event network-vif-plugged-a5b4d272-5273-4469-9a19-733d5bada1cc {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e7a38b4-527b-4d40-98a0-2cb1ecf4d025 req-5a672f8c-752c-41d2-9df4-e077cd5d1ff7 service nova] Acquiring lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e7a38b4-527b-4d40-98a0-2cb1ecf4d025 req-5a672f8c-752c-41d2-9df4-e077cd5d1ff7 service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e7a38b4-527b-4d40-98a0-2cb1ecf4d025 req-5a672f8c-752c-41d2-9df4-e077cd5d1ff7 service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-2e7a38b4-527b-4d40-98a0-2cb1ecf4d025 req-5a672f8c-752c-41d2-9df4-e077cd5d1ff7 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] No waiting events found dispatching network-vif-plugged-a5b4d272-5273-4469-9a19-733d5bada1cc {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:32 user nova-compute[74311]: WARNING nova.compute.manager [req-2e7a38b4-527b-4d40-98a0-2cb1ecf4d025 req-5a672f8c-752c-41d2-9df4-e077cd5d1ff7 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received unexpected event network-vif-plugged-a5b4d272-5273-4469-9a19-733d5bada1cc for instance with vm_state active and task_state None.
Oct 20 10:14:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "023498fa-b18b-4947-9b09-e9f6caafa931" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "023498fa-b18b-4947-9b09-e9f6caafa931" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.objects.instance [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lazy-loading 'flavor' on Instance uuid 023498fa-b18b-4947-9b09-e9f6caafa931 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "023498fa-b18b-4947-9b09-e9f6caafa931" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:14:33 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Creating image(s)
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Ensure instance console log exists: /opt/stack/data/nova/instances/d604a60d-cb10-46a9-8b53-adec39a93a84/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Start _get_guest_xml network_info=[{"id": "1945a62d-3b78-4092-92cf-3609131863fd", "address": "fa:16:3e:88:e7:48", "network": {"id": "37a1d6c5-3fc8-482c-bdf2-08694d929f66", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1387148929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1945a62d-3b", "ovs_interfaceid": "1945a62d-3b78-4092-92cf-3609131863fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "address": "fa:16:3e:a4:4c:e3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b06e65-3d", "ovs_interfaceid": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "address": "fa:16:3e:58:d3:49", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4b55ba-9c", "ovs_interfaceid": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9e19dda-eda1-4115-9028-3d814859462c", "address": "fa:16:3e:d8:03:d3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e19dda-ed", "ovs_interfaceid": "f9e19dda-eda1-4115-9028-3d814859462c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6213339-1858-41a4-b0ed-db8897a2dca7", "address": "fa:16:3e:1e:ef:d4", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6213339-18", "ovs_interfaceid": "d6213339-1858-41a4-b0ed-db8897a2dca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f7fdb4-ccdf-488d-9725-c15f461af479", "address": "fa:16:3e:f7:27:e0", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f7fdb4-cc", "ovs_interfaceid": "45f7fdb4-ccdf-488d-9725-c15f461af479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84d098d4-3ea0-41bf-8abc-c6d340094630", "address": "fa:16:3e:e2:ae:b4", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d098d4-3e", "ovs_interfaceid": "84d098d4-3ea0-41bf-8abc-c6d340094630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'cc2cad30-171a-49fd-9ed0-ed36daa519a5', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lthyROHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd604a60d-cb10-46a9-8b53-adec39a93a84', 'attached_at': '', 'detached_at': '', 'volume_id': '2003efea-b3e5-4085-9290-fecb0dc99d77', 'serial': '2003efea-b3e5-4085-9290-fecb0dc99d77'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '1d8872d4-752b-4b76-a79c-e6b77b5fbeca', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJzHlLca', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd604a60d-cb10-46a9-8b53-adec39a93a84', 'attached_at': '', 'detached_at': '', 'volume_id': 'b5eb5a5d-f10a-40d2-a8f0-955866b28055', 'serial': 'b5eb5a5d-f10a-40d2-a8f0-955866b28055'}, 'boot_index': 1, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': '452d1634-2afa-4e11-8646-a58f3bd9339a', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPxObQAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd604a60d-cb10-46a9-8b53-adec39a93a84', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6744400-dc37-4058-8a21-5f6511e68e16', 'serial': 'd6744400-dc37-4058-8a21-5f6511e68e16'}, 'boot_index': 2, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:14:33 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:14:33 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG os_brick.initiator.connector [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Factory for ISCSI on None {{(pid=74311) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lthyROHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:14:33 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:14:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:14:33 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:14:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:14:33 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:14:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d1bf4a-3ad6-4dc5-85e3-882ccc671a27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:14:33 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e27bed-9d7e-4c04-8fae-33bd850a6ab9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77] added
Oct 20 10:14:34 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "023498fa-b18b-4947-9b09-e9f6caafa931" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "023498fa-b18b-4947-9b09-e9f6caafa931" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:34 user nova-compute[74311]: INFO nova.compute.manager [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Attaching volume 0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 to /dev/vdb
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a7b7bf-3968-4323-a04c-cfb89275382e]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6521c00f-4d1b-43a6-9425-f3ab9d9d2695]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lthyROHI {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lthyROHI" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2915a7cf-46f8-4c13-b14c-8961473d669c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lthyROHI'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b146d699-bc62-4189-b777-5095c0dce3a5]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90a6d0e-12e0-42ab-bd0c-71b2249cc4b7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:14:34 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:14:34 user nova-compute[74311]:  {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:14:34 user nova-compute[74311]: WARNING os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 10:14:34 user nova-compute[74311]: 
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ae3728-a789-4c3f-bf53-d96f83234ad1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77, portal: 172.16.0.220,3260]
Oct 20 10:14:34 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77, portal: 172.16.0.220,3260] successful.
Oct 20 10:14:34 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.utils [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55a02cf-e085-48c9-bbbb-b6a733fe676e]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6006f24a-f853-457c-9f77-54dec066ff78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b13243-8d2c-4078-994b-55107b8d9641]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:34 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:34 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[06927477-30f4-451e-915a-c5a89b397b75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80f46a8-7d4b-4450-970d-ca44e47352df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d96d0e-70bf-44c6-ba67-85bf2ec2247e]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lthyROHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8025e77-9951-4e41-84bc-2824d1fd3796]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:14:34 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:14:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1142e1e2-052d-40e2-b46a-d4f19c2eff2f]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG os_brick.utils [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:14:34 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Updating existing volume attachment record: 103d1c8e-13f2-4105-8d90-0db45cff5948 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26666626261383963', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666626261383963', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJzHlLca', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:14:35 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:14:35 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:14:35 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[877241b3-495d-4292-91a7-e431259ba322]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:14:35 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[04218f59-6f35-449c-8d14-d6406eb2761a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055] added
Oct 20 10:14:35 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7ed3b7-0e5b-4751-b7c6-5efc3717b1af]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73aa6ae-3c6e-489f-8a8f-ddb39a7b60a5]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJzHlLca {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tJzHlLca" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa89abb-eb3e-4f17-befa-01d5035beb0c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tJzHlLca'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c6f3ce-a2ec-4508-9124-09444bf794f8]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e745d8c7-f854-454c-809d-101efa3276ef]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:35 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:35 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebe4287-d88a-4028-82f6-e0cc145da10c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055, portal: 172.16.0.220,3260]
Oct 20 10:14:35 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055, portal: 172.16.0.220,3260] successful.
Oct 20 10:14:35 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0aa0da-b738-4a6b-8de5-b7a8f58d0009]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62136d2-1a74-43e0-80eb-81f0ee0f5f53]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:35 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:35 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:35 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:35 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf00d12f-1a93-4d1f-a3e5-981f7fb48eb3]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:14:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJzHlLca', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26365303037323063', 'path': '/dev/sdc'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365303037323063', 'path': '/dev/sdc'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPxObQAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:14:36 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:14:36 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:14:36 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a8e43d-8cd0-445f-9212-4fba1dfaa52d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:14:36 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7998e7-bc63-4708-ae11-8e9b6a54eed5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16] added
Oct 20 10:14:36 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba958b94-9f4c-4029-8fd1-f6a5da390e15]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e689a5-4f2b-400c-b22d-9c157a4c93ca]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPxObQAR {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPxObQAR" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad33039-3a8b-409f-8b52-82efdeca80c8]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WPxObQAR'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d74482-994f-418a-a2cc-b544324d4d0a]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d58146c-4399-42bc-b86d-99acc51ffebf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:36 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:36 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:36 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:36 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f681d67-740a-4512-86a3-063dff97f78f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16, portal: 172.16.0.220,3260]
Oct 20 10:14:36 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16, portal: 172.16.0.220,3260] successful.
Oct 20 10:14:36 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c8a751-7f97-4284-b73a-828c811a8b14]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb8a3bb-9ac4-4139-8a71-4a35ed3b7a70]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:36 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:36 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:14:36 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:36 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:36 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:14:36 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:14:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[915a65b2-b86c-4dc1-9de4-da6b064ef93a]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:37 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:14:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPxObQAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23437303766666439', 'path': '/dev/sdd'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437303766666439', 'path': '/dev/sdd'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1945a62d-3b78-4092-92cf-3609131863fd", "address": "fa:16:3e:88:e7:48", "network": {"id": "37a1d6c5-3fc8-482c-bdf2-08694d929f66", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1387148929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1945a62d-3b", "ovs_interfaceid": "1945a62d-3b78-4092-92cf-3609131863fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "1945a62d-3b78-4092-92cf-3609131863fd", "address": "fa:16:3e:88:e7:48", "network": {"id": "37a1d6c5-3fc8-482c-bdf2-08694d929f66", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1387148929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1945a62d-3b", "ovs_interfaceid": "1945a62d-3b78-4092-92cf-3609131863fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:e7:48,bridge_name='br-int',has_traffic_filtering=True,id=1945a62d-3b78-4092-92cf-3609131863fd,network=Network(37a1d6c5-3fc8-482c-bdf2-08694d929f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1945a62d-3b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "address": "fa:16:3e:a4:4c:e3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b06e65-3d", "ovs_interfaceid": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "address": "fa:16:3e:a4:4c:e3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b06e65-3d", "ovs_interfaceid": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4c:e3,bridge_name='br-int',has_traffic_filtering=True,id=51b06e65-3d65-4b26-9f2c-9b1098f034f4,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51b06e65-3d') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "address": "fa:16:3e:58:d3:49", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4b55ba-9c", "ovs_interfaceid": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "address": "fa:16:3e:58:d3:49", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4b55ba-9c", "ovs_interfaceid": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:d3:49,bridge_name='br-int',has_traffic_filtering=True,id=2d4b55ba-9c6e-4784-a967-8b0ab34053a7,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d4b55ba-9c') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9e19dda-eda1-4115-9028-3d814859462c", "address": "fa:16:3e:d8:03:d3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e19dda-ed", "ovs_interfaceid": "f9e19dda-eda1-4115-9028-3d814859462c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "f9e19dda-eda1-4115-9028-3d814859462c", "address": "fa:16:3e:d8:03:d3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e19dda-ed", "ovs_interfaceid": "f9e19dda-eda1-4115-9028-3d814859462c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:03:d3,bridge_name='br-int',has_traffic_filtering=True,id=f9e19dda-eda1-4115-9028-3d814859462c,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e19dda-ed') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6213339-1858-41a4-b0ed-db8897a2dca7", "address": "fa:16:3e:1e:ef:d4", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6213339-18", "ovs_interfaceid": "d6213339-1858-41a4-b0ed-db8897a2dca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "d6213339-1858-41a4-b0ed-db8897a2dca7", "address": "fa:16:3e:1e:ef:d4", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6213339-18", "ovs_interfaceid": "d6213339-1858-41a4-b0ed-db8897a2dca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ef:d4,bridge_name='br-int',has_traffic_filtering=True,id=d6213339-1858-41a4-b0ed-db8897a2dca7,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6213339-18') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45f7fdb4-ccdf-488d-9725-c15f461af479", "address": "fa:16:3e:f7:27:e0", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f7fdb4-cc", "ovs_interfaceid": "45f7fdb4-ccdf-488d-9725-c15f461af479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "45f7fdb4-ccdf-488d-9725-c15f461af479", "address": "fa:16:3e:f7:27:e0", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f7fdb4-cc", "ovs_interfaceid": "45f7fdb4-ccdf-488d-9725-c15f461af479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:27:e0,bridge_name='br-int',has_traffic_filtering=True,id=45f7fdb4-ccdf-488d-9725-c15f461af479,network=Network(5198fb67-a161-45d6-8909-997c0683fd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45f7fdb4-cc') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84d098d4-3ea0-41bf-8abc-c6d340094630", "address": "fa:16:3e:e2:ae:b4", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d098d4-3e", "ovs_interfaceid": "84d098d4-3ea0-41bf-8abc-c6d340094630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "84d098d4-3ea0-41bf-8abc-c6d340094630", "address": "fa:16:3e:e2:ae:b4", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d098d4-3e", "ovs_interfaceid": "84d098d4-3ea0-41bf-8abc-c6d340094630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ae:b4,bridge_name='br-int',has_traffic_filtering=True,id=84d098d4-3ea0-41bf-8abc-c6d340094630,network=Network(5198fb67-a161-45d6-8909-997c0683fd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d098d4-3e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.objects.instance [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lazy-loading 'pci_devices' on Instance uuid d604a60d-cb10-46a9-8b53-adec39a93a84 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:14:38 user nova-compute[74311]:   <uuid>d604a60d-cb10-46a9-8b53-adec39a93a84</uuid>
Oct 20 10:14:38 user nova-compute[74311]:   <name>instance-0000000b</name>
Oct 20 10:14:38 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:14:38 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:14:38 user nova-compute[74311]:   <metadata>
Oct 20 10:14:38 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:14:38 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:14:38 user nova-compute[74311]:       <nova:name>tempest-device-tagging-server-220304069</nova:name>
Oct 20 10:14:38 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:14:33</nova:creationTime>
Oct 20 10:14:38 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:14:38 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:14:38 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:14:38 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:14:38 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:14:38 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:14:38 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:14:38 user nova-compute[74311]:       <nova:owner>
Oct 20 10:14:38 user nova-compute[74311]:         <nova:user uuid="e81b9fee1eb946ce98e8f8e9705ca429">tempest-TaggedBootDevicesTest-332152516-project-member</nova:user>
Oct 20 10:14:38 user nova-compute[74311]:         <nova:project uuid="3f86d5595c8844db8ccdd70600dde9bf">tempest-TaggedBootDevicesTest-332152516</nova:project>
Oct 20 10:14:38 user nova-compute[74311]:       </nova:owner>
Oct 20 10:14:38 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:14:38 user nova-compute[74311]:       <nova:ports>
Oct 20 10:14:38 user nova-compute[74311]:         <nova:port uuid="1945a62d-3b78-4092-92cf-3609131863fd">
Oct 20 10:14:38 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 10:14:38 user nova-compute[74311]:         </nova:port>
Oct 20 10:14:38 user nova-compute[74311]:         <nova:port uuid="51b06e65-3d65-4b26-9f2c-9b1098f034f4">
Oct 20 10:14:38 user nova-compute[74311]:           <nova:ip type="fixed" address="10.1.1.214" ipVersion="4"/>
Oct 20 10:14:38 user nova-compute[74311]:         </nova:port>
Oct 20 10:14:38 user nova-compute[74311]:         <nova:port uuid="2d4b55ba-9c6e-4784-a967-8b0ab34053a7">
Oct 20 10:14:38 user nova-compute[74311]:           <nova:ip type="fixed" address="10.1.1.19" ipVersion="4"/>
Oct 20 10:14:38 user nova-compute[74311]:         </nova:port>
Oct 20 10:14:38 user nova-compute[74311]:         <nova:port uuid="f9e19dda-eda1-4115-9028-3d814859462c">
Oct 20 10:14:38 user nova-compute[74311]:           <nova:ip type="fixed" address="10.1.1.38" ipVersion="4"/>
Oct 20 10:14:38 user nova-compute[74311]:         </nova:port>
Oct 20 10:14:38 user nova-compute[74311]:         <nova:port uuid="d6213339-1858-41a4-b0ed-db8897a2dca7">
Oct 20 10:14:38 user nova-compute[74311]:           <nova:ip type="fixed" address="10.1.1.254" ipVersion="4"/>
Oct 20 10:14:38 user nova-compute[74311]:         </nova:port>
Oct 20 10:14:38 user nova-compute[74311]:         <nova:port uuid="45f7fdb4-ccdf-488d-9725-c15f461af479">
Oct 20 10:14:38 user nova-compute[74311]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 10:14:38 user nova-compute[74311]:         </nova:port>
Oct 20 10:14:38 user nova-compute[74311]:         <nova:port uuid="84d098d4-3ea0-41bf-8abc-c6d340094630">
Oct 20 10:14:38 user nova-compute[74311]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 10:14:38 user nova-compute[74311]:         </nova:port>
Oct 20 10:14:38 user nova-compute[74311]:       </nova:ports>
Oct 20 10:14:38 user nova-compute[74311]:     </nova:instance>
Oct 20 10:14:38 user nova-compute[74311]:   </metadata>
Oct 20 10:14:38 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:14:38 user nova-compute[74311]:     <system>
Oct 20 10:14:38 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:14:38 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:14:38 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:14:38 user nova-compute[74311]:       <entry name="serial">d604a60d-cb10-46a9-8b53-adec39a93a84</entry>
Oct 20 10:14:38 user nova-compute[74311]:       <entry name="uuid">d604a60d-cb10-46a9-8b53-adec39a93a84</entry>
Oct 20 10:14:38 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:14:38 user nova-compute[74311]:     </system>
Oct 20 10:14:38 user nova-compute[74311]:   </sysinfo>
Oct 20 10:14:38 user nova-compute[74311]:   <os>
Oct 20 10:14:38 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:14:38 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:14:38 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:14:38 user nova-compute[74311]:   </os>
Oct 20 10:14:38 user nova-compute[74311]:   <features>
Oct 20 10:14:38 user nova-compute[74311]:     <acpi/>
Oct 20 10:14:38 user nova-compute[74311]:     <apic/>
Oct 20 10:14:38 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:14:38 user nova-compute[74311]:   </features>
Oct 20 10:14:38 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:14:38 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:14:38 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:14:38 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:14:38 user nova-compute[74311]:   </clock>
Oct 20 10:14:38 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:14:38 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:14:38 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:14:38 user nova-compute[74311]:   </cpu>
Oct 20 10:14:38 user nova-compute[74311]:   <devices>
Oct 20 10:14:38 user nova-compute[74311]:     <disk type="file" device="cdrom">
Oct 20 10:14:38 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 10:14:38 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/d604a60d-cb10-46a9-8b53-adec39a93a84/disk.config"/>
Oct 20 10:14:38 user nova-compute[74311]:       <target dev="hda" bus="ide"/>
Oct 20 10:14:38 user nova-compute[74311]:     </disk>
Oct 20 10:14:38 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:14:38 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:14:38 user nova-compute[74311]:       <source dev="/dev/sdb"/>
Oct 20 10:14:38 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:14:38 user nova-compute[74311]:       <serial>2003efea-b3e5-4085-9290-fecb0dc99d77</serial>
Oct 20 10:14:38 user nova-compute[74311]:     </disk>
Oct 20 10:14:38 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:14:38 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:14:38 user nova-compute[74311]:       <source dev="/dev/sdc"/>
Oct 20 10:14:38 user nova-compute[74311]:       <target dev="vdb" bus="virtio"/>
Oct 20 10:14:38 user nova-compute[74311]:       <serial>b5eb5a5d-f10a-40d2-a8f0-955866b28055</serial>
Oct 20 10:14:38 user nova-compute[74311]:     </disk>
Oct 20 10:14:38 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:14:38 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:14:38 user nova-compute[74311]:       <source dev="/dev/sdd"/>
Oct 20 10:14:38 user nova-compute[74311]:       <target dev="vdc" bus="virtio"/>
Oct 20 10:14:38 user nova-compute[74311]:       <serial>d6744400-dc37-4058-8a21-5f6511e68e16</serial>
Oct 20 10:14:38 user nova-compute[74311]:     </disk>
Oct 20 10:14:38 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:14:38 user nova-compute[74311]:       <mac address="fa:16:3e:88:e7:48"/>
Oct 20 10:14:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:14:38 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:14:38 user nova-compute[74311]:       <target dev="tap1945a62d-3b"/>
Oct 20 10:14:38 user nova-compute[74311]:     </interface>
Oct 20 10:14:38 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:14:38 user nova-compute[74311]:       <mac address="fa:16:3e:a4:4c:e3"/>
Oct 20 10:14:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:14:38 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:14:38 user nova-compute[74311]:       <target dev="tap51b06e65-3d"/>
Oct 20 10:14:38 user nova-compute[74311]:     </interface>
Oct 20 10:14:38 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:14:38 user nova-compute[74311]:       <mac address="fa:16:3e:58:d3:49"/>
Oct 20 10:14:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:14:38 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:14:38 user nova-compute[74311]:       <target dev="tap2d4b55ba-9c"/>
Oct 20 10:14:38 user nova-compute[74311]:     </interface>
Oct 20 10:14:38 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:14:38 user nova-compute[74311]:       <mac address="fa:16:3e:d8:03:d3"/>
Oct 20 10:14:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:14:38 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:14:38 user nova-compute[74311]:       <target dev="tapf9e19dda-ed"/>
Oct 20 10:14:38 user nova-compute[74311]:     </interface>
Oct 20 10:14:38 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:14:38 user nova-compute[74311]:       <mac address="fa:16:3e:1e:ef:d4"/>
Oct 20 10:14:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:14:38 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:14:38 user nova-compute[74311]:       <target dev="tapd6213339-18"/>
Oct 20 10:14:38 user nova-compute[74311]:     </interface>
Oct 20 10:14:38 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:14:38 user nova-compute[74311]:       <mac address="fa:16:3e:f7:27:e0"/>
Oct 20 10:14:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:14:38 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:14:38 user nova-compute[74311]:       <target dev="tap45f7fdb4-cc"/>
Oct 20 10:14:38 user nova-compute[74311]:     </interface>
Oct 20 10:14:38 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:14:38 user nova-compute[74311]:       <mac address="fa:16:3e:e2:ae:b4"/>
Oct 20 10:14:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:14:38 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:14:38 user nova-compute[74311]:       <target dev="tap84d098d4-3e"/>
Oct 20 10:14:38 user nova-compute[74311]:     </interface>
Oct 20 10:14:38 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:14:38 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/d604a60d-cb10-46a9-8b53-adec39a93a84/console.log" append="off"/>
Oct 20 10:14:38 user nova-compute[74311]:     </serial>
Oct 20 10:14:38 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:14:38 user nova-compute[74311]:     <video>
Oct 20 10:14:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:14:38 user nova-compute[74311]:     </video>
Oct 20 10:14:38 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:14:38 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:14:38 user nova-compute[74311]:     </rng>
Oct 20 10:14:38 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:14:38 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:14:38 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:14:38 user nova-compute[74311]:     </memballoon>
Oct 20 10:14:38 user nova-compute[74311]:   </devices>
Oct 20 10:14:38 user nova-compute[74311]: </domain>
Oct 20 10:14:38 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1945a62d-3b78-4092-92cf-3609131863fd", "address": "fa:16:3e:88:e7:48", "network": {"id": "37a1d6c5-3fc8-482c-bdf2-08694d929f66", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1387148929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1945a62d-3b", "ovs_interfaceid": "1945a62d-3b78-4092-92cf-3609131863fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "1945a62d-3b78-4092-92cf-3609131863fd", "address": "fa:16:3e:88:e7:48", "network": {"id": "37a1d6c5-3fc8-482c-bdf2-08694d929f66", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1387148929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1945a62d-3b", "ovs_interfaceid": "1945a62d-3b78-4092-92cf-3609131863fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:e7:48,bridge_name='br-int',has_traffic_filtering=True,id=1945a62d-3b78-4092-92cf-3609131863fd,network=Network(37a1d6c5-3fc8-482c-bdf2-08694d929f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1945a62d-3b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG os_vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:e7:48,bridge_name='br-int',has_traffic_filtering=True,id=1945a62d-3b78-4092-92cf-3609131863fd,network=Network(37a1d6c5-3fc8-482c-bdf2-08694d929f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1945a62d-3b') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2402dc91-46c5-5f77-9c75-7aa43835f5eb', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1945a62d-3b, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1945a62d-3b, col_values=(('qos', UUID('aa7b29bf-b939-4ce8-b9a3-5f7d59887e14')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1945a62d-3b, col_values=(('external_ids', {'iface-id': '1945a62d-3b78-4092-92cf-3609131863fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:e7:48', 'vm-uuid': 'd604a60d-cb10-46a9-8b53-adec39a93a84'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: INFO os_vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:e7:48,bridge_name='br-int',has_traffic_filtering=True,id=1945a62d-3b78-4092-92cf-3609131863fd,network=Network(37a1d6c5-3fc8-482c-bdf2-08694d929f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1945a62d-3b')
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "address": "fa:16:3e:a4:4c:e3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b06e65-3d", "ovs_interfaceid": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "address": "fa:16:3e:a4:4c:e3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b06e65-3d", "ovs_interfaceid": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4c:e3,bridge_name='br-int',has_traffic_filtering=True,id=51b06e65-3d65-4b26-9f2c-9b1098f034f4,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51b06e65-3d') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG os_vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4c:e3,bridge_name='br-int',has_traffic_filtering=True,id=51b06e65-3d65-4b26-9f2c-9b1098f034f4,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51b06e65-3d') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6205a90f-cab1-5f1f-8413-35f6be75deb1', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51b06e65-3d, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51b06e65-3d, col_values=(('qos', UUID('0c999491-f616-4474-9185-c8979cc9e6a1')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51b06e65-3d, col_values=(('external_ids', {'iface-id': '51b06e65-3d65-4b26-9f2c-9b1098f034f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:4c:e3', 'vm-uuid': 'd604a60d-cb10-46a9-8b53-adec39a93a84'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: INFO os_vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4c:e3,bridge_name='br-int',has_traffic_filtering=True,id=51b06e65-3d65-4b26-9f2c-9b1098f034f4,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51b06e65-3d')
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "address": "fa:16:3e:58:d3:49", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4b55ba-9c", "ovs_interfaceid": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "address": "fa:16:3e:58:d3:49", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4b55ba-9c", "ovs_interfaceid": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:d3:49,bridge_name='br-int',has_traffic_filtering=True,id=2d4b55ba-9c6e-4784-a967-8b0ab34053a7,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d4b55ba-9c') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG os_vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d3:49,bridge_name='br-int',has_traffic_filtering=True,id=2d4b55ba-9c6e-4784-a967-8b0ab34053a7,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d4b55ba-9c') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '448d675f-e0e4-5485-8596-9e81dfcc5b98', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d4b55ba-9c, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d4b55ba-9c, col_values=(('qos', UUID('2233a00e-ad02-4918-b71f-f10cacbc66e7')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d4b55ba-9c, col_values=(('external_ids', {'iface-id': '2d4b55ba-9c6e-4784-a967-8b0ab34053a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:d3:49', 'vm-uuid': 'd604a60d-cb10-46a9-8b53-adec39a93a84'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: INFO os_vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d3:49,bridge_name='br-int',has_traffic_filtering=True,id=2d4b55ba-9c6e-4784-a967-8b0ab34053a7,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d4b55ba-9c')
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9e19dda-eda1-4115-9028-3d814859462c", "address": "fa:16:3e:d8:03:d3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e19dda-ed", "ovs_interfaceid": "f9e19dda-eda1-4115-9028-3d814859462c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "f9e19dda-eda1-4115-9028-3d814859462c", "address": "fa:16:3e:d8:03:d3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e19dda-ed", "ovs_interfaceid": "f9e19dda-eda1-4115-9028-3d814859462c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:03:d3,bridge_name='br-int',has_traffic_filtering=True,id=f9e19dda-eda1-4115-9028-3d814859462c,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e19dda-ed') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG os_vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:03:d3,bridge_name='br-int',has_traffic_filtering=True,id=f9e19dda-eda1-4115-9028-3d814859462c,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e19dda-ed') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97da37cb-bac1-5a7c-af9a-dbf1e8330224', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9e19dda-ed, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9e19dda-ed, col_values=(('qos', UUID('d91d21fc-56c5-48ef-822d-66c12e36fce2')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9e19dda-ed, col_values=(('external_ids', {'iface-id': 'f9e19dda-eda1-4115-9028-3d814859462c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:03:d3', 'vm-uuid': 'd604a60d-cb10-46a9-8b53-adec39a93a84'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: INFO os_vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:03:d3,bridge_name='br-int',has_traffic_filtering=True,id=f9e19dda-eda1-4115-9028-3d814859462c,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e19dda-ed')
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6213339-1858-41a4-b0ed-db8897a2dca7", "address": "fa:16:3e:1e:ef:d4", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6213339-18", "ovs_interfaceid": "d6213339-1858-41a4-b0ed-db8897a2dca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "d6213339-1858-41a4-b0ed-db8897a2dca7", "address": "fa:16:3e:1e:ef:d4", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6213339-18", "ovs_interfaceid": "d6213339-1858-41a4-b0ed-db8897a2dca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ef:d4,bridge_name='br-int',has_traffic_filtering=True,id=d6213339-1858-41a4-b0ed-db8897a2dca7,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6213339-18') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG os_vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ef:d4,bridge_name='br-int',has_traffic_filtering=True,id=d6213339-1858-41a4-b0ed-db8897a2dca7,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6213339-18') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc119a21-87c7-5fb6-b270-ca58da3df52c', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6213339-18, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6213339-18, col_values=(('qos', UUID('4d75dbbd-d820-4528-8a60-6d9a573d9532')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6213339-18, col_values=(('external_ids', {'iface-id': 'd6213339-1858-41a4-b0ed-db8897a2dca7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:ef:d4', 'vm-uuid': 'd604a60d-cb10-46a9-8b53-adec39a93a84'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: INFO os_vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ef:d4,bridge_name='br-int',has_traffic_filtering=True,id=d6213339-1858-41a4-b0ed-db8897a2dca7,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6213339-18')
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45f7fdb4-ccdf-488d-9725-c15f461af479", "address": "fa:16:3e:f7:27:e0", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f7fdb4-cc", "ovs_interfaceid": "45f7fdb4-ccdf-488d-9725-c15f461af479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "45f7fdb4-ccdf-488d-9725-c15f461af479", "address": "fa:16:3e:f7:27:e0", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f7fdb4-cc", "ovs_interfaceid": "45f7fdb4-ccdf-488d-9725-c15f461af479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:27:e0,bridge_name='br-int',has_traffic_filtering=True,id=45f7fdb4-ccdf-488d-9725-c15f461af479,network=Network(5198fb67-a161-45d6-8909-997c0683fd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45f7fdb4-cc') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG os_vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:27:e0,bridge_name='br-int',has_traffic_filtering=True,id=45f7fdb4-ccdf-488d-9725-c15f461af479,network=Network(5198fb67-a161-45d6-8909-997c0683fd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45f7fdb4-cc') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3dae271-aec9-5a7c-83e6-b7dd28389e46', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45f7fdb4-cc, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45f7fdb4-cc, col_values=(('qos', UUID('276a32ab-2516-4de7-85ab-7a9dac110954')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45f7fdb4-cc, col_values=(('external_ids', {'iface-id': '45f7fdb4-ccdf-488d-9725-c15f461af479', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:27:e0', 'vm-uuid': 'd604a60d-cb10-46a9-8b53-adec39a93a84'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: INFO os_vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:27:e0,bridge_name='br-int',has_traffic_filtering=True,id=45f7fdb4-ccdf-488d-9725-c15f461af479,network=Network(5198fb67-a161-45d6-8909-997c0683fd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45f7fdb4-cc')
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:13:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84d098d4-3ea0-41bf-8abc-c6d340094630", "address": "fa:16:3e:e2:ae:b4", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d098d4-3e", "ovs_interfaceid": "84d098d4-3ea0-41bf-8abc-c6d340094630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "84d098d4-3ea0-41bf-8abc-c6d340094630", "address": "fa:16:3e:e2:ae:b4", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d098d4-3e", "ovs_interfaceid": "84d098d4-3ea0-41bf-8abc-c6d340094630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ae:b4,bridge_name='br-int',has_traffic_filtering=True,id=84d098d4-3ea0-41bf-8abc-c6d340094630,network=Network(5198fb67-a161-45d6-8909-997c0683fd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d098d4-3e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG os_vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ae:b4,bridge_name='br-int',has_traffic_filtering=True,id=84d098d4-3ea0-41bf-8abc-c6d340094630,network=Network(5198fb67-a161-45d6-8909-997c0683fd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d098d4-3e') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '606ad900-fde8-514f-a459-1c7654235270', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84d098d4-3e, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84d098d4-3e, col_values=(('qos', UUID('e2a063b8-e218-466a-a969-829c7c712470')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84d098d4-3e, col_values=(('external_ids', {'iface-id': '84d098d4-3ea0-41bf-8abc-c6d340094630', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:ae:b4', 'vm-uuid': 'd604a60d-cb10-46a9-8b53-adec39a93a84'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:38 user nova-compute[74311]: INFO os_vif [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ae:b4,bridge_name='br-int',has_traffic_filtering=True,id=84d098d4-3ea0-41bf-8abc-c6d340094630,network=Network(5198fb67-a161-45d6-8909-997c0683fd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d098d4-3e')
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] No BDM found with device name hda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] No VIF found with MAC fa:16:3e:88:e7:48, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:14:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] No VIF found with MAC fa:16:3e:1e:ef:d4, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:14:38 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Using config drive
Oct 20 10:14:39 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Creating config drive at /opt/stack/data/nova/instances/d604a60d-cb10-46a9-8b53-adec39a93a84/disk.config
Oct 20 10:14:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d604a60d-cb10-46a9-8b53-adec39a93a84/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvxmbe8pf {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d604a60d-cb10-46a9-8b53-adec39a93a84/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvxmbe8pf" returned: 0 in 0.070s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-1149afa9-1198-46b0-b5f6-275ac35e4f31 req-7f1fc186-c0e6-4f5a-90c5-f0ceea523f7d service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1149afa9-1198-46b0-b5f6-275ac35e4f31 req-7f1fc186-c0e6-4f5a-90c5-f0ceea523f7d service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1149afa9-1198-46b0-b5f6-275ac35e4f31 req-7f1fc186-c0e6-4f5a-90c5-f0ceea523f7d service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1149afa9-1198-46b0-b5f6-275ac35e4f31 req-7f1fc186-c0e6-4f5a-90c5-f0ceea523f7d service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-1149afa9-1198-46b0-b5f6-275ac35e4f31 req-7f1fc186-c0e6-4f5a-90c5-f0ceea523f7d service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:41 user nova-compute[74311]: WARNING nova.compute.manager [req-1149afa9-1198-46b0-b5f6-275ac35e4f31 req-7f1fc186-c0e6-4f5a-90c5-f0ceea523f7d service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-1945a62d-3b78-4092-92cf-3609131863fd for instance with vm_state building and task_state spawning.
Oct 20 10:14:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-6016771e-7202-43e3-bc49-fed1c2868293 req-c68dcade-c25e-46a4-a4f6-7ce47249a95a service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-51b06e65-3d65-4b26-9f2c-9b1098f034f4 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6016771e-7202-43e3-bc49-fed1c2868293 req-c68dcade-c25e-46a4-a4f6-7ce47249a95a service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6016771e-7202-43e3-bc49-fed1c2868293 req-c68dcade-c25e-46a4-a4f6-7ce47249a95a service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6016771e-7202-43e3-bc49-fed1c2868293 req-c68dcade-c25e-46a4-a4f6-7ce47249a95a service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-6016771e-7202-43e3-bc49-fed1c2868293 req-c68dcade-c25e-46a4-a4f6-7ce47249a95a service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-51b06e65-3d65-4b26-9f2c-9b1098f034f4 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:41 user nova-compute[74311]: WARNING nova.compute.manager [req-6016771e-7202-43e3-bc49-fed1c2868293 req-c68dcade-c25e-46a4-a4f6-7ce47249a95a service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-51b06e65-3d65-4b26-9f2c-9b1098f034f4 for instance with vm_state building and task_state spawning.
Oct 20 10:14:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:43 user nova-compute[74311]: WARNING nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-1945a62d-3b78-4092-92cf-3609131863fd for instance with vm_state building and task_state spawning.
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-2d4b55ba-9c6e-4784-a967-8b0ab34053a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-2d4b55ba-9c6e-4784-a967-8b0ab34053a7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:43 user nova-compute[74311]: WARNING nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-2d4b55ba-9c6e-4784-a967-8b0ab34053a7 for instance with vm_state building and task_state spawning.
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-2d4b55ba-9c6e-4784-a967-8b0ab34053a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-2d4b55ba-9c6e-4784-a967-8b0ab34053a7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:43 user nova-compute[74311]: WARNING nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-2d4b55ba-9c6e-4784-a967-8b0ab34053a7 for instance with vm_state building and task_state spawning.
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-f9e19dda-eda1-4115-9028-3d814859462c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-f9e19dda-eda1-4115-9028-3d814859462c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:43 user nova-compute[74311]: WARNING nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-f9e19dda-eda1-4115-9028-3d814859462c for instance with vm_state building and task_state spawning.
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-f9e19dda-eda1-4115-9028-3d814859462c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-f9e19dda-eda1-4115-9028-3d814859462c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:43 user nova-compute[74311]: WARNING nova.compute.manager [req-4ae89fad-82b6-46bb-8c94-067d32f14ca8 req-78a6eb29-43fb-48bd-8095-5891a15984d3 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-f9e19dda-eda1-4115-9028-3d814859462c for instance with vm_state building and task_state spawning.
Oct 20 10:14:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-51b06e65-3d65-4b26-9f2c-9b1098f034f4 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-51b06e65-3d65-4b26-9f2c-9b1098f034f4 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:43 user nova-compute[74311]: WARNING nova.compute.manager [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-51b06e65-3d65-4b26-9f2c-9b1098f034f4 for instance with vm_state building and task_state spawning.
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-d6213339-1858-41a4-b0ed-db8897a2dca7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-d6213339-1858-41a4-b0ed-db8897a2dca7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:43 user nova-compute[74311]: WARNING nova.compute.manager [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-d6213339-1858-41a4-b0ed-db8897a2dca7 for instance with vm_state building and task_state spawning.
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-d6213339-1858-41a4-b0ed-db8897a2dca7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-d6213339-1858-41a4-b0ed-db8897a2dca7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:43 user nova-compute[74311]: WARNING nova.compute.manager [req-f2e76be2-6ef7-4400-af43-d2949d73796b req-ca7dddda-f924-42f2-ada4-7f8a3df00ffc service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-d6213339-1858-41a4-b0ed-db8897a2dca7 for instance with vm_state building and task_state spawning.
Oct 20 10:14:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-45f7fdb4-ccdf-488d-9725-c15f461af479 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-45f7fdb4-ccdf-488d-9725-c15f461af479 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:45 user nova-compute[74311]: WARNING nova.compute.manager [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-45f7fdb4-ccdf-488d-9725-c15f461af479 for instance with vm_state building and task_state spawning.
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Received event network-changed-9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Refreshing instance network info cache due to event network-changed-9610009e-e341-4814-a3c3-523081eb0c8b. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Acquiring lock "refresh_cache-12bfda49-ce9d-4806-a982-08ce670faeb6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Acquired lock "refresh_cache-12bfda49-ce9d-4806-a982-08ce670faeb6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.network.neutron [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Refreshing network info cache for port 9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:14:45 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Instance spawned successfully.
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:14:45 user nova-compute[74311]: INFO nova.compute.manager [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Took 11.52 seconds to spawn the instance on the hypervisor.
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:14:45 user nova-compute[74311]: INFO nova.compute.manager [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Took 67.41 seconds to build instance.
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3ac2d7c-3e90-41ce-a683-06d3810745e5 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 67.507s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.network.neutron [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Updated VIF entry in instance network info cache for port 9610009e-e341-4814-a3c3-523081eb0c8b. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.network.neutron [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Updating instance_info_cache with network_info: [{"id": "9610009e-e341-4814-a3c3-523081eb0c8b", "address": "fa:16:3e:8b:94:00", "network": {"id": "b7d019f1-b3d9-472b-b369-db22786af195", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2011103604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb286be870f14bc89403febfdb4bff45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9610009e-e3", "ovs_interfaceid": "9610009e-e341-4814-a3c3-523081eb0c8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Releasing lock "refresh_cache-12bfda49-ce9d-4806-a982-08ce670faeb6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-45f7fdb4-ccdf-488d-9725-c15f461af479 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-45f7fdb4-ccdf-488d-9725-c15f461af479 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:45 user nova-compute[74311]: WARNING nova.compute.manager [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-45f7fdb4-ccdf-488d-9725-c15f461af479 for instance with vm_state building and task_state spawning.
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-84d098d4-3ea0-41bf-8abc-c6d340094630 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-84d098d4-3ea0-41bf-8abc-c6d340094630 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:45 user nova-compute[74311]: WARNING nova.compute.manager [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-84d098d4-3ea0-41bf-8abc-c6d340094630 for instance with vm_state building and task_state spawning.
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-84d098d4-3ea0-41bf-8abc-c6d340094630 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-84d098d4-3ea0-41bf-8abc-c6d340094630 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:14:45 user nova-compute[74311]: WARNING nova.compute.manager [req-7c942937-a22a-456f-890d-f2e54b77378d req-b4196ef1-94cc-470d-aae7-c4f0d8cb261b service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-84d098d4-3ea0-41bf-8abc-c6d340094630 for instance with vm_state building and task_state spawning.
Oct 20 10:14:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-d6d3f88f-8d91-4761-bb53-66e75433a3fa req-eb5a3375-d3ad-4706-82e7-719637eefeb6 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Received event network-changed-e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:14:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-d6d3f88f-8d91-4761-bb53-66e75433a3fa req-eb5a3375-d3ad-4706-82e7-719637eefeb6 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Refreshing instance network info cache due to event network-changed-e147adef-a22c-42a1-918d-12fcf3203eb7. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:14:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d6d3f88f-8d91-4761-bb53-66e75433a3fa req-eb5a3375-d3ad-4706-82e7-719637eefeb6 service nova] Acquiring lock "refresh_cache-d5d019ce-3f5d-422c-b278-2b3cb3fd594a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:14:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d6d3f88f-8d91-4761-bb53-66e75433a3fa req-eb5a3375-d3ad-4706-82e7-719637eefeb6 service nova] Acquired lock "refresh_cache-d5d019ce-3f5d-422c-b278-2b3cb3fd594a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:14:47 user nova-compute[74311]: DEBUG nova.network.neutron [req-d6d3f88f-8d91-4761-bb53-66e75433a3fa req-eb5a3375-d3ad-4706-82e7-719637eefeb6 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Refreshing network info cache for port e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:14:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:47 user nova-compute[74311]: DEBUG nova.network.neutron [req-d6d3f88f-8d91-4761-bb53-66e75433a3fa req-eb5a3375-d3ad-4706-82e7-719637eefeb6 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Updated VIF entry in instance network info cache for port e147adef-a22c-42a1-918d-12fcf3203eb7. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:14:47 user nova-compute[74311]: DEBUG nova.network.neutron [req-d6d3f88f-8d91-4761-bb53-66e75433a3fa req-eb5a3375-d3ad-4706-82e7-719637eefeb6 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Updating instance_info_cache with network_info: [{"id": "e147adef-a22c-42a1-918d-12fcf3203eb7", "address": "fa:16:3e:05:ab:49", "network": {"id": "f43a19cd-be0a-44a9-9e9d-4710422e489e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942278319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abab5999f8db4c76b520f5988643941f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape147adef-a2", "ovs_interfaceid": "e147adef-a22c-42a1-918d-12fcf3203eb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:14:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d6d3f88f-8d91-4761-bb53-66e75433a3fa req-eb5a3375-d3ad-4706-82e7-719637eefeb6 service nova] Releasing lock "refresh_cache-d5d019ce-3f5d-422c-b278-2b3cb3fd594a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HaEboKPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:14:48 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:14:48 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:14:48 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d4ad3d-f30c-4117-9b4d-3c416606488b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:14:48 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a6640b-f280-45e4-87f2-9bbfd4c1cc8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818] added
Oct 20 10:14:48 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[263d34a6-5648-464e-9f2d-ede0280c9d7f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a893a1e-92a8-4b9b-b7af-8c8d0ee9592f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HaEboKPr {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HaEboKPr" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[537e70cc-1e0b-4f25-9e3d-e4a0de73a6c3]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HaEboKPr'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a914f71b-82e2-4d42-b3e9-5f1dd71c2da9]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8108fe8a-8fb4-4021-8086-ff17acbd1716]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:48 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:48 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:14:48 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:48 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:48 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:14:48 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Acquiring lock "12bfda49-ce9d-4806-a982-08ce670faeb6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bb1b26-321b-438f-b573-8384c177da40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818, portal: 172.16.0.220,3260]
Oct 20 10:14:48 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818, portal: 172.16.0.220,3260] successful.
Oct 20 10:14:48 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG nova.objects.instance [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lazy-loading 'flavor' on Instance uuid 12bfda49-ce9d-4806-a982-08ce670faeb6 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1b2606-45e7-4ffb-a9e8-94a03eac1d51]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG nova.objects.instance [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lazy-loading 'flavor' on Instance uuid d5d019ce-3f5d-422c-b278-2b3cb3fd594a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4ebf4e-9e38-4f98-ba2c-bd9a52d48f43]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:48 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:48 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:14:48 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:14:48 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:48 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:48 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:14:48 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:14:48 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.113s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51c472c-e390-45d6-9a6d-488df03e4fdf]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HaEboKPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Acquiring lock "12bfda49-ce9d-4806-a982-08ce670faeb6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:48 user nova-compute[74311]: INFO nova.compute.manager [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Attaching volume 52c7449e-7346-4d50-ab15-1b674961af4a to /dev/vdb
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:48 user nova-compute[74311]: INFO nova.compute.manager [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Attaching volume a4c94db1-73ff-4a10-a63d-6fed1bf2f53c to /dev/vdb
Oct 20 10:14:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.utils [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkIQbyrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:14:48 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d79cadb-10f0-45e0-9cfa-0923d7a7fb94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fa28f7-e245-433e-a54b-4796c9f31d10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.utils [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a436ac-6139-4ac6-82dd-35a9b00136b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b3284b-5a24-47a1-b36b-6491f776faa9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fb64ff-f2e5-40fc-9834-78bb1db5d952]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:14:48 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6337315b-c0f1-43d8-b2ea-b941dcb33afb]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG os_brick.utils [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Updating existing volume attachment record: 87c4f089-49fb-4b9c-8f3a-af85aa7f61f3 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b44172-b7dd-4cab-90c2-813bf860b80b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ed6d66-9df6-4922-bc69-be7b598b80be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dbf500-8b31-419d-b00e-aba5153a920b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:14:49 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[35573bc4-714f-4cc3-b935-99edb6ab4838]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.utils [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Updating existing volume attachment record: 416c13b7-a338-4c4a-b34a-eb1f047b4458 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23130396561396238', 'path': '/dev/sde'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130396561396238', 'path': '/dev/sde'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.586s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:14:49 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:14:49 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lazy-loading 'flavor' on Instance uuid 4dd0bb76-160a-4247-8bf7-5e28745fe4e5 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d8119b-b700-4a21-9604-e005300eb4ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:14:49 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:14:49 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:14:49 user nova-compute[74311]:   <source dev="/dev/sde"/>
Oct 20 10:14:49 user nova-compute[74311]:   <target dev="sdc" bus="scsi"/>
Oct 20 10:14:49 user nova-compute[74311]:   <serial>a667d8d8-304b-4625-b60c-7d3b28ef5818</serial>
Oct 20 10:14:49 user nova-compute[74311]:   <address type="drive" controller="0" unit="2"/>
Oct 20 10:14:49 user nova-compute[74311]: </disk>
Oct 20 10:14:49 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3babb4f2-7c82-47f4-af70-3dd46ab9cf1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637] added
Oct 20 10:14:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b84c143-0598-4183-a88f-bf215ff7569d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a525a52a-182a-4d50-9210-7bd48e537899]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SkIQbyrh {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SkIQbyrh" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[18882dc6-18f8-47f9-8f3f-805700f42c17]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SkIQbyrh'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ad0ca3-1672-42e7-a566-b19278470635]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8b2bfd-f37b-49ed-b422-42016bdf5930]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9f16c7-443b-4259-92a4-5c265c99551d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637, portal: 172.16.0.220,3260]
Oct 20 10:14:49 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637, portal: 172.16.0.220,3260] successful.
Oct 20 10:14:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f661d53-6ac3-4b4e-ac0c-d1de7811db09]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b22dbf-35c3-4d45-b062-f13bb2b9a9b1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:14:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b651ae99-6307-4fe0-99e6-b19e289b6632]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:14:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkIQbyrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:14:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] No BDM found with device name sda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:14:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:14:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:14:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] No VIF found with MAC fa:16:3e:4c:e0:96, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:14:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:14:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] <== connect_volume: return (1984ms) {'type': 'block', 'scsi_wwn': '26663383834653763', 'path': '/dev/sdf'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:14:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663383834653763', 'path': '/dev/sdf'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:14:50 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lazy-loading 'flavor' on Instance uuid ed823684-5b31-4b43-a601-bb5e303e0863 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:14:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:14:50 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:14:50 user nova-compute[74311]:   <source dev="/dev/sdf"/>
Oct 20 10:14:50 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:14:50 user nova-compute[74311]:   <serial>0b0a4555-7fce-4841-8cb4-6210fff8e637</serial>
Oct 20 10:14:50 user nova-compute[74311]: </disk>
Oct 20 10:14:50 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:14:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:14:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:14:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] No VIF found with MAC fa:16:3e:08:f0:9b, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:14:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:53 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:14:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:14:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:14:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:14:53 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:14:53 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating instance_info_cache with network_info: [{"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:14:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:14:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:14:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncqtzBuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:14:54 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:14:54 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:14:54 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab205ac-a31c-47f5-bb20-4324e00be5fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:14:54 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaf4f74-f7c0-4da8-945b-ae4f2ab63bb2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8] added
Oct 20 10:14:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d8a11e-a5b1-4652-994e-662199b4b314]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[877ffdbe-7c8c-4ca2-a74b-12408a5317b1]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ncqtzBuv {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ncqtzBuv" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f3431e-94a4-4817-958c-bdde4e9ca55f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ncqtzBuv'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca808a8-e531-472b-b45a-d774e3b0edaa]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[06044414-285e-4fa2-90e4-b88e8a067669]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84ecc9b-0d86-4ae0-a3c4-a097e9ed4d29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8, portal: 172.16.0.220,3260]
Oct 20 10:14:54 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8, portal: 172.16.0.220,3260] successful.
Oct 20 10:14:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d86169a-c34c-4e9e-abe4-987df1944188]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-92eb66a2-4fbc-46ee-b4cc-e748b506db27 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.145s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[266fef96-e27d-484f-ab86-805aba55a341]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:14:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d72c813-5f55-42b5-bc06-2e868cfb3c9d]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncqtzBuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:14:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7c321f65-f8f6-4da9-9085-e6c528cc53d8 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "ed823684-5b31-4b43-a601-bb5e303e0863" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.175s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:14:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:14:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:14:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:14:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23061663535666630', 'path': '/dev/sdg'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:14:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061663535666630', 'path': '/dev/sdg'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:14:55 user nova-compute[74311]: DEBUG nova.objects.instance [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lazy-loading 'flavor' on Instance uuid 023498fa-b18b-4947-9b09-e9f6caafa931 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:14:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:14:55 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:14:55 user nova-compute[74311]:   <source dev="/dev/sdg"/>
Oct 20 10:14:55 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:14:55 user nova-compute[74311]:   <serial>0a2d3108-65d8-4f6d-9532-9ab41d20b9a8</serial>
Oct 20 10:14:55 user nova-compute[74311]: </disk>
Oct 20 10:14:55 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:14:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:55 user nova-compute[74311]: INFO nova.compute.manager [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Detaching volume a667d8d8-304b-4625-b60c-7d3b28ef5818
Oct 20 10:14:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:14:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] No BDM found with device name hda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:14:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] No VIF found with MAC fa:16:3e:6e:29:a6, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:14:55 user nova-compute[74311]: INFO nova.virt.block_device [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Attempting to driver detach volume a667d8d8-304b-4625-b60c-7d3b28ef5818 from mountpoint /dev/sdc
Oct 20 10:14:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Attempting to detach device sdc from instance 4dd0bb76-160a-4247-8bf7-5e28745fe4e5 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:14:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:14:56 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:14:56 user nova-compute[74311]:   <source dev="/dev/sde"/>
Oct 20 10:14:56 user nova-compute[74311]:   <target dev="sdc" bus="scsi"/>
Oct 20 10:14:56 user nova-compute[74311]:   <serial>a667d8d8-304b-4625-b60c-7d3b28ef5818</serial>
Oct 20 10:14:56 user nova-compute[74311]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 10:14:56 user nova-compute[74311]: </disk>
Oct 20 10:14:56 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:14:56 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Successfully detached device sdc from instance 4dd0bb76-160a-4247-8bf7-5e28745fe4e5 from the persistent domain config.
Oct 20 10:14:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 4dd0bb76-160a-4247-8bf7-5e28745fe4e5 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:14:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:14:56 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:14:56 user nova-compute[74311]:   <source dev="/dev/sde"/>
Oct 20 10:14:56 user nova-compute[74311]:   <target dev="sdc" bus="scsi"/>
Oct 20 10:14:56 user nova-compute[74311]:   <serial>a667d8d8-304b-4625-b60c-7d3b28ef5818</serial>
Oct 20 10:14:56 user nova-compute[74311]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 10:14:56 user nova-compute[74311]: </disk>
Oct 20 10:14:56 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:14:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c7b75b82-9841-4f89-844d-b1b9d7b5bb12 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "023498fa-b18b-4947-9b09-e9f6caafa931" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.103s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "ed823684-5b31-4b43-a601-bb5e303e0863" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "ed823684-5b31-4b43-a601-bb5e303e0863" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:56 user nova-compute[74311]: INFO nova.compute.manager [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Detaching volume 0b0a4555-7fce-4841-8cb4-6210fff8e637
Oct 20 10:14:56 user nova-compute[74311]: INFO nova.virt.block_device [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Attempting to driver detach volume 0b0a4555-7fce-4841-8cb4-6210fff8e637 from mountpoint /dev/vdb
Oct 20 10:14:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Attempting to detach device vdb from instance ed823684-5b31-4b43-a601-bb5e303e0863 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:14:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:14:56 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:14:56 user nova-compute[74311]:   <source dev="/dev/sdf"/>
Oct 20 10:14:56 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:14:56 user nova-compute[74311]:   <serial>0b0a4555-7fce-4841-8cb4-6210fff8e637</serial>
Oct 20 10:14:56 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:14:56 user nova-compute[74311]: </disk>
Oct 20 10:14:56 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:14:56 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Successfully detached device vdb from instance ed823684-5b31-4b43-a601-bb5e303e0863 from the persistent domain config.
Oct 20 10:14:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed823684-5b31-4b43-a601-bb5e303e0863 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:14:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:14:56 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:14:56 user nova-compute[74311]:   <source dev="/dev/sdf"/>
Oct 20 10:14:56 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:14:56 user nova-compute[74311]:   <serial>0b0a4555-7fce-4841-8cb4-6210fff8e637</serial>
Oct 20 10:14:56 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:14:56 user nova-compute[74311]: </disk>
Oct 20 10:14:56 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:14:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 4dd0bb76-160a-4247-8bf7-5e28745fe4e5 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:14:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed823684-5b31-4b43-a601-bb5e303e0863 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:14:57 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:14:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "023498fa-b18b-4947-9b09-e9f6caafa931" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "023498fa-b18b-4947-9b09-e9f6caafa931" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:57 user nova-compute[74311]: INFO nova.compute.manager [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Detaching volume 0a2d3108-65d8-4f6d-9532-9ab41d20b9a8
Oct 20 10:14:57 user nova-compute[74311]: INFO nova.virt.block_device [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Attempting to driver detach volume 0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 from mountpoint /dev/vdb
Oct 20 10:14:57 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Attempting to detach device vdb from instance 023498fa-b18b-4947-9b09-e9f6caafa931 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:14:57 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:14:57 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:14:57 user nova-compute[74311]:   <source dev="/dev/sdg"/>
Oct 20 10:14:57 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:14:57 user nova-compute[74311]:   <serial>0a2d3108-65d8-4f6d-9532-9ab41d20b9a8</serial>
Oct 20 10:14:57 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 10:14:57 user nova-compute[74311]: </disk>
Oct 20 10:14:57 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:14:57 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Successfully detached device vdb from instance 023498fa-b18b-4947-9b09-e9f6caafa931 from the persistent domain config.
Oct 20 10:14:57 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 023498fa-b18b-4947-9b09-e9f6caafa931 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:14:57 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:14:57 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:14:57 user nova-compute[74311]:   <source dev="/dev/sdg"/>
Oct 20 10:14:57 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:14:57 user nova-compute[74311]:   <serial>0a2d3108-65d8-4f6d-9532-9ab41d20b9a8</serial>
Oct 20 10:14:57 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 10:14:57 user nova-compute[74311]: </disk>
Oct 20 10:14:57 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:14:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:57 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 023498fa-b18b-4947-9b09-e9f6caafa931 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:14:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:14:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "cfc97865-6f94-4924-afc5-188d50543672" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:01 user nova-compute[74311]: DEBUG nova.compute.manager [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:15:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:15:02 user nova-compute[74311]: INFO nova.compute.claims [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Claim successful on node user
Oct 20 10:15:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.837s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:15:02 user nova-compute[74311]: DEBUG nova.network.neutron [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:15:02 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:15:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:15:03 user nova-compute[74311]: DEBUG nova.policy [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c6b76de1f054ca0973f2f9ba2eafaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090bd6a8a14d4a308e67be7a12e47ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:15:03 user nova-compute[74311]: INFO nova.virt.block_device [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Booting with blank volume at /dev/vda
Oct 20 10:15:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:03 user nova-compute[74311]: DEBUG nova.network.neutron [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Successfully created port: 2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:15:03 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:15:03 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:15:03 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=6951MB free_disk=25.41124725341797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:15:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 47a30844-242f-4a7f-ad9f-232a6e76b4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2fed360b-584a-4e1a-8e27-9189de7f5007 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 4dd0bb76-160a-4247-8bf7-5e28745fe4e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ed823684-5b31-4b43-a601-bb5e303e0863 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 023498fa-b18b-4947-9b09-e9f6caafa931 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 12bfda49-ce9d-4806-a982-08ce670faeb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance d5d019ce-3f5d-422c-b278-2b3cb3fd594a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance d604a60d-cb10-46a9-8b53-adec39a93a84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 7007d024-0a3b-425c-89f5-342728c2397b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.network.neutron [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Successfully updated port: 2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquired lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.network.neutron [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.manager [req-95905b20-df20-4d80-8403-f41b8b7e017c req-1778403d-4cd7-4e86-bafd-39a7fb5029df service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-changed-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.compute.manager [req-95905b20-df20-4d80-8403-f41b8b7e017c req-1778403d-4cd7-4e86-bafd-39a7fb5029df service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Refreshing instance network info cache due to event network-changed-2e1b0047-2f93-4f83-a6e7-514659a2faae. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-95905b20-df20-4d80-8403-f41b8b7e017c req-1778403d-4cd7-4e86-bafd-39a7fb5029df service nova] Acquiring lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:15:04 user nova-compute[74311]: DEBUG nova.network.neutron [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:15:05 user nova-compute[74311]: DEBUG nova.network.neutron [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Updating instance_info_cache with network_info: [{"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:15:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Releasing lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:15:05 user nova-compute[74311]: DEBUG nova.compute.manager [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Instance network_info: |[{"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:15:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-95905b20-df20-4d80-8403-f41b8b7e017c req-1778403d-4cd7-4e86-bafd-39a7fb5029df service nova] Acquired lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:15:05 user nova-compute[74311]: DEBUG nova.network.neutron [req-95905b20-df20-4d80-8403-f41b8b7e017c req-1778403d-4cd7-4e86-bafd-39a7fb5029df service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Refreshing network info cache for port 2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:15:05 user nova-compute[74311]: DEBUG nova.network.neutron [req-95905b20-df20-4d80-8403-f41b8b7e017c req-1778403d-4cd7-4e86-bafd-39a7fb5029df service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Updated VIF entry in instance network info cache for port 2e1b0047-2f93-4f83-a6e7-514659a2faae. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:15:05 user nova-compute[74311]: DEBUG nova.network.neutron [req-95905b20-df20-4d80-8403-f41b8b7e017c req-1778403d-4cd7-4e86-bafd-39a7fb5029df service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Updating instance_info_cache with network_info: [{"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:15:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-95905b20-df20-4d80-8403-f41b8b7e017c req-1778403d-4cd7-4e86-bafd-39a7fb5029df service nova] Releasing lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:15:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEyRKrnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:15:08 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:15:08 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:15:08 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa72b566-5f08-4ef9-9b4e-78b6ec88f433]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:15:08 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f947e7e-c47d-4f87-a06a-fba2465fb393]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a] added
Oct 20 10:15:08 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[920df99d-e70c-4703-ae5c-c5807210c3c6]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8e70a8-be9d-4253-8e60-bb893e39b1ea]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEyRKrnx {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UEyRKrnx" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06dd42a-4dbe-4060-9f94-96899198d4df]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UEyRKrnx'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[943f61ce-4bbc-446b-afdd-842b581aa8db]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b43b3b-2d4b-46b9-a1b1-497a67737460]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --login" returned: 0 in 0.143s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b7be8f-fabe-4200-8e1f-9010dc3c006f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a, portal: 172.16.0.220,3260]
Oct 20 10:15:08 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a, portal: 172.16.0.220,3260] successful.
Oct 20 10:15:08 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ef2327-ebda-4235-8f56-52a098171bfd]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[611353e8-1790-4252-b942-943f3004866a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)
Oct 20 10:15:08 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:15:08 user nova-compute[74311]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)
Oct 20 10:15:08 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec2539a-bf31-4bc1-9483-2324f5ee75d9]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEyRKrnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:15:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:09 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:15:09 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23631643464363239', 'path': '/dev/sdh'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:15:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631643464363239', 'path': '/dev/sdh'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:15:09 user nova-compute[74311]: DEBUG nova.objects.instance [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lazy-loading 'flavor' on Instance uuid 12bfda49-ce9d-4806-a982-08ce670faeb6 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] attach device xml: <disk type="block" device="disk">
Oct 20 10:15:09 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:15:09 user nova-compute[74311]:   <source dev="/dev/sdh"/>
Oct 20 10:15:09 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:15:09 user nova-compute[74311]:   <serial>52c7449e-7346-4d50-ab15-1b674961af4a</serial>
Oct 20 10:15:09 user nova-compute[74311]: </disk>
Oct 20 10:15:09 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:15:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:15:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:15:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] No VIF found with MAC fa:16:3e:8b:94:00, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:15:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef1076af-34b3-488e-a360-a94700200fbe tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.850s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4ba53078-52e8-43dd-8c2a-a277ed630863 tempest-VolumesAssistedSnapshotsTest-1822633949 tempest-VolumesAssistedSnapshotsTest-1822633949-project] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] volume_snapshot_create: create_info: {'snapshot_id': '0a00085f-340f-42ba-8fea-76857a47686f', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74311) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 20 10:15:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4ba53078-52e8-43dd-8c2a-a277ed630863 tempest-VolumesAssistedSnapshotsTest-1822633949 tempest-VolumesAssistedSnapshotsTest-1822633949-project] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] snap xml: <domainsnapshot>
Oct 20 10:15:11 user nova-compute[74311]:   <disks>
Oct 20 10:15:11 user nova-compute[74311]:     <disk name="/dev/sdh" snapshot="external" type="file">
Oct 20 10:15:11 user nova-compute[74311]:       <source file="/dev/new_file"/>
Oct 20 10:15:11 user nova-compute[74311]:     </disk>
Oct 20 10:15:11 user nova-compute[74311]:     <disk name="vda" snapshot="no"/>
Oct 20 10:15:11 user nova-compute[74311]:   </disks>
Oct 20 10:15:11 user nova-compute[74311]: </domainsnapshot>
Oct 20 10:15:11 user nova-compute[74311]:  {{(pid=74311) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 20 10:15:11 user nova-compute[74311]: DEBUG nova.objects.instance [None req-4ba53078-52e8-43dd-8c2a-a277ed630863 tempest-VolumesAssistedSnapshotsTest-1822633949 tempest-VolumesAssistedSnapshotsTest-1822633949-project] Lazy-loading 'system_metadata' on Instance uuid 12bfda49-ce9d-4806-a982-08ce670faeb6 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:11 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-4ba53078-52e8-43dd-8c2a-a277ed630863 tempest-VolumesAssistedSnapshotsTest-1822633949 tempest-VolumesAssistedSnapshotsTest-1822633949-project] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [None req-4ba53078-52e8-43dd-8c2a-a277ed630863 tempest-VolumesAssistedSnapshotsTest-1822633949 tempest-VolumesAssistedSnapshotsTest-1822633949-project] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Traceback (most recent call last):
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     rv = execute(f, *args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     six.reraise(c, e, tb)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     raise value
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     rv = meth(*args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] 
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [None req-4ba53078-52e8-43dd-8c2a-a277ed630863 tempest-VolumesAssistedSnapshotsTest-1822633949 tempest-VolumesAssistedSnapshotsTest-1822633949-project] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Traceback (most recent call last):
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     self._volume_snapshot_create(context, instance, guest,
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     rv = execute(f, *args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     six.reraise(c, e, tb)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     raise value
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     rv = meth(*args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] 
Oct 20 10:15:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-87dc6317-2a94-4665-9c41-a3e1c3b48b4a tempest-VolumesAssistedSnapshotsTest-1822633949 tempest-VolumesAssistedSnapshotsTest-1822633949-project] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] volume_snapshot_delete: delete_info: {'volume_id': '52c7449e-7346-4d50-ab15-1b674961af4a'} {{(pid=74311) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [None req-87dc6317-2a94-4665-9c41-a3e1c3b48b4a tempest-VolumesAssistedSnapshotsTest-1822633949 tempest-VolumesAssistedSnapshotsTest-1822633949-project] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Traceback (most recent call last):
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6]     if delete_info['type'] != 'qcow2':
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] KeyError: 'type'
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] 
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [None req-4ba53078-52e8-43dd-8c2a-a277ed630863 tempest-VolumesAssistedSnapshotsTest-1822633949 tempest-VolumesAssistedSnapshotsTest-1822633949-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 0a00085f-340f-42ba-8fea-76857a47686f could not be found.
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     raise value
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver 
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver 
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 0a00085f-340f-42ba-8fea-76857a47686f could not be found. (HTTP 404) (Request-ID: req-89fa19af-05f4-4394-bbdb-6272055e79d0)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver 
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver 
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 0a00085f-340f-42ba-8fea-76857a47686f could not be found.
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver 
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server [None req-4ba53078-52e8-43dd-8c2a-a277ed630863 tempest-VolumesAssistedSnapshotsTest-1822633949 tempest-VolumesAssistedSnapshotsTest-1822633949-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     raise value
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server 
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver [None req-87dc6317-2a94-4665-9c41-a3e1c3b48b4a tempest-VolumesAssistedSnapshotsTest-1822633949 tempest-VolumesAssistedSnapshotsTest-1822633949-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver 
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver 
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-29cfc3a2-93a1-4986-8de4-327914f4e4d6)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver 
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver 
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 10:15:11 user nova-compute[74311]: ERROR nova.virt.libvirt.driver 
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server [None req-87dc6317-2a94-4665-9c41-a3e1c3b48b4a tempest-VolumesAssistedSnapshotsTest-1822633949 tempest-VolumesAssistedSnapshotsTest-1822633949-project] Exception during message handling: KeyError: 'type'
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 20 10:15:11 user nova-compute[74311]: ERROR oslo_messaging.rpc.server 
Oct 20 10:15:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Acquiring lock "12bfda49-ce9d-4806-a982-08ce670faeb6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:12 user nova-compute[74311]: INFO nova.compute.manager [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Detaching volume 52c7449e-7346-4d50-ab15-1b674961af4a
Oct 20 10:15:12 user nova-compute[74311]: INFO nova.virt.block_device [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Attempting to driver detach volume 52c7449e-7346-4d50-ab15-1b674961af4a from mountpoint /dev/vdb
Oct 20 10:15:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Attempting to detach device vdb from instance 12bfda49-ce9d-4806-a982-08ce670faeb6 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:15:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 10:15:12 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:15:12 user nova-compute[74311]:   <source dev="/dev/sdh"/>
Oct 20 10:15:12 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:15:12 user nova-compute[74311]:   <serial>52c7449e-7346-4d50-ab15-1b674961af4a</serial>
Oct 20 10:15:12 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:15:12 user nova-compute[74311]: </disk>
Oct 20 10:15:12 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:15:12 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Successfully detached device vdb from instance 12bfda49-ce9d-4806-a982-08ce670faeb6 from the persistent domain config.
Oct 20 10:15:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 12bfda49-ce9d-4806-a982-08ce670faeb6 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:15:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 10:15:12 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:15:12 user nova-compute[74311]:   <source dev="/dev/sdh"/>
Oct 20 10:15:12 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:15:12 user nova-compute[74311]:   <serial>52c7449e-7346-4d50-ab15-1b674961af4a</serial>
Oct 20 10:15:12 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:15:12 user nova-compute[74311]: </disk>
Oct 20 10:15:12 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:15:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 12bfda49-ce9d-4806-a982-08ce670faeb6 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irFMbDQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:15:13 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:15:13 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:15:13 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[45388f2e-9be4-47e6-86ea-0682834561d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:15:13 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f246daf6-7ba2-455c-bf89-04444242b99b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c] added
Oct 20 10:15:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d816b8-6ed6-4b0e-a2ff-9a785fcd84f5]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb23064-6c6d-4c51-bf37-2b4dd9719e6e]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v irFMbDQW {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v irFMbDQW" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f348c4-97fb-4871-8f02-d59497f8a2e7]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'irFMbDQW'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ca4104-66d8-496c-9605-269a8cf2443b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eef0968-fc0c-48c1-8d41-61939bf35ff9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)
Oct 20 10:15:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)
Oct 20 10:15:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff7b417-a143-415a-8f85-79813e9b1fbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260]
Oct 20 10:15:13 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260] successful.
Oct 20 10:15:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b709a08-454d-439d-a0b7-984007823b65]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9159af4a-cb60-49f6-8457-385ee4b6b580]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)
Oct 20 10:15:13 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[914f6074-5541-4aa7-94c9-3dbbff70f4e9]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:15:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG os_brick.utils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4940f2a4-55bf-4e97-a55e-ad5785952686]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2442bb75-0755-46f8-a2d2-2802b811e5d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcc10eb-ec85-4735-b51f-93f6c0c027fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d7d2a7-ba59-4e7e-8be9-26b119b99df0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:15:14 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:15:14 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4571d938-7152-4658-9dbe-2e063306b611]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG os_brick.utils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Updating existing volume attachment record: afaa0011-45c9-48c7-a1c0-18dabf75b602 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irFMbDQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23961336637336664', 'path': '/dev/sdi'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961336637336664', 'path': '/dev/sdi'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG nova.objects.instance [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lazy-loading 'flavor' on Instance uuid d5d019ce-3f5d-422c-b278-2b3cb3fd594a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:15:14 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:15:14 user nova-compute[74311]:   <source dev="/dev/sdi"/>
Oct 20 10:15:14 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:15:14 user nova-compute[74311]:   <serial>a4c94db1-73ff-4a10-a63d-6fed1bf2f53c</serial>
Oct 20 10:15:14 user nova-compute[74311]: </disk>
Oct 20 10:15:14 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:15:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:15:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:15:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] No VIF found with MAC fa:16:3e:05:ab:49, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:15:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c8913767-032a-4ee9-a134-b3bf2919e142 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.524s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Acquiring lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.utils [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[250c4ed6-2a90-48a3-86e9-e7de7addb341]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1530b3f9-4f71-4520-910d-6dadabf4b84b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[274a1e24-fb7c-4e16-967a-757383122de6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f59d7fc-a4d5-4e73-b6d1-2ea1cec57364]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 4dd0bb76-160a-4247-8bf7-5e28745fe4e5 is timed out.
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:15:16 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Successfully detached device sdc from instance 4dd0bb76-160a-4247-8bf7-5e28745fe4e5 from the live domain config.
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HaEboKPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:15:16 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:15:16 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a6437c-5b07-4baa-8423-19d601ba8686]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.utils [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ed12bd-69be-4aab-a084-de3bb2d21037]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:15:16 user nova-compute[74311]: No targets found.
Oct 20 10:15:16 user nova-compute[74311]: iSNS:
Oct 20 10:15:16 user nova-compute[74311]: No targets found.
Oct 20 10:15:16 user nova-compute[74311]: STATIC:
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: FIRMWARE:
Oct 20 10:15:16 user nova-compute[74311]: No targets found.
Oct 20 10:15:16 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:15:16 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:15:16 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9411a7e3-6227-486b-8d9c-7e63490509c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6018a5bc-9f45-4af2-abf7-849065609580]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:16 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:16 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164f8c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818'): ({'sde'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Removing single pathed devices sde {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: INFO nova.compute.manager [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Swapping volume a4c94db1-73ff-4a10-a63d-6fed1bf2f53c for 13fca40a-d3b1-4d16-860b-9ddf99381bc8
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[116c503f-9753-480d-aab6-dbb9caa557cf]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[53af2180-27b2-4eb0-a4af-e7c39ded2706]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Flushing IO for device /dev/sde {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00b5f86-a764-4458-a1c1-a08f846fed80]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7ee7d7-2041-44b3-a377-65f142c90275]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] SCSI volumes sde have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cf60f8-b925-482a-8e16-1e8fc377a4d7]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72f7f60-27db-4111-8b33-94b58b66d639]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818, portal: 172.16.0.220,3260]
Oct 20 10:15:16 user nova-compute[74311]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818, portal: 172.16.0.220,3260] successful.
Oct 20 10:15:16 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ed823684-5b31-4b43-a601-bb5e303e0863 is timed out.
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a667d8d8-304b-4625-b60c-7d3b28ef5818 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf38ec2-5e66-4e9a-9168-ee80b04500a9]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] <== disconnect_volume: return (349ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:15:16 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Successfully detached device vdb from instance ed823684-5b31-4b43-a601-bb5e303e0863 from the live domain config.
Oct 20 10:15:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SkIQbyrh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:15:16 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4342c0-787e-4f38-8ae2-13cc053cf02e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:15:16 user nova-compute[74311]: No targets found.
Oct 20 10:15:16 user nova-compute[74311]: iSNS:
Oct 20 10:15:16 user nova-compute[74311]: No targets found.
Oct 20 10:15:16 user nova-compute[74311]: STATIC:
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c
Oct 20 10:15:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:16 user nova-compute[74311]: FIRMWARE:
Oct 20 10:15:16 user nova-compute[74311]: No targets found.
Oct 20 10:15:16 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:15:16 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:15:16 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[19286894-8d71-4ae8-b003-1faac2754398]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ec0222-e3c3-4202-a377-cfd367d45ff1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:16 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)
Oct 20 10:15:16 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:16 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164f8dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637'): ({'sdf'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Removing single pathed devices sdf {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4461c3-2f82-437a-9261-dffd1fd343cb]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad314e69-5864-4658-9679-3420c9551d65]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Flushing IO for device /dev/sdf {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:15:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a18120f-8fb6-4fb8-9921-07beb9b3f4ee]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.031s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab049d5-55bc-4f47-96ba-528b36226e09]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] SCSI volumes sdf have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2e9964-cbf5-44c1-838b-d6e085b774c4]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a191e6e9-0b50-451d-a9a8-95b094b5e78b]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637, portal: 172.16.0.220,3260]
Oct 20 10:15:17 user nova-compute[74311]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637, portal: 172.16.0.220,3260] successful.
Oct 20 10:15:17 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b0a4555-7fce-4841-8cb4-6210fff8e637 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc582c5e-c548-41bf-ba4e-aa18b4cb048b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] <== disconnect_volume: return (345ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:17 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 023498fa-b18b-4947-9b09-e9f6caafa931 is timed out.
Oct 20 10:15:17 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Successfully detached device vdb from instance 023498fa-b18b-4947-9b09-e9f6caafa931 from the live domain config.
Oct 20 10:15:17 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ncqtzBuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:15:17 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[880c6de4-21ba-4c46-bca8-36d6f60341c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:15:17 user nova-compute[74311]: No targets found.
Oct 20 10:15:17 user nova-compute[74311]: iSNS:
Oct 20 10:15:17 user nova-compute[74311]: No targets found.
Oct 20 10:15:17 user nova-compute[74311]: STATIC:
Oct 20 10:15:17 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77
Oct 20 10:15:17 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:17 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:17 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a
Oct 20 10:15:17 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:17 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:17 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16
Oct 20 10:15:17 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:17 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:17 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8
Oct 20 10:15:17 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:17 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:17 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055
Oct 20 10:15:17 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:17 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:17 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c
Oct 20 10:15:17 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:17 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:17 user nova-compute[74311]: FIRMWARE:
Oct 20 10:15:17 user nova-compute[74311]: No targets found.
Oct 20 10:15:17 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:15:17 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:15:17 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c70806-1a32-4f07-ab57-d10e5387e0ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c39052-0e70-4d06-a42b-907c2764531a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:17 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:17 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:17 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:15:17 user nova-compute[74311]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)
Oct 20 10:15:17 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:17 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:17 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:17 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:17 user nova-compute[74311]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 (non-flash)
Oct 20 10:15:17 user nova-compute[74311]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)
Oct 20 10:15:17 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:17 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164f8ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8'): ({'sdg'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Removing single pathed devices sdg {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[347ca7cd-18d4-434d-93be-6f1b9c9ce7e3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f355aa-78c8-4a7e-aa22-2fd3dd061807]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Flushing IO for device /dev/sdg {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ad0ef2-98bf-40ab-b7ad-2e4c574ed751]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG nova.objects.instance [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lazy-loading 'flavor' on Instance uuid 4dd0bb76-160a-4247-8bf7-5e28745fe4e5 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4870e0-4e43-4523-86ac-8584ee30654c]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] SCSI volumes sdg have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fab7fa-b32d-4ab5-9a01-b57693d19884]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-40950cfc-579b-4784-b593-2770e0cd8809 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.119s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a885868d-c6b0-48bd-a7f3-09cdb1a5a0ce]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8, portal: 172.16.0.220,3260]
Oct 20 10:15:17 user nova-compute[74311]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8, portal: 172.16.0.220,3260] successful.
Oct 20 10:15:17 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2d3108-65d8-4f6d-9532-9ab41d20b9a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[146ab2bd-880c-4f09-87f4-0e4da84822a2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:15:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] <== disconnect_volume: return (328ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:15:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:15:18 user nova-compute[74311]: DEBUG nova.objects.instance [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lazy-loading 'flavor' on Instance uuid ed823684-5b31-4b43-a601-bb5e303e0863 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c15bfbe8-a5fd-42a7-bef2-14204187eae4 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "ed823684-5b31-4b43-a601-bb5e303e0863" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.495s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:19 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lazy-loading 'flavor' on Instance uuid 023498fa-b18b-4947-9b09-e9f6caafa931 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e91b77d0-ad9b-4acf-a1a0-10e294dc9ea8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "023498fa-b18b-4947-9b09-e9f6caafa931" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.725s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "interface-023498fa-b18b-4947-9b09-e9f6caafa931-a5b4d272-5273-4469-9a19-733d5bada1cc" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "interface-023498fa-b18b-4947-9b09-e9f6caafa931-a5b4d272-5273-4469-9a19-733d5bada1cc" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.objects.instance [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lazy-loading 'flavor' on Instance uuid 023498fa-b18b-4947-9b09-e9f6caafa931 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-683979222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-683979222',id=8,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAka0fGmXxuri5svjkz2HGnAAMwNmV/IgeCY0qqOdRgNIDrai8wjXmgODQlUjDOkNgT+vtqR0NIIR/7gHXjzK406sjo8EG1oh8DP0FT7lElr/8iMYNu2UdW9vM5ZOr2qnw==',key_name='tempest-keypair-2115206596',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16b3aaaa066740fa913e22537f799e86',ramdisk_id='',reservation_id='r-4t98aki2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-340750198',owner_user_name='tempest-TaggedAttachmentsTest-340750198-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ba84b7bf6a7418a821a22bbd3b0569c',uuid=023498fa-b18b-4947-9b09-e9f6caafa931,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5b4d272-5273-4469-9a19-733d5bada1cc", "address": "fa:16:3e:ad:26:65", "network": {"id": "6fafdbe4-876b-4db5-8d17-ed51c90dc01a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-825674472", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b4d272-52", "ovs_interfaceid": "a5b4d272-5273-4469-9a19-733d5bada1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Converting VIF {"id": "a5b4d272-5273-4469-9a19-733d5bada1cc", "address": "fa:16:3e:ad:26:65", "network": {"id": "6fafdbe4-876b-4db5-8d17-ed51c90dc01a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-825674472", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b4d272-52", "ovs_interfaceid": "a5b4d272-5273-4469-9a19-733d5bada1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:26:65,bridge_name='br-int',has_traffic_filtering=True,id=a5b4d272-5273-4469-9a19-733d5bada1cc,network=Network(6fafdbe4-876b-4db5-8d17-ed51c90dc01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b4d272-52') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ad:26:65"/><model type="virtio"/><mtu size="1442"/><target dev="tapa5b4d272-52"/></interface> {{(pid=74311) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ad:26:65"/><model type="virtio"/><mtu size="1442"/><target dev="tapa5b4d272-52"/></interface> {{(pid=74311) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Attempting to detach device tapa5b4d272-52 from instance 023498fa-b18b-4947-9b09-e9f6caafa931 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] detach device xml: <interface type="ethernet">
Oct 20 10:15:20 user nova-compute[74311]:   <mac address="fa:16:3e:ad:26:65"/>
Oct 20 10:15:20 user nova-compute[74311]:   <model type="virtio"/>
Oct 20 10:15:20 user nova-compute[74311]:   <mtu size="1442"/>
Oct 20 10:15:20 user nova-compute[74311]:   <target dev="tapa5b4d272-52"/>
Oct 20 10:15:20 user nova-compute[74311]: </interface>
Oct 20 10:15:20 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ad:26:65"/><model type="virtio"/><mtu size="1442"/><target dev="tapa5b4d272-52"/></interface> {{(pid=74311) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ad:26:65"/><model type="virtio"/><mtu size="1442"/><target dev="tapa5b4d272-52"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 20 10:15:20 user nova-compute[74311]:   <name>instance-00000008</name>
Oct 20 10:15:20 user nova-compute[74311]:   <uuid>023498fa-b18b-4947-9b09-e9f6caafa931</uuid>
Oct 20 10:15:20 user nova-compute[74311]:   <metadata>
Oct 20 10:15:20 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:15:20 user nova-compute[74311]:   <nova:package version="0.0.0"/>
Oct 20 10:15:20 user nova-compute[74311]:   <nova:name>tempest-device-tagging-server-683979222</nova:name>
Oct 20 10:15:20 user nova-compute[74311]:   <nova:creationTime>2023-10-20 10:14:32</nova:creationTime>
Oct 20 10:15:20 user nova-compute[74311]:   <nova:flavor name="m1.tiny">
Oct 20 10:15:20 user nova-compute[74311]:     <nova:memory>512</nova:memory>
Oct 20 10:15:20 user nova-compute[74311]:     <nova:disk>1</nova:disk>
Oct 20 10:15:20 user nova-compute[74311]:     <nova:swap>0</nova:swap>
Oct 20 10:15:20 user nova-compute[74311]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:15:20 user nova-compute[74311]:     <nova:vcpus>1</nova:vcpus>
Oct 20 10:15:20 user nova-compute[74311]:   </nova:flavor>
Oct 20 10:15:20 user nova-compute[74311]:   <nova:owner>
Oct 20 10:15:20 user nova-compute[74311]:     <nova:user uuid="6ba84b7bf6a7418a821a22bbd3b0569c">tempest-TaggedAttachmentsTest-340750198-project-member</nova:user>
Oct 20 10:15:20 user nova-compute[74311]:     <nova:project uuid="16b3aaaa066740fa913e22537f799e86">tempest-TaggedAttachmentsTest-340750198</nova:project>
Oct 20 10:15:20 user nova-compute[74311]:   </nova:owner>
Oct 20 10:15:20 user nova-compute[74311]:   <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:15:20 user nova-compute[74311]:   <nova:ports>
Oct 20 10:15:20 user nova-compute[74311]:     <nova:port uuid="465bad7c-bd36-492a-bd18-a8fcbd8bfd42">
Oct 20 10:15:20 user nova-compute[74311]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 10:15:20 user nova-compute[74311]:     </nova:port>
Oct 20 10:15:20 user nova-compute[74311]:     <nova:port uuid="a5b4d272-5273-4469-9a19-733d5bada1cc">
Oct 20 10:15:20 user nova-compute[74311]:       <nova:ip type="fixed" address="10.10.10.208" ipVersion="4"/>
Oct 20 10:15:20 user nova-compute[74311]:     </nova:port>
Oct 20 10:15:20 user nova-compute[74311]:   </nova:ports>
Oct 20 10:15:20 user nova-compute[74311]: </nova:instance>
Oct 20 10:15:20 user nova-compute[74311]:   </metadata>
Oct 20 10:15:20 user nova-compute[74311]:   <memory unit='KiB'>524288</memory>
Oct 20 10:15:20 user nova-compute[74311]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 10:15:20 user nova-compute[74311]:   <vcpu placement='static'>1</vcpu>
Oct 20 10:15:20 user nova-compute[74311]:   <resource>
Oct 20 10:15:20 user nova-compute[74311]:     <partition>/machine</partition>
Oct 20 10:15:20 user nova-compute[74311]:   </resource>
Oct 20 10:15:20 user nova-compute[74311]:   <sysinfo type='smbios'>
Oct 20 10:15:20 user nova-compute[74311]:     <system>
Oct 20 10:15:20 user nova-compute[74311]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 10:15:20 user nova-compute[74311]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 10:15:20 user nova-compute[74311]:       <entry name='version'>0.0.0</entry>
Oct 20 10:15:20 user nova-compute[74311]:       <entry name='serial'>023498fa-b18b-4947-9b09-e9f6caafa931</entry>
Oct 20 10:15:20 user nova-compute[74311]:       <entry name='uuid'>023498fa-b18b-4947-9b09-e9f6caafa931</entry>
Oct 20 10:15:20 user nova-compute[74311]:       <entry name='family'>Virtual Machine</entry>
Oct 20 10:15:20 user nova-compute[74311]:     </system>
Oct 20 10:15:20 user nova-compute[74311]:   </sysinfo>
Oct 20 10:15:20 user nova-compute[74311]:   <os>
Oct 20 10:15:20 user nova-compute[74311]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 10:15:20 user nova-compute[74311]:     <boot dev='hd'/>
Oct 20 10:15:20 user nova-compute[74311]:     <smbios mode='sysinfo'/>
Oct 20 10:15:20 user nova-compute[74311]:   </os>
Oct 20 10:15:20 user nova-compute[74311]:   <features>
Oct 20 10:15:20 user nova-compute[74311]:     <acpi/>
Oct 20 10:15:20 user nova-compute[74311]:     <apic/>
Oct 20 10:15:20 user nova-compute[74311]:     <vmcoreinfo state='on'/>
Oct 20 10:15:20 user nova-compute[74311]:   </features>
Oct 20 10:15:20 user nova-compute[74311]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 10:15:20 user nova-compute[74311]:     <model fallback='forbid'>Nehalem</model>
Oct 20 10:15:20 user nova-compute[74311]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 10:15:20 user nova-compute[74311]:     <feature policy='require' name='vme'/>
Oct 20 10:15:20 user nova-compute[74311]:     <feature policy='require' name='x2apic'/>
Oct 20 10:15:20 user nova-compute[74311]:     <feature policy='require' name='hypervisor'/>
Oct 20 10:15:20 user nova-compute[74311]:   </cpu>
Oct 20 10:15:20 user nova-compute[74311]:   <clock offset='utc'>
Oct 20 10:15:20 user nova-compute[74311]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 10:15:20 user nova-compute[74311]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 10:15:20 user nova-compute[74311]:     <timer name='hpet' present='no'/>
Oct 20 10:15:20 user nova-compute[74311]:   </clock>
Oct 20 10:15:20 user nova-compute[74311]:   <on_poweroff>destroy</on_poweroff>
Oct 20 10:15:20 user nova-compute[74311]:   <on_reboot>restart</on_reboot>
Oct 20 10:15:20 user nova-compute[74311]:   <on_crash>destroy</on_crash>
Oct 20 10:15:20 user nova-compute[74311]:   <devices>
Oct 20 10:15:20 user nova-compute[74311]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 10:15:20 user nova-compute[74311]:     <disk type='file' device='disk'>
Oct 20 10:15:20 user nova-compute[74311]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 10:15:20 user nova-compute[74311]:       <source file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk' index='2'/>
Oct 20 10:15:20 user nova-compute[74311]:       <backingStore type='file' index='3'>
Oct 20 10:15:20 user nova-compute[74311]:         <format type='raw'/>
Oct 20 10:15:20 user nova-compute[74311]:         <source file='/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223'/>
Oct 20 10:15:20 user nova-compute[74311]:         <backingStore/>
Oct 20 10:15:20 user nova-compute[74311]:       </backingStore>
Oct 20 10:15:20 user nova-compute[74311]:       <target dev='vda' bus='virtio'/>
Oct 20 10:15:20 user nova-compute[74311]:       <alias name='virtio-disk0'/>
Oct 20 10:15:20 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 10:15:20 user nova-compute[74311]:     </disk>
Oct 20 10:15:20 user nova-compute[74311]:     <disk type='file' device='cdrom'>
Oct 20 10:15:20 user nova-compute[74311]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 10:15:20 user nova-compute[74311]:       <source file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk.config' index='1'/>
Oct 20 10:15:20 user nova-compute[74311]:       <backingStore/>
Oct 20 10:15:20 user nova-compute[74311]:       <target dev='hda' bus='ide'/>
Oct 20 10:15:20 user nova-compute[74311]:       <readonly/>
Oct 20 10:15:20 user nova-compute[74311]:       <alias name='ide0-0-0'/>
Oct 20 10:15:20 user nova-compute[74311]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 10:15:20 user nova-compute[74311]:     </disk>
Oct 20 10:15:20 user nova-compute[74311]:     <controller type='usb' index='0' model='none'>
Oct 20 10:15:20 user nova-compute[74311]:       <alias name='usb'/>
Oct 20 10:15:20 user nova-compute[74311]:     </controller>
Oct 20 10:15:20 user nova-compute[74311]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 10:15:20 user nova-compute[74311]:       <alias name='pci.0'/>
Oct 20 10:15:20 user nova-compute[74311]:     </controller>
Oct 20 10:15:20 user nova-compute[74311]:     <controller type='ide' index='0'>
Oct 20 10:15:20 user nova-compute[74311]:       <alias name='ide'/>
Oct 20 10:15:20 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 10:15:20 user nova-compute[74311]:     </controller>
Oct 20 10:15:20 user nova-compute[74311]:     <interface type='ethernet'>
Oct 20 10:15:20 user nova-compute[74311]:       <mac address='fa:16:3e:6e:29:a6'/>
Oct 20 10:15:20 user nova-compute[74311]:       <target dev='tap465bad7c-bd'/>
Oct 20 10:15:20 user nova-compute[74311]:       <model type='virtio'/>
Oct 20 10:15:20 user nova-compute[74311]:       <mtu size='1442'/>
Oct 20 10:15:20 user nova-compute[74311]:       <alias name='net0'/>
Oct 20 10:15:20 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 10:15:20 user nova-compute[74311]:     </interface>
Oct 20 10:15:20 user nova-compute[74311]:     <interface type='ethernet'>
Oct 20 10:15:20 user nova-compute[74311]:       <mac address='fa:16:3e:ad:26:65'/>
Oct 20 10:15:20 user nova-compute[74311]:       <target dev='tapa5b4d272-52'/>
Oct 20 10:15:20 user nova-compute[74311]:       <model type='virtio'/>
Oct 20 10:15:20 user nova-compute[74311]:       <mtu size='1442'/>
Oct 20 10:15:20 user nova-compute[74311]:       <alias name='net1'/>
Oct 20 10:15:20 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 20 10:15:20 user nova-compute[74311]:     </interface>
Oct 20 10:15:20 user nova-compute[74311]:     <serial type='pty'>
Oct 20 10:15:20 user nova-compute[74311]:       <source path='/dev/pts/7'/>
Oct 20 10:15:20 user nova-compute[74311]:       <log file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/console.log' append='off'/>
Oct 20 10:15:20 user nova-compute[74311]:       <target type='isa-serial' port='0'>
Oct 20 10:15:20 user nova-compute[74311]:         <model name='isa-serial'/>
Oct 20 10:15:20 user nova-compute[74311]:       </target>
Oct 20 10:15:20 user nova-compute[74311]:       <alias name='serial0'/>
Oct 20 10:15:20 user nova-compute[74311]:     </serial>
Oct 20 10:15:20 user nova-compute[74311]:     <console type='pty' tty='/dev/pts/7'>
Oct 20 10:15:20 user nova-compute[74311]:       <source path='/dev/pts/7'/>
Oct 20 10:15:20 user nova-compute[74311]:       <log file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/console.log' append='off'/>
Oct 20 10:15:20 user nova-compute[74311]:       <target type='serial' port='0'/>
Oct 20 10:15:20 user nova-compute[74311]:       <alias name='serial0'/>
Oct 20 10:15:20 user nova-compute[74311]:     </console>
Oct 20 10:15:20 user nova-compute[74311]:     <input type='mouse' bus='ps2'>
Oct 20 10:15:20 user nova-compute[74311]:       <alias name='input0'/>
Oct 20 10:15:20 user nova-compute[74311]:     </input>
Oct 20 10:15:20 user nova-compute[74311]:     <input type='keyboard' bus='ps2'>
Oct 20 10:15:20 user nova-compute[74311]:       <alias name='input1'/>
Oct 20 10:15:20 user nova-compute[74311]:     </input>
Oct 20 10:15:20 user nova-compute[74311]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 20 10:15:20 user nova-compute[74311]:       <listen type='address' address='0.0.0.0'/>
Oct 20 10:15:20 user nova-compute[74311]:     </graphics>
Oct 20 10:15:20 user nova-compute[74311]:     <audio id='1' type='none'/>
Oct 20 10:15:20 user nova-compute[74311]:     <video>
Oct 20 10:15:20 user nova-compute[74311]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 10:15:20 user nova-compute[74311]:       <alias name='video0'/>
Oct 20 10:15:20 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 10:15:20 user nova-compute[74311]:     </video>
Oct 20 10:15:20 user nova-compute[74311]:     <memballoon model='virtio'>
Oct 20 10:15:20 user nova-compute[74311]:       <stats period='10'/>
Oct 20 10:15:20 user nova-compute[74311]:       <alias name='balloon0'/>
Oct 20 10:15:20 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 10:15:20 user nova-compute[74311]:     </memballoon>
Oct 20 10:15:20 user nova-compute[74311]:     <rng model='virtio'>
Oct 20 10:15:20 user nova-compute[74311]:       <backend model='random'>/dev/urandom</backend>
Oct 20 10:15:20 user nova-compute[74311]:       <alias name='rng0'/>
Oct 20 10:15:20 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 10:15:20 user nova-compute[74311]:     </rng>
Oct 20 10:15:20 user nova-compute[74311]:   </devices>
Oct 20 10:15:20 user nova-compute[74311]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 10:15:20 user nova-compute[74311]:     <label>libvirt-023498fa-b18b-4947-9b09-e9f6caafa931</label>
Oct 20 10:15:20 user nova-compute[74311]:     <imagelabel>libvirt-023498fa-b18b-4947-9b09-e9f6caafa931</imagelabel>
Oct 20 10:15:20 user nova-compute[74311]:   </seclabel>
Oct 20 10:15:20 user nova-compute[74311]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 10:15:20 user nova-compute[74311]:     <label>+64055:+108</label>
Oct 20 10:15:20 user nova-compute[74311]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 10:15:20 user nova-compute[74311]:   </seclabel>
Oct 20 10:15:20 user nova-compute[74311]: </domain>
Oct 20 10:15:20 user nova-compute[74311]:  {{(pid=74311) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 10:15:20 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Successfully detached device tapa5b4d272-52 from instance 023498fa-b18b-4947-9b09-e9f6caafa931 from the persistent domain config.
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] (1/8): Attempting to detach device tapa5b4d272-52 with device alias net1 from instance 023498fa-b18b-4947-9b09-e9f6caafa931 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] detach device xml: <interface type="ethernet">
Oct 20 10:15:20 user nova-compute[74311]:   <mac address="fa:16:3e:ad:26:65"/>
Oct 20 10:15:20 user nova-compute[74311]:   <model type="virtio"/>
Oct 20 10:15:20 user nova-compute[74311]:   <mtu size="1442"/>
Oct 20 10:15:20 user nova-compute[74311]:   <target dev="tapa5b4d272-52"/>
Oct 20 10:15:20 user nova-compute[74311]: </interface>
Oct 20 10:15:20 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:20 user nova-compute[74311]: INFO nova.compute.manager [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Terminating instance
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Start waiting for the detach event from libvirt for device tapa5b4d272-52 with device alias net1 for instance 023498fa-b18b-4947-9b09-e9f6caafa931 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-06012b50-8eb4-4707-8014-6d5229eedd6b req-770b8805-0483-433c-9f71-715f394c19c5 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Received event network-vif-unplugged-c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-06012b50-8eb4-4707-8014-6d5229eedd6b req-770b8805-0483-433c-9f71-715f394c19c5 service nova] Acquiring lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-06012b50-8eb4-4707-8014-6d5229eedd6b req-770b8805-0483-433c-9f71-715f394c19c5 service nova] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-06012b50-8eb4-4707-8014-6d5229eedd6b req-770b8805-0483-433c-9f71-715f394c19c5 service nova] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-06012b50-8eb4-4707-8014-6d5229eedd6b req-770b8805-0483-433c-9f71-715f394c19c5 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] No waiting events found dispatching network-vif-unplugged-c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-06012b50-8eb4-4707-8014-6d5229eedd6b req-770b8805-0483-433c-9f71-715f394c19c5 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Received event network-vif-unplugged-c02afa9c-c54e-4894-a7ee-568784a07d55 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-a2c9b0b2-4dda-461b-9291-5dacec27044e req-db7c32a6-e72a-4f76-b42b-8b7b8b8d0fd5 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received event network-vif-unplugged-a5b4d272-5273-4469-9a19-733d5bada1cc {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a2c9b0b2-4dda-461b-9291-5dacec27044e req-db7c32a6-e72a-4f76-b42b-8b7b8b8d0fd5 service nova] Acquiring lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a2c9b0b2-4dda-461b-9291-5dacec27044e req-db7c32a6-e72a-4f76-b42b-8b7b8b8d0fd5 service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a2c9b0b2-4dda-461b-9291-5dacec27044e req-db7c32a6-e72a-4f76-b42b-8b7b8b8d0fd5 service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-a2c9b0b2-4dda-461b-9291-5dacec27044e req-db7c32a6-e72a-4f76-b42b-8b7b8b8d0fd5 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] No waiting events found dispatching network-vif-unplugged-a5b4d272-5273-4469-9a19-733d5bada1cc {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:15:20 user nova-compute[74311]: WARNING nova.compute.manager [req-a2c9b0b2-4dda-461b-9291-5dacec27044e req-db7c32a6-e72a-4f76-b42b-8b7b8b8d0fd5 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received unexpected event network-vif-unplugged-a5b4d272-5273-4469-9a19-733d5bada1cc for instance with vm_state active and task_state None.
Oct 20 10:15:21 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Instance destroyed successfully.
Oct 20 10:15:21 user nova-compute[74311]: DEBUG nova.objects.instance [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lazy-loading 'resources' on Instance uuid 4dd0bb76-160a-4247-8bf7-5e28745fe4e5 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:12:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1624968394',display_name='tempest-AttachSCSIVolumeTestJSON-server-1624968394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1624968394',id=6,image_ref='8427a028-b2d7-45cd-b32f-9d113bc32b3b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBI8lRuL7ft6Q6GowooTedPfc6tPy6eyW1QfkTrwa/VM14hNb2kAl5g/XZfqFPqw3+dxmlgNd8laduw+kqVqbN9e8UXs+jifTHvgjkSOeeR3SnhSN2xZ8IlE9S+7NnvfYg==',key_name='tempest-keypair-1263924815',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63abe0204d114b75b7c2eff41b6fbb19',ramdisk_id='',reservation_id='r-7wo13m0t',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8427a028-b2d7-45cd-b32f-9d113bc32b3b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1945506651',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1945506651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:12:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1e26ba3870d4546b18d45cd4f83c5fb',uuid=4dd0bb76-160a-4247-8bf7-5e28745fe4e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c02afa9c-c54e-4894-a7ee-568784a07d55", "address": "fa:16:3e:4c:e0:96", "network": {"id": "e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-705302433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abe0204d114b75b7c2eff41b6fbb19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02afa9c-c5", "ovs_interfaceid": "c02afa9c-c54e-4894-a7ee-568784a07d55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Converting VIF {"id": "c02afa9c-c54e-4894-a7ee-568784a07d55", "address": "fa:16:3e:4c:e0:96", "network": {"id": "e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-705302433-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63abe0204d114b75b7c2eff41b6fbb19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc02afa9c-c5", "ovs_interfaceid": "c02afa9c-c54e-4894-a7ee-568784a07d55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:e0:96,bridge_name='br-int',has_traffic_filtering=True,id=c02afa9c-c54e-4894-a7ee-568784a07d55,network=Network(e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02afa9c-c5') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG os_vif [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:e0:96,bridge_name='br-int',has_traffic_filtering=True,id=c02afa9c-c54e-4894-a7ee-568784a07d55,network=Network(e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02afa9c-c5') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc02afa9c-c5, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a048534c-97eb-456f-ae7f-7e368882c37f) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:21 user nova-compute[74311]: INFO os_vif [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:e0:96,bridge_name='br-int',has_traffic_filtering=True,id=c02afa9c-c54e-4894-a7ee-568784a07d55,network=Network(e22e4194-2a0d-499a-80f2-5fd2c9cd8a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc02afa9c-c5')
Oct 20 10:15:21 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Deleting instance files /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5_del
Oct 20 10:15:21 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Deletion of /opt/stack/data/nova/instances/4dd0bb76-160a-4247-8bf7-5e28745fe4e5_del complete
Oct 20 10:15:21 user nova-compute[74311]: INFO nova.compute.manager [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 20 10:15:21 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:15:21 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:15:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-bfd0b5bd-0b40-4692-adb4-7e270cc1c014 req-1dfccfad-d3ad-4ac7-a412-15fb6eafad64 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Received event network-vif-plugged-c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bfd0b5bd-0b40-4692-adb4-7e270cc1c014 req-1dfccfad-d3ad-4ac7-a412-15fb6eafad64 service nova] Acquiring lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bfd0b5bd-0b40-4692-adb4-7e270cc1c014 req-1dfccfad-d3ad-4ac7-a412-15fb6eafad64 service nova] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bfd0b5bd-0b40-4692-adb4-7e270cc1c014 req-1dfccfad-d3ad-4ac7-a412-15fb6eafad64 service nova] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-bfd0b5bd-0b40-4692-adb4-7e270cc1c014 req-1dfccfad-d3ad-4ac7-a412-15fb6eafad64 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] No waiting events found dispatching network-vif-plugged-c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:15:22 user nova-compute[74311]: WARNING nova.compute.manager [req-bfd0b5bd-0b40-4692-adb4-7e270cc1c014 req-1dfccfad-d3ad-4ac7-a412-15fb6eafad64 service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Received unexpected event network-vif-plugged-c02afa9c-c54e-4894-a7ee-568784a07d55 for instance with vm_state active and task_state deleting.
Oct 20 10:15:22 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:15:22 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Took 1.52 seconds to deallocate network for instance.
Oct 20 10:15:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-a4395613-5ed9-4d6e-80c2-d68527455222 req-1f4fbddf-bb71-4ce8-9f0b-d7becabf39dc service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received event network-vif-plugged-a5b4d272-5273-4469-9a19-733d5bada1cc {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a4395613-5ed9-4d6e-80c2-d68527455222 req-1f4fbddf-bb71-4ce8-9f0b-d7becabf39dc service nova] Acquiring lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a4395613-5ed9-4d6e-80c2-d68527455222 req-1f4fbddf-bb71-4ce8-9f0b-d7becabf39dc service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a4395613-5ed9-4d6e-80c2-d68527455222 req-1f4fbddf-bb71-4ce8-9f0b-d7becabf39dc service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-a4395613-5ed9-4d6e-80c2-d68527455222 req-1f4fbddf-bb71-4ce8-9f0b-d7becabf39dc service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] No waiting events found dispatching network-vif-plugged-a5b4d272-5273-4469-9a19-733d5bada1cc {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:15:22 user nova-compute[74311]: WARNING nova.compute.manager [req-a4395613-5ed9-4d6e-80c2-d68527455222 req-1f4fbddf-bb71-4ce8-9f0b-d7becabf39dc service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received unexpected event network-vif-plugged-a5b4d272-5273-4469-9a19-733d5bada1cc for instance with vm_state active and task_state None.
Oct 20 10:15:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-a4395613-5ed9-4d6e-80c2-d68527455222 req-1f4fbddf-bb71-4ce8-9f0b-d7becabf39dc service nova] [instance: 4dd0bb76-160a-4247-8bf7-5e28745fe4e5] Received event network-vif-deleted-c02afa9c-c54e-4894-a7ee-568784a07d55 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:23 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:15:23 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:15:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.515s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:23 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Deleted allocations for instance 4dd0bb76-160a-4247-8bf7-5e28745fe4e5
Oct 20 10:15:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1564775a-0ea8-4800-a608-7791bebd1645 tempest-AttachSCSIVolumeTestJSON-1945506651 tempest-AttachSCSIVolumeTestJSON-1945506651-project-member] Lock "4dd0bb76-160a-4247-8bf7-5e28745fe4e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.309s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:15:32 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 12bfda49-ce9d-4806-a982-08ce670faeb6 is timed out.
Oct 20 10:15:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Successfully detached device vdb from instance 12bfda49-ce9d-4806-a982-08ce670faeb6 from the live domain config.
Oct 20 10:15:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UEyRKrnx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:15:32 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e710b18-4047-42ab-94a2-659f3787b4e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:15:32 user nova-compute[74311]: No targets found.
Oct 20 10:15:32 user nova-compute[74311]: iSNS:
Oct 20 10:15:32 user nova-compute[74311]: No targets found.
Oct 20 10:15:32 user nova-compute[74311]: STATIC:
Oct 20 10:15:32 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77
Oct 20 10:15:32 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:32 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:32 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a
Oct 20 10:15:32 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:32 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:32 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16
Oct 20 10:15:32 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:32 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:32 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055
Oct 20 10:15:32 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:32 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:32 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c
Oct 20 10:15:32 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:32 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:32 user nova-compute[74311]: FIRMWARE:
Oct 20 10:15:32 user nova-compute[74311]: No targets found.
Oct 20 10:15:32 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:15:32 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:15:32 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c0e81c-fa77-4010-8eb4-d7bc255fd061]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e020fc9-0b56-409a-a6d0-e3b7bf4606c8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:32 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:32 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:32 user nova-compute[74311]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)
Oct 20 10:15:32 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:32 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:32 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:32 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:32 user nova-compute[74311]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a (non-flash)
Oct 20 10:15:32 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:32 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164f37e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a'): ({'sdh'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Removing single pathed devices sdh {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6d40fb-1711-413a-866c-f670f23512f5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f90a870-6073-4280-a027-788d8a55c432]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Flushing IO for device /dev/sdh {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3108cf-5cdc-4ca0-b2a1-39d241cb75c7]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc057152-6c88-4f36-8992-4c8af36802fb]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] SCSI volumes sdh have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1c9000-43de-4e0f-9549-9773fce495d0]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[51105bd7-b58f-4a7e-abaf-8cfc48d60beb]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a, portal: 172.16.0.220,3260]
Oct 20 10:15:32 user nova-compute[74311]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a, portal: 172.16.0.220,3260] successful.
Oct 20 10:15:32 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52c7449e-7346-4d50-ab15-1b674961af4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba0ddcf-8a08-4345-9b79-4999b754034b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] <== disconnect_volume: return (302ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:15:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:15:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:40 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Waiting for libvirt event about the detach of device tapa5b4d272-52 with device alias net1 from instance 023498fa-b18b-4947-9b09-e9f6caafa931 is timed out.
Oct 20 10:15:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ad:26:65"/><model type="virtio"/><mtu size="1442"/><target dev="tapa5b4d272-52"/></interface> {{(pid=74311) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ad:26:65"/><model type="virtio"/><mtu size="1442"/><target dev="tapa5b4d272-52"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 20 10:15:40 user nova-compute[74311]:   <name>instance-00000008</name>
Oct 20 10:15:40 user nova-compute[74311]:   <uuid>023498fa-b18b-4947-9b09-e9f6caafa931</uuid>
Oct 20 10:15:40 user nova-compute[74311]:   <metadata>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:15:40 user nova-compute[74311]:   <nova:package version="0.0.0"/>
Oct 20 10:15:40 user nova-compute[74311]:   <nova:name>tempest-device-tagging-server-683979222</nova:name>
Oct 20 10:15:40 user nova-compute[74311]:   <nova:creationTime>2023-10-20 10:14:32</nova:creationTime>
Oct 20 10:15:40 user nova-compute[74311]:   <nova:flavor name="m1.tiny">
Oct 20 10:15:40 user nova-compute[74311]:     <nova:memory>512</nova:memory>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:disk>1</nova:disk>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:swap>0</nova:swap>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:vcpus>1</nova:vcpus>
Oct 20 10:15:40 user nova-compute[74311]:   </nova:flavor>
Oct 20 10:15:40 user nova-compute[74311]:   <nova:owner>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:user uuid="6ba84b7bf6a7418a821a22bbd3b0569c">tempest-TaggedAttachmentsTest-340750198-project-member</nova:user>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:project uuid="16b3aaaa066740fa913e22537f799e86">tempest-TaggedAttachmentsTest-340750198</nova:project>
Oct 20 10:15:40 user nova-compute[74311]:   </nova:owner>
Oct 20 10:15:40 user nova-compute[74311]:   <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:15:40 user nova-compute[74311]:   <nova:ports>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:port uuid="465bad7c-bd36-492a-bd18-a8fcbd8bfd42">
Oct 20 10:15:40 user nova-compute[74311]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 10:15:40 user nova-compute[74311]:     </nova:port>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:port uuid="a5b4d272-5273-4469-9a19-733d5bada1cc">
Oct 20 10:15:40 user nova-compute[74311]:       <nova:ip type="fixed" address="10.10.10.208" ipVersion="4"/>
Oct 20 10:15:40 user nova-compute[74311]:     </nova:port>
Oct 20 10:15:40 user nova-compute[74311]:   </nova:ports>
Oct 20 10:15:40 user nova-compute[74311]: </nova:instance>
Oct 20 10:15:40 user nova-compute[74311]:   </metadata>
Oct 20 10:15:40 user nova-compute[74311]:   <memory unit='KiB'>524288</memory>
Oct 20 10:15:40 user nova-compute[74311]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 10:15:40 user nova-compute[74311]:   <vcpu placement='static'>1</vcpu>
Oct 20 10:15:40 user nova-compute[74311]:   <resource>
Oct 20 10:15:40 user nova-compute[74311]:     <partition>/machine</partition>
Oct 20 10:15:40 user nova-compute[74311]:   </resource>
Oct 20 10:15:40 user nova-compute[74311]:   <sysinfo type='smbios'>
Oct 20 10:15:40 user nova-compute[74311]:     <system>
Oct 20 10:15:40 user nova-compute[74311]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 10:15:40 user nova-compute[74311]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 10:15:40 user nova-compute[74311]:       <entry name='version'>0.0.0</entry>
Oct 20 10:15:40 user nova-compute[74311]:       <entry name='serial'>023498fa-b18b-4947-9b09-e9f6caafa931</entry>
Oct 20 10:15:40 user nova-compute[74311]:       <entry name='uuid'>023498fa-b18b-4947-9b09-e9f6caafa931</entry>
Oct 20 10:15:40 user nova-compute[74311]:       <entry name='family'>Virtual Machine</entry>
Oct 20 10:15:40 user nova-compute[74311]:     </system>
Oct 20 10:15:40 user nova-compute[74311]:   </sysinfo>
Oct 20 10:15:40 user nova-compute[74311]:   <os>
Oct 20 10:15:40 user nova-compute[74311]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 10:15:40 user nova-compute[74311]:     <boot dev='hd'/>
Oct 20 10:15:40 user nova-compute[74311]:     <smbios mode='sysinfo'/>
Oct 20 10:15:40 user nova-compute[74311]:   </os>
Oct 20 10:15:40 user nova-compute[74311]:   <features>
Oct 20 10:15:40 user nova-compute[74311]:     <acpi/>
Oct 20 10:15:40 user nova-compute[74311]:     <apic/>
Oct 20 10:15:40 user nova-compute[74311]:     <vmcoreinfo state='on'/>
Oct 20 10:15:40 user nova-compute[74311]:   </features>
Oct 20 10:15:40 user nova-compute[74311]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 10:15:40 user nova-compute[74311]:     <model fallback='forbid'>Nehalem</model>
Oct 20 10:15:40 user nova-compute[74311]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 10:15:40 user nova-compute[74311]:     <feature policy='require' name='vme'/>
Oct 20 10:15:40 user nova-compute[74311]:     <feature policy='require' name='x2apic'/>
Oct 20 10:15:40 user nova-compute[74311]:     <feature policy='require' name='hypervisor'/>
Oct 20 10:15:40 user nova-compute[74311]:   </cpu>
Oct 20 10:15:40 user nova-compute[74311]:   <clock offset='utc'>
Oct 20 10:15:40 user nova-compute[74311]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 10:15:40 user nova-compute[74311]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 10:15:40 user nova-compute[74311]:     <timer name='hpet' present='no'/>
Oct 20 10:15:40 user nova-compute[74311]:   </clock>
Oct 20 10:15:40 user nova-compute[74311]:   <on_poweroff>destroy</on_poweroff>
Oct 20 10:15:40 user nova-compute[74311]:   <on_reboot>restart</on_reboot>
Oct 20 10:15:40 user nova-compute[74311]:   <on_crash>destroy</on_crash>
Oct 20 10:15:40 user nova-compute[74311]:   <devices>
Oct 20 10:15:40 user nova-compute[74311]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 10:15:40 user nova-compute[74311]:     <disk type='file' device='disk'>
Oct 20 10:15:40 user nova-compute[74311]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 10:15:40 user nova-compute[74311]:       <source file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk' index='2'/>
Oct 20 10:15:40 user nova-compute[74311]:       <backingStore type='file' index='3'>
Oct 20 10:15:40 user nova-compute[74311]:         <format type='raw'/>
Oct 20 10:15:40 user nova-compute[74311]:         <source file='/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223'/>
Oct 20 10:15:40 user nova-compute[74311]:         <backingStore/>
Oct 20 10:15:40 user nova-compute[74311]:       </backingStore>
Oct 20 10:15:40 user nova-compute[74311]:       <target dev='vda' bus='virtio'/>
Oct 20 10:15:40 user nova-compute[74311]:       <alias name='virtio-disk0'/>
Oct 20 10:15:40 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 10:15:40 user nova-compute[74311]:     </disk>
Oct 20 10:15:40 user nova-compute[74311]:     <disk type='file' device='cdrom'>
Oct 20 10:15:40 user nova-compute[74311]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 10:15:40 user nova-compute[74311]:       <source file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk.config' index='1'/>
Oct 20 10:15:40 user nova-compute[74311]:       <backingStore/>
Oct 20 10:15:40 user nova-compute[74311]:       <target dev='hda' bus='ide'/>
Oct 20 10:15:40 user nova-compute[74311]:       <readonly/>
Oct 20 10:15:40 user nova-compute[74311]:       <alias name='ide0-0-0'/>
Oct 20 10:15:40 user nova-compute[74311]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 10:15:40 user nova-compute[74311]:     </disk>
Oct 20 10:15:40 user nova-compute[74311]:     <controller type='usb' index='0' model='none'>
Oct 20 10:15:40 user nova-compute[74311]:       <alias name='usb'/>
Oct 20 10:15:40 user nova-compute[74311]:     </controller>
Oct 20 10:15:40 user nova-compute[74311]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 10:15:40 user nova-compute[74311]:       <alias name='pci.0'/>
Oct 20 10:15:40 user nova-compute[74311]:     </controller>
Oct 20 10:15:40 user nova-compute[74311]:     <controller type='ide' index='0'>
Oct 20 10:15:40 user nova-compute[74311]:       <alias name='ide'/>
Oct 20 10:15:40 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 10:15:40 user nova-compute[74311]:     </controller>
Oct 20 10:15:40 user nova-compute[74311]:     <interface type='ethernet'>
Oct 20 10:15:40 user nova-compute[74311]:       <mac address='fa:16:3e:6e:29:a6'/>
Oct 20 10:15:40 user nova-compute[74311]:       <target dev='tap465bad7c-bd'/>
Oct 20 10:15:40 user nova-compute[74311]:       <model type='virtio'/>
Oct 20 10:15:40 user nova-compute[74311]:       <mtu size='1442'/>
Oct 20 10:15:40 user nova-compute[74311]:       <alias name='net0'/>
Oct 20 10:15:40 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 10:15:40 user nova-compute[74311]:     </interface>
Oct 20 10:15:40 user nova-compute[74311]:     <serial type='pty'>
Oct 20 10:15:40 user nova-compute[74311]:       <source path='/dev/pts/7'/>
Oct 20 10:15:40 user nova-compute[74311]:       <log file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/console.log' append='off'/>
Oct 20 10:15:40 user nova-compute[74311]:       <target type='isa-serial' port='0'>
Oct 20 10:15:40 user nova-compute[74311]:         <model name='isa-serial'/>
Oct 20 10:15:40 user nova-compute[74311]:       </target>
Oct 20 10:15:40 user nova-compute[74311]:       <alias name='serial0'/>
Oct 20 10:15:40 user nova-compute[74311]:     </serial>
Oct 20 10:15:40 user nova-compute[74311]:     <console type='pty' tty='/dev/pts/7'>
Oct 20 10:15:40 user nova-compute[74311]:       <source path='/dev/pts/7'/>
Oct 20 10:15:40 user nova-compute[74311]:       <log file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/console.log' append='off'/>
Oct 20 10:15:40 user nova-compute[74311]:       <target type='serial' port='0'/>
Oct 20 10:15:40 user nova-compute[74311]:       <alias name='serial0'/>
Oct 20 10:15:40 user nova-compute[74311]:     </console>
Oct 20 10:15:40 user nova-compute[74311]:     <input type='mouse' bus='ps2'>
Oct 20 10:15:40 user nova-compute[74311]:       <alias name='input0'/>
Oct 20 10:15:40 user nova-compute[74311]:     </input>
Oct 20 10:15:40 user nova-compute[74311]:     <input type='keyboard' bus='ps2'>
Oct 20 10:15:40 user nova-compute[74311]:       <alias name='input1'/>
Oct 20 10:15:40 user nova-compute[74311]:     </input>
Oct 20 10:15:40 user nova-compute[74311]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 20 10:15:40 user nova-compute[74311]:       <listen type='address' address='0.0.0.0'/>
Oct 20 10:15:40 user nova-compute[74311]:     </graphics>
Oct 20 10:15:40 user nova-compute[74311]:     <audio id='1' type='none'/>
Oct 20 10:15:40 user nova-compute[74311]:     <video>
Oct 20 10:15:40 user nova-compute[74311]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 10:15:40 user nova-compute[74311]:       <alias name='video0'/>
Oct 20 10:15:40 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 10:15:40 user nova-compute[74311]:     </video>
Oct 20 10:15:40 user nova-compute[74311]:     <memballoon model='virtio'>
Oct 20 10:15:40 user nova-compute[74311]:       <stats period='10'/>
Oct 20 10:15:40 user nova-compute[74311]:       <alias name='balloon0'/>
Oct 20 10:15:40 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 10:15:40 user nova-compute[74311]:     </memballoon>
Oct 20 10:15:40 user nova-compute[74311]:     <rng model='virtio'>
Oct 20 10:15:40 user nova-compute[74311]:       <backend model='random'>/dev/urandom</backend>
Oct 20 10:15:40 user nova-compute[74311]:       <alias name='rng0'/>
Oct 20 10:15:40 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 10:15:40 user nova-compute[74311]:     </rng>
Oct 20 10:15:40 user nova-compute[74311]:   </devices>
Oct 20 10:15:40 user nova-compute[74311]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 10:15:40 user nova-compute[74311]:     <label>libvirt-023498fa-b18b-4947-9b09-e9f6caafa931</label>
Oct 20 10:15:40 user nova-compute[74311]:     <imagelabel>libvirt-023498fa-b18b-4947-9b09-e9f6caafa931</imagelabel>
Oct 20 10:15:40 user nova-compute[74311]:   </seclabel>
Oct 20 10:15:40 user nova-compute[74311]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 10:15:40 user nova-compute[74311]:     <label>+64055:+108</label>
Oct 20 10:15:40 user nova-compute[74311]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 10:15:40 user nova-compute[74311]:   </seclabel>
Oct 20 10:15:40 user nova-compute[74311]: </domain>
Oct 20 10:15:40 user nova-compute[74311]:  {{(pid=74311) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 10:15:40 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Successfully detached device tapa5b4d272-52 from instance 023498fa-b18b-4947-9b09-e9f6caafa931 from the live domain config.
Oct 20 10:15:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-683979222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-683979222',id=8,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAka0fGmXxuri5svjkz2HGnAAMwNmV/IgeCY0qqOdRgNIDrai8wjXmgODQlUjDOkNgT+vtqR0NIIR/7gHXjzK406sjo8EG1oh8DP0FT7lElr/8iMYNu2UdW9vM5ZOr2qnw==',key_name='tempest-keypair-2115206596',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16b3aaaa066740fa913e22537f799e86',ramdisk_id='',reservation_id='r-4t98aki2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-340750198',owner_user_name='tempest-TaggedAttachmentsTest-340750198-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ba84b7bf6a7418a821a22bbd3b0569c',uuid=023498fa-b18b-4947-9b09-e9f6caafa931,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5b4d272-5273-4469-9a19-733d5bada1cc", "address": "fa:16:3e:ad:26:65", "network": {"id": "6fafdbe4-876b-4db5-8d17-ed51c90dc01a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-825674472", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b4d272-52", "ovs_interfaceid": "a5b4d272-5273-4469-9a19-733d5bada1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Converting VIF {"id": "a5b4d272-5273-4469-9a19-733d5bada1cc", "address": "fa:16:3e:ad:26:65", "network": {"id": "6fafdbe4-876b-4db5-8d17-ed51c90dc01a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-825674472", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b4d272-52", "ovs_interfaceid": "a5b4d272-5273-4469-9a19-733d5bada1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:26:65,bridge_name='br-int',has_traffic_filtering=True,id=a5b4d272-5273-4469-9a19-733d5bada1cc,network=Network(6fafdbe4-876b-4db5-8d17-ed51c90dc01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b4d272-52') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG os_vif [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:26:65,bridge_name='br-int',has_traffic_filtering=True,id=a5b4d272-5273-4469-9a19-733d5bada1cc,network=Network(6fafdbe4-876b-4db5-8d17-ed51c90dc01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b4d272-52') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5b4d272-52, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=debc3564-248a-4965-850f-cb013e1558f9) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:40 user nova-compute[74311]: INFO os_vif [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:26:65,bridge_name='br-int',has_traffic_filtering=True,id=a5b4d272-5273-4469-9a19-733d5bada1cc,network=Network(6fafdbe4-876b-4db5-8d17-ed51c90dc01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b4d272-52')
Oct 20 10:15:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:15:40 user nova-compute[74311]:   <nova:package version="0.0.0"/>
Oct 20 10:15:40 user nova-compute[74311]:   <nova:name>tempest-device-tagging-server-683979222</nova:name>
Oct 20 10:15:40 user nova-compute[74311]:   <nova:creationTime>2023-10-20 10:15:40</nova:creationTime>
Oct 20 10:15:40 user nova-compute[74311]:   <nova:flavor name="m1.tiny">
Oct 20 10:15:40 user nova-compute[74311]:     <nova:memory>512</nova:memory>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:disk>1</nova:disk>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:swap>0</nova:swap>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:vcpus>1</nova:vcpus>
Oct 20 10:15:40 user nova-compute[74311]:   </nova:flavor>
Oct 20 10:15:40 user nova-compute[74311]:   <nova:owner>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:user uuid="6ba84b7bf6a7418a821a22bbd3b0569c">tempest-TaggedAttachmentsTest-340750198-project-member</nova:user>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:project uuid="16b3aaaa066740fa913e22537f799e86">tempest-TaggedAttachmentsTest-340750198</nova:project>
Oct 20 10:15:40 user nova-compute[74311]:   </nova:owner>
Oct 20 10:15:40 user nova-compute[74311]:   <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:15:40 user nova-compute[74311]:   <nova:ports>
Oct 20 10:15:40 user nova-compute[74311]:     <nova:port uuid="465bad7c-bd36-492a-bd18-a8fcbd8bfd42">
Oct 20 10:15:40 user nova-compute[74311]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 10:15:40 user nova-compute[74311]:     </nova:port>
Oct 20 10:15:40 user nova-compute[74311]:   </nova:ports>
Oct 20 10:15:40 user nova-compute[74311]: </nova:instance>
Oct 20 10:15:40 user nova-compute[74311]:  {{(pid=74311) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received event network-vif-deleted-a5b4d272-5273-4469-9a19-733d5bada1cc {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:40 user nova-compute[74311]: INFO nova.compute.manager [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Neutron deleted interface a5b4d272-5273-4469-9a19-733d5bada1cc; detaching it from the instance and deleting it from the info cache
Oct 20 10:15:40 user nova-compute[74311]: DEBUG nova.network.neutron [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Updating instance_info_cache with network_info: [{"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG nova.objects.instance [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] Lazy-loading 'system_metadata' on Instance uuid 023498fa-b18b-4947-9b09-e9f6caafa931 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquired lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG nova.network.neutron [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:15:40 user nova-compute[74311]: DEBUG nova.objects.instance [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] Lazy-loading 'flavor' on Instance uuid 023498fa-b18b-4947-9b09-e9f6caafa931 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG nova.objects.base [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] Object Instance<023498fa-b18b-4947-9b09-e9f6caafa931> lazy-loaded attributes: system_metadata,flavor {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-683979222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-683979222',id=8,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAka0fGmXxuri5svjkz2HGnAAMwNmV/IgeCY0qqOdRgNIDrai8wjXmgODQlUjDOkNgT+vtqR0NIIR/7gHXjzK406sjo8EG1oh8DP0FT7lElr/8iMYNu2UdW9vM5ZOr2qnw==',key_name='tempest-keypair-2115206596',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16b3aaaa066740fa913e22537f799e86',ramdisk_id='',reservation_id='r-4t98aki2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-340750198',owner_user_name='tempest-TaggedAttachmentsTest-340750198-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ba84b7bf6a7418a821a22bbd3b0569c',uuid=023498fa-b18b-4947-9b09-e9f6caafa931,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5b4d272-5273-4469-9a19-733d5bada1cc", "address": "fa:16:3e:ad:26:65", "network": {"id": "6fafdbe4-876b-4db5-8d17-ed51c90dc01a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-825674472", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b4d272-52", "ovs_interfaceid": "a5b4d272-5273-4469-9a19-733d5bada1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG nova.network.os_vif_util [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] Converting VIF {"id": "a5b4d272-5273-4469-9a19-733d5bada1cc", "address": "fa:16:3e:ad:26:65", "network": {"id": "6fafdbe4-876b-4db5-8d17-ed51c90dc01a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-825674472", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b4d272-52", "ovs_interfaceid": "a5b4d272-5273-4469-9a19-733d5bada1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG nova.network.os_vif_util [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:26:65,bridge_name='br-int',has_traffic_filtering=True,id=a5b4d272-5273-4469-9a19-733d5bada1cc,network=Network(6fafdbe4-876b-4db5-8d17-ed51c90dc01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b4d272-52') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ad:26:65"/><model type="virtio"/><mtu size="1442"/><target dev="tapa5b4d272-52"/></interface> {{(pid=74311) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ad:26:65"/><model type="virtio"/><mtu size="1442"/><target dev="tapa5b4d272-52"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 20 10:15:41 user nova-compute[74311]:   <name>instance-00000008</name>
Oct 20 10:15:41 user nova-compute[74311]:   <uuid>023498fa-b18b-4947-9b09-e9f6caafa931</uuid>
Oct 20 10:15:41 user nova-compute[74311]:   <metadata>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:15:41 user nova-compute[74311]:   <nova:package version="0.0.0"/>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:name>tempest-device-tagging-server-683979222</nova:name>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:creationTime>2023-10-20 10:15:40</nova:creationTime>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:flavor name="m1.tiny">
Oct 20 10:15:41 user nova-compute[74311]:     <nova:memory>512</nova:memory>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:disk>1</nova:disk>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:swap>0</nova:swap>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:vcpus>1</nova:vcpus>
Oct 20 10:15:41 user nova-compute[74311]:   </nova:flavor>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:owner>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:user uuid="6ba84b7bf6a7418a821a22bbd3b0569c">tempest-TaggedAttachmentsTest-340750198-project-member</nova:user>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:project uuid="16b3aaaa066740fa913e22537f799e86">tempest-TaggedAttachmentsTest-340750198</nova:project>
Oct 20 10:15:41 user nova-compute[74311]:   </nova:owner>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:ports>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:port uuid="465bad7c-bd36-492a-bd18-a8fcbd8bfd42">
Oct 20 10:15:41 user nova-compute[74311]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 10:15:41 user nova-compute[74311]:     </nova:port>
Oct 20 10:15:41 user nova-compute[74311]:   </nova:ports>
Oct 20 10:15:41 user nova-compute[74311]: </nova:instance>
Oct 20 10:15:41 user nova-compute[74311]:   </metadata>
Oct 20 10:15:41 user nova-compute[74311]:   <memory unit='KiB'>524288</memory>
Oct 20 10:15:41 user nova-compute[74311]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 10:15:41 user nova-compute[74311]:   <vcpu placement='static'>1</vcpu>
Oct 20 10:15:41 user nova-compute[74311]:   <resource>
Oct 20 10:15:41 user nova-compute[74311]:     <partition>/machine</partition>
Oct 20 10:15:41 user nova-compute[74311]:   </resource>
Oct 20 10:15:41 user nova-compute[74311]:   <sysinfo type='smbios'>
Oct 20 10:15:41 user nova-compute[74311]:     <system>
Oct 20 10:15:41 user nova-compute[74311]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 10:15:41 user nova-compute[74311]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 10:15:41 user nova-compute[74311]:       <entry name='version'>0.0.0</entry>
Oct 20 10:15:41 user nova-compute[74311]:       <entry name='serial'>023498fa-b18b-4947-9b09-e9f6caafa931</entry>
Oct 20 10:15:41 user nova-compute[74311]:       <entry name='uuid'>023498fa-b18b-4947-9b09-e9f6caafa931</entry>
Oct 20 10:15:41 user nova-compute[74311]:       <entry name='family'>Virtual Machine</entry>
Oct 20 10:15:41 user nova-compute[74311]:     </system>
Oct 20 10:15:41 user nova-compute[74311]:   </sysinfo>
Oct 20 10:15:41 user nova-compute[74311]:   <os>
Oct 20 10:15:41 user nova-compute[74311]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 10:15:41 user nova-compute[74311]:     <boot dev='hd'/>
Oct 20 10:15:41 user nova-compute[74311]:     <smbios mode='sysinfo'/>
Oct 20 10:15:41 user nova-compute[74311]:   </os>
Oct 20 10:15:41 user nova-compute[74311]:   <features>
Oct 20 10:15:41 user nova-compute[74311]:     <acpi/>
Oct 20 10:15:41 user nova-compute[74311]:     <apic/>
Oct 20 10:15:41 user nova-compute[74311]:     <vmcoreinfo state='on'/>
Oct 20 10:15:41 user nova-compute[74311]:   </features>
Oct 20 10:15:41 user nova-compute[74311]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 10:15:41 user nova-compute[74311]:     <model fallback='forbid'>Nehalem</model>
Oct 20 10:15:41 user nova-compute[74311]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 10:15:41 user nova-compute[74311]:     <feature policy='require' name='vme'/>
Oct 20 10:15:41 user nova-compute[74311]:     <feature policy='require' name='x2apic'/>
Oct 20 10:15:41 user nova-compute[74311]:     <feature policy='require' name='hypervisor'/>
Oct 20 10:15:41 user nova-compute[74311]:   </cpu>
Oct 20 10:15:41 user nova-compute[74311]:   <clock offset='utc'>
Oct 20 10:15:41 user nova-compute[74311]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 10:15:41 user nova-compute[74311]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 10:15:41 user nova-compute[74311]:     <timer name='hpet' present='no'/>
Oct 20 10:15:41 user nova-compute[74311]:   </clock>
Oct 20 10:15:41 user nova-compute[74311]:   <on_poweroff>destroy</on_poweroff>
Oct 20 10:15:41 user nova-compute[74311]:   <on_reboot>restart</on_reboot>
Oct 20 10:15:41 user nova-compute[74311]:   <on_crash>destroy</on_crash>
Oct 20 10:15:41 user nova-compute[74311]:   <devices>
Oct 20 10:15:41 user nova-compute[74311]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 10:15:41 user nova-compute[74311]:     <disk type='file' device='disk'>
Oct 20 10:15:41 user nova-compute[74311]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 10:15:41 user nova-compute[74311]:       <source file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk' index='2'/>
Oct 20 10:15:41 user nova-compute[74311]:       <backingStore type='file' index='3'>
Oct 20 10:15:41 user nova-compute[74311]:         <format type='raw'/>
Oct 20 10:15:41 user nova-compute[74311]:         <source file='/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223'/>
Oct 20 10:15:41 user nova-compute[74311]:         <backingStore/>
Oct 20 10:15:41 user nova-compute[74311]:       </backingStore>
Oct 20 10:15:41 user nova-compute[74311]:       <target dev='vda' bus='virtio'/>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='virtio-disk0'/>
Oct 20 10:15:41 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </disk>
Oct 20 10:15:41 user nova-compute[74311]:     <disk type='file' device='cdrom'>
Oct 20 10:15:41 user nova-compute[74311]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 10:15:41 user nova-compute[74311]:       <source file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk.config' index='1'/>
Oct 20 10:15:41 user nova-compute[74311]:       <backingStore/>
Oct 20 10:15:41 user nova-compute[74311]:       <target dev='hda' bus='ide'/>
Oct 20 10:15:41 user nova-compute[74311]:       <readonly/>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='ide0-0-0'/>
Oct 20 10:15:41 user nova-compute[74311]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </disk>
Oct 20 10:15:41 user nova-compute[74311]:     <controller type='usb' index='0' model='none'>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='usb'/>
Oct 20 10:15:41 user nova-compute[74311]:     </controller>
Oct 20 10:15:41 user nova-compute[74311]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='pci.0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </controller>
Oct 20 10:15:41 user nova-compute[74311]:     <controller type='ide' index='0'>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='ide'/>
Oct 20 10:15:41 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 10:15:41 user nova-compute[74311]:     </controller>
Oct 20 10:15:41 user nova-compute[74311]:     <interface type='ethernet'>
Oct 20 10:15:41 user nova-compute[74311]:       <mac address='fa:16:3e:6e:29:a6'/>
Oct 20 10:15:41 user nova-compute[74311]:       <target dev='tap465bad7c-bd'/>
Oct 20 10:15:41 user nova-compute[74311]:       <model type='virtio'/>
Oct 20 10:15:41 user nova-compute[74311]:       <mtu size='1442'/>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='net0'/>
Oct 20 10:15:41 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </interface>
Oct 20 10:15:41 user nova-compute[74311]:     <serial type='pty'>
Oct 20 10:15:41 user nova-compute[74311]:       <source path='/dev/pts/7'/>
Oct 20 10:15:41 user nova-compute[74311]:       <log file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/console.log' append='off'/>
Oct 20 10:15:41 user nova-compute[74311]:       <target type='isa-serial' port='0'>
Oct 20 10:15:41 user nova-compute[74311]:         <model name='isa-serial'/>
Oct 20 10:15:41 user nova-compute[74311]:       </target>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='serial0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </serial>
Oct 20 10:15:41 user nova-compute[74311]:     <console type='pty' tty='/dev/pts/7'>
Oct 20 10:15:41 user nova-compute[74311]:       <source path='/dev/pts/7'/>
Oct 20 10:15:41 user nova-compute[74311]:       <log file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/console.log' append='off'/>
Oct 20 10:15:41 user nova-compute[74311]:       <target type='serial' port='0'/>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='serial0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </console>
Oct 20 10:15:41 user nova-compute[74311]:     <input type='mouse' bus='ps2'>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='input0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </input>
Oct 20 10:15:41 user nova-compute[74311]:     <input type='keyboard' bus='ps2'>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='input1'/>
Oct 20 10:15:41 user nova-compute[74311]:     </input>
Oct 20 10:15:41 user nova-compute[74311]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 20 10:15:41 user nova-compute[74311]:       <listen type='address' address='0.0.0.0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </graphics>
Oct 20 10:15:41 user nova-compute[74311]:     <audio id='1' type='none'/>
Oct 20 10:15:41 user nova-compute[74311]:     <video>
Oct 20 10:15:41 user nova-compute[74311]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='video0'/>
Oct 20 10:15:41 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </video>
Oct 20 10:15:41 user nova-compute[74311]:     <memballoon model='virtio'>
Oct 20 10:15:41 user nova-compute[74311]:       <stats period='10'/>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='balloon0'/>
Oct 20 10:15:41 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </memballoon>
Oct 20 10:15:41 user nova-compute[74311]:     <rng model='virtio'>
Oct 20 10:15:41 user nova-compute[74311]:       <backend model='random'>/dev/urandom</backend>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='rng0'/>
Oct 20 10:15:41 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </rng>
Oct 20 10:15:41 user nova-compute[74311]:   </devices>
Oct 20 10:15:41 user nova-compute[74311]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 10:15:41 user nova-compute[74311]:     <label>libvirt-023498fa-b18b-4947-9b09-e9f6caafa931</label>
Oct 20 10:15:41 user nova-compute[74311]:     <imagelabel>libvirt-023498fa-b18b-4947-9b09-e9f6caafa931</imagelabel>
Oct 20 10:15:41 user nova-compute[74311]:   </seclabel>
Oct 20 10:15:41 user nova-compute[74311]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 10:15:41 user nova-compute[74311]:     <label>+64055:+108</label>
Oct 20 10:15:41 user nova-compute[74311]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 10:15:41 user nova-compute[74311]:   </seclabel>
Oct 20 10:15:41 user nova-compute[74311]: </domain>
Oct 20 10:15:41 user nova-compute[74311]:  {{(pid=74311) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ad:26:65"/><model type="virtio"/><mtu size="1442"/><target dev="tapa5b4d272-52"/></interface> {{(pid=74311) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ad:26:65"/><model type="virtio"/><mtu size="1442"/><target dev="tapa5b4d272-52"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 20 10:15:41 user nova-compute[74311]:   <name>instance-00000008</name>
Oct 20 10:15:41 user nova-compute[74311]:   <uuid>023498fa-b18b-4947-9b09-e9f6caafa931</uuid>
Oct 20 10:15:41 user nova-compute[74311]:   <metadata>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:15:41 user nova-compute[74311]:   <nova:package version="0.0.0"/>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:name>tempest-device-tagging-server-683979222</nova:name>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:creationTime>2023-10-20 10:15:40</nova:creationTime>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:flavor name="m1.tiny">
Oct 20 10:15:41 user nova-compute[74311]:     <nova:memory>512</nova:memory>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:disk>1</nova:disk>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:swap>0</nova:swap>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:vcpus>1</nova:vcpus>
Oct 20 10:15:41 user nova-compute[74311]:   </nova:flavor>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:owner>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:user uuid="6ba84b7bf6a7418a821a22bbd3b0569c">tempest-TaggedAttachmentsTest-340750198-project-member</nova:user>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:project uuid="16b3aaaa066740fa913e22537f799e86">tempest-TaggedAttachmentsTest-340750198</nova:project>
Oct 20 10:15:41 user nova-compute[74311]:   </nova:owner>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:ports>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:port uuid="465bad7c-bd36-492a-bd18-a8fcbd8bfd42">
Oct 20 10:15:41 user nova-compute[74311]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 10:15:41 user nova-compute[74311]:     </nova:port>
Oct 20 10:15:41 user nova-compute[74311]:   </nova:ports>
Oct 20 10:15:41 user nova-compute[74311]: </nova:instance>
Oct 20 10:15:41 user nova-compute[74311]:   </metadata>
Oct 20 10:15:41 user nova-compute[74311]:   <memory unit='KiB'>524288</memory>
Oct 20 10:15:41 user nova-compute[74311]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 10:15:41 user nova-compute[74311]:   <vcpu placement='static'>1</vcpu>
Oct 20 10:15:41 user nova-compute[74311]:   <resource>
Oct 20 10:15:41 user nova-compute[74311]:     <partition>/machine</partition>
Oct 20 10:15:41 user nova-compute[74311]:   </resource>
Oct 20 10:15:41 user nova-compute[74311]:   <sysinfo type='smbios'>
Oct 20 10:15:41 user nova-compute[74311]:     <system>
Oct 20 10:15:41 user nova-compute[74311]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 10:15:41 user nova-compute[74311]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 10:15:41 user nova-compute[74311]:       <entry name='version'>0.0.0</entry>
Oct 20 10:15:41 user nova-compute[74311]:       <entry name='serial'>023498fa-b18b-4947-9b09-e9f6caafa931</entry>
Oct 20 10:15:41 user nova-compute[74311]:       <entry name='uuid'>023498fa-b18b-4947-9b09-e9f6caafa931</entry>
Oct 20 10:15:41 user nova-compute[74311]:       <entry name='family'>Virtual Machine</entry>
Oct 20 10:15:41 user nova-compute[74311]:     </system>
Oct 20 10:15:41 user nova-compute[74311]:   </sysinfo>
Oct 20 10:15:41 user nova-compute[74311]:   <os>
Oct 20 10:15:41 user nova-compute[74311]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 10:15:41 user nova-compute[74311]:     <boot dev='hd'/>
Oct 20 10:15:41 user nova-compute[74311]:     <smbios mode='sysinfo'/>
Oct 20 10:15:41 user nova-compute[74311]:   </os>
Oct 20 10:15:41 user nova-compute[74311]:   <features>
Oct 20 10:15:41 user nova-compute[74311]:     <acpi/>
Oct 20 10:15:41 user nova-compute[74311]:     <apic/>
Oct 20 10:15:41 user nova-compute[74311]:     <vmcoreinfo state='on'/>
Oct 20 10:15:41 user nova-compute[74311]:   </features>
Oct 20 10:15:41 user nova-compute[74311]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 10:15:41 user nova-compute[74311]:     <model fallback='forbid'>Nehalem</model>
Oct 20 10:15:41 user nova-compute[74311]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 10:15:41 user nova-compute[74311]:     <feature policy='require' name='vme'/>
Oct 20 10:15:41 user nova-compute[74311]:     <feature policy='require' name='x2apic'/>
Oct 20 10:15:41 user nova-compute[74311]:     <feature policy='require' name='hypervisor'/>
Oct 20 10:15:41 user nova-compute[74311]:   </cpu>
Oct 20 10:15:41 user nova-compute[74311]:   <clock offset='utc'>
Oct 20 10:15:41 user nova-compute[74311]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 10:15:41 user nova-compute[74311]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 10:15:41 user nova-compute[74311]:     <timer name='hpet' present='no'/>
Oct 20 10:15:41 user nova-compute[74311]:   </clock>
Oct 20 10:15:41 user nova-compute[74311]:   <on_poweroff>destroy</on_poweroff>
Oct 20 10:15:41 user nova-compute[74311]:   <on_reboot>restart</on_reboot>
Oct 20 10:15:41 user nova-compute[74311]:   <on_crash>destroy</on_crash>
Oct 20 10:15:41 user nova-compute[74311]:   <devices>
Oct 20 10:15:41 user nova-compute[74311]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 10:15:41 user nova-compute[74311]:     <disk type='file' device='disk'>
Oct 20 10:15:41 user nova-compute[74311]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 10:15:41 user nova-compute[74311]:       <source file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk' index='2'/>
Oct 20 10:15:41 user nova-compute[74311]:       <backingStore type='file' index='3'>
Oct 20 10:15:41 user nova-compute[74311]:         <format type='raw'/>
Oct 20 10:15:41 user nova-compute[74311]:         <source file='/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223'/>
Oct 20 10:15:41 user nova-compute[74311]:         <backingStore/>
Oct 20 10:15:41 user nova-compute[74311]:       </backingStore>
Oct 20 10:15:41 user nova-compute[74311]:       <target dev='vda' bus='virtio'/>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='virtio-disk0'/>
Oct 20 10:15:41 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </disk>
Oct 20 10:15:41 user nova-compute[74311]:     <disk type='file' device='cdrom'>
Oct 20 10:15:41 user nova-compute[74311]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 10:15:41 user nova-compute[74311]:       <source file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk.config' index='1'/>
Oct 20 10:15:41 user nova-compute[74311]:       <backingStore/>
Oct 20 10:15:41 user nova-compute[74311]:       <target dev='hda' bus='ide'/>
Oct 20 10:15:41 user nova-compute[74311]:       <readonly/>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='ide0-0-0'/>
Oct 20 10:15:41 user nova-compute[74311]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </disk>
Oct 20 10:15:41 user nova-compute[74311]:     <controller type='usb' index='0' model='none'>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='usb'/>
Oct 20 10:15:41 user nova-compute[74311]:     </controller>
Oct 20 10:15:41 user nova-compute[74311]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='pci.0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </controller>
Oct 20 10:15:41 user nova-compute[74311]:     <controller type='ide' index='0'>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='ide'/>
Oct 20 10:15:41 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 10:15:41 user nova-compute[74311]:     </controller>
Oct 20 10:15:41 user nova-compute[74311]:     <interface type='ethernet'>
Oct 20 10:15:41 user nova-compute[74311]:       <mac address='fa:16:3e:6e:29:a6'/>
Oct 20 10:15:41 user nova-compute[74311]:       <target dev='tap465bad7c-bd'/>
Oct 20 10:15:41 user nova-compute[74311]:       <model type='virtio'/>
Oct 20 10:15:41 user nova-compute[74311]:       <mtu size='1442'/>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='net0'/>
Oct 20 10:15:41 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </interface>
Oct 20 10:15:41 user nova-compute[74311]:     <serial type='pty'>
Oct 20 10:15:41 user nova-compute[74311]:       <source path='/dev/pts/7'/>
Oct 20 10:15:41 user nova-compute[74311]:       <log file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/console.log' append='off'/>
Oct 20 10:15:41 user nova-compute[74311]:       <target type='isa-serial' port='0'>
Oct 20 10:15:41 user nova-compute[74311]:         <model name='isa-serial'/>
Oct 20 10:15:41 user nova-compute[74311]:       </target>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='serial0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </serial>
Oct 20 10:15:41 user nova-compute[74311]:     <console type='pty' tty='/dev/pts/7'>
Oct 20 10:15:41 user nova-compute[74311]:       <source path='/dev/pts/7'/>
Oct 20 10:15:41 user nova-compute[74311]:       <log file='/opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/console.log' append='off'/>
Oct 20 10:15:41 user nova-compute[74311]:       <target type='serial' port='0'/>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='serial0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </console>
Oct 20 10:15:41 user nova-compute[74311]:     <input type='mouse' bus='ps2'>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='input0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </input>
Oct 20 10:15:41 user nova-compute[74311]:     <input type='keyboard' bus='ps2'>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='input1'/>
Oct 20 10:15:41 user nova-compute[74311]:     </input>
Oct 20 10:15:41 user nova-compute[74311]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 20 10:15:41 user nova-compute[74311]:       <listen type='address' address='0.0.0.0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </graphics>
Oct 20 10:15:41 user nova-compute[74311]:     <audio id='1' type='none'/>
Oct 20 10:15:41 user nova-compute[74311]:     <video>
Oct 20 10:15:41 user nova-compute[74311]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='video0'/>
Oct 20 10:15:41 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </video>
Oct 20 10:15:41 user nova-compute[74311]:     <memballoon model='virtio'>
Oct 20 10:15:41 user nova-compute[74311]:       <stats period='10'/>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='balloon0'/>
Oct 20 10:15:41 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </memballoon>
Oct 20 10:15:41 user nova-compute[74311]:     <rng model='virtio'>
Oct 20 10:15:41 user nova-compute[74311]:       <backend model='random'>/dev/urandom</backend>
Oct 20 10:15:41 user nova-compute[74311]:       <alias name='rng0'/>
Oct 20 10:15:41 user nova-compute[74311]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 10:15:41 user nova-compute[74311]:     </rng>
Oct 20 10:15:41 user nova-compute[74311]:   </devices>
Oct 20 10:15:41 user nova-compute[74311]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 10:15:41 user nova-compute[74311]:     <label>libvirt-023498fa-b18b-4947-9b09-e9f6caafa931</label>
Oct 20 10:15:41 user nova-compute[74311]:     <imagelabel>libvirt-023498fa-b18b-4947-9b09-e9f6caafa931</imagelabel>
Oct 20 10:15:41 user nova-compute[74311]:   </seclabel>
Oct 20 10:15:41 user nova-compute[74311]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 10:15:41 user nova-compute[74311]:     <label>+64055:+108</label>
Oct 20 10:15:41 user nova-compute[74311]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 10:15:41 user nova-compute[74311]:   </seclabel>
Oct 20 10:15:41 user nova-compute[74311]: </domain>
Oct 20 10:15:41 user nova-compute[74311]:  {{(pid=74311) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 10:15:41 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Detaching interface fa:16:3e:ad:26:65 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapa5b4d272-52' not found.
Oct 20 10:15:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-683979222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-683979222',id=8,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAka0fGmXxuri5svjkz2HGnAAMwNmV/IgeCY0qqOdRgNIDrai8wjXmgODQlUjDOkNgT+vtqR0NIIR/7gHXjzK406sjo8EG1oh8DP0FT7lElr/8iMYNu2UdW9vM5ZOr2qnw==',key_name='tempest-keypair-2115206596',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16b3aaaa066740fa913e22537f799e86',ramdisk_id='',reservation_id='r-4t98aki2',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-340750198',owner_user_name='tempest-TaggedAttachmentsTest-340750198-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ba84b7bf6a7418a821a22bbd3b0569c',uuid=023498fa-b18b-4947-9b09-e9f6caafa931,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5b4d272-5273-4469-9a19-733d5bada1cc", "address": "fa:16:3e:ad:26:65", "network": {"id": "6fafdbe4-876b-4db5-8d17-ed51c90dc01a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-825674472", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b4d272-52", "ovs_interfaceid": "a5b4d272-5273-4469-9a19-733d5bada1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG nova.network.os_vif_util [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] Converting VIF {"id": "a5b4d272-5273-4469-9a19-733d5bada1cc", "address": "fa:16:3e:ad:26:65", "network": {"id": "6fafdbe4-876b-4db5-8d17-ed51c90dc01a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-825674472", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5b4d272-52", "ovs_interfaceid": "a5b4d272-5273-4469-9a19-733d5bada1cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG nova.network.os_vif_util [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:26:65,bridge_name='br-int',has_traffic_filtering=True,id=a5b4d272-5273-4469-9a19-733d5bada1cc,network=Network(6fafdbe4-876b-4db5-8d17-ed51c90dc01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b4d272-52') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG os_vif [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:26:65,bridge_name='br-int',has_traffic_filtering=True,id=a5b4d272-5273-4469-9a19-733d5bada1cc,network=Network(6fafdbe4-876b-4db5-8d17-ed51c90dc01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b4d272-52') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5b4d272-52, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:15:41 user nova-compute[74311]: INFO os_vif [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:26:65,bridge_name='br-int',has_traffic_filtering=True,id=a5b4d272-5273-4469-9a19-733d5bada1cc,network=Network(6fafdbe4-876b-4db5-8d17-ed51c90dc01a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5b4d272-52')
Oct 20 10:15:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [req-4fd762d3-f68f-4c0c-9f5d-f2a7e1a43b16 req-9b5c1978-db39-4e24-a3c7-f65079e4db10 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:15:41 user nova-compute[74311]:   <nova:package version="0.0.0"/>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:name>tempest-device-tagging-server-683979222</nova:name>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:creationTime>2023-10-20 10:15:41</nova:creationTime>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:flavor name="m1.tiny">
Oct 20 10:15:41 user nova-compute[74311]:     <nova:memory>512</nova:memory>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:disk>1</nova:disk>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:swap>0</nova:swap>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:vcpus>1</nova:vcpus>
Oct 20 10:15:41 user nova-compute[74311]:   </nova:flavor>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:owner>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:user uuid="6ba84b7bf6a7418a821a22bbd3b0569c">tempest-TaggedAttachmentsTest-340750198-project-member</nova:user>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:project uuid="16b3aaaa066740fa913e22537f799e86">tempest-TaggedAttachmentsTest-340750198</nova:project>
Oct 20 10:15:41 user nova-compute[74311]:   </nova:owner>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:15:41 user nova-compute[74311]:   <nova:ports>
Oct 20 10:15:41 user nova-compute[74311]:     <nova:port uuid="465bad7c-bd36-492a-bd18-a8fcbd8bfd42">
Oct 20 10:15:41 user nova-compute[74311]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 10:15:41 user nova-compute[74311]:     </nova:port>
Oct 20 10:15:41 user nova-compute[74311]:   </nova:ports>
Oct 20 10:15:41 user nova-compute[74311]: </nova:instance>
Oct 20 10:15:41 user nova-compute[74311]:  {{(pid=74311) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Updating instance_info_cache with network_info: [{"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Releasing lock "refresh_cache-023498fa-b18b-4947-9b09-e9f6caafa931" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:15:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08f9c82a-22ca-453a-9e67-61afeb2012c8 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "interface-023498fa-b18b-4947-9b09-e9f6caafa931-a5b4d272-5273-4469-9a19-733d5bada1cc" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.379s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "7007d024-0a3b-425c-89f5-342728c2397b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "7007d024-0a3b-425c-89f5-342728c2397b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "7007d024-0a3b-425c-89f5-342728c2397b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "7007d024-0a3b-425c-89f5-342728c2397b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "7007d024-0a3b-425c-89f5-342728c2397b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:43 user nova-compute[74311]: INFO nova.compute.manager [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Terminating instance
Oct 20 10:15:43 user nova-compute[74311]: DEBUG nova.compute.manager [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-7834ba85-a0d1-405c-96c5-52a0154383a2 req-f7337f96-739d-4b94-8fc6-cf5bc26f4e82 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Received event network-vif-unplugged-8849f33b-3838-4db8-b284-adf0d69e250e {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7834ba85-a0d1-405c-96c5-52a0154383a2 req-f7337f96-739d-4b94-8fc6-cf5bc26f4e82 service nova] Acquiring lock "7007d024-0a3b-425c-89f5-342728c2397b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7834ba85-a0d1-405c-96c5-52a0154383a2 req-f7337f96-739d-4b94-8fc6-cf5bc26f4e82 service nova] Lock "7007d024-0a3b-425c-89f5-342728c2397b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7834ba85-a0d1-405c-96c5-52a0154383a2 req-f7337f96-739d-4b94-8fc6-cf5bc26f4e82 service nova] Lock "7007d024-0a3b-425c-89f5-342728c2397b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-7834ba85-a0d1-405c-96c5-52a0154383a2 req-f7337f96-739d-4b94-8fc6-cf5bc26f4e82 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] No waiting events found dispatching network-vif-unplugged-8849f33b-3838-4db8-b284-adf0d69e250e {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-7834ba85-a0d1-405c-96c5-52a0154383a2 req-f7337f96-739d-4b94-8fc6-cf5bc26f4e82 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Received event network-vif-unplugged-8849f33b-3838-4db8-b284-adf0d69e250e for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:43 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Instance destroyed successfully.
Oct 20 10:15:43 user nova-compute[74311]: DEBUG nova.objects.instance [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lazy-loading 'resources' on Instance uuid 7007d024-0a3b-425c-89f5-342728c2397b {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:13:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1254043393',display_name='tempest-ServersNegativeTestJSON-server-1254043393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1254043393',id=12,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:13:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbc9455e6a754bafb33349644f579988',ramdisk_id='',reservation_id='r-8a7cv3f1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1307260612',owner_user_name='tempest-ServersNegativeTestJSON-1307260612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:14:00Z,user_data=None,user_id='6c40e8a363dd4eaf862c0b61de171130',uuid=7007d024-0a3b-425c-89f5-342728c2397b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8849f33b-3838-4db8-b284-adf0d69e250e", "address": "fa:16:3e:67:f7:8a", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8849f33b-38", "ovs_interfaceid": "8849f33b-3838-4db8-b284-adf0d69e250e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Converting VIF {"id": "8849f33b-3838-4db8-b284-adf0d69e250e", "address": "fa:16:3e:67:f7:8a", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8849f33b-38", "ovs_interfaceid": "8849f33b-3838-4db8-b284-adf0d69e250e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:f7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8849f33b-3838-4db8-b284-adf0d69e250e,network=Network(5253925b-fda9-426d-8a82-bc8924961ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8849f33b-38') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG os_vif [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:f7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8849f33b-3838-4db8-b284-adf0d69e250e,network=Network(5253925b-fda9-426d-8a82-bc8924961ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8849f33b-38') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8849f33b-38, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b39f6d7-dfb9-42a2-847f-130a648b7bec) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:15:43 user nova-compute[74311]: INFO os_vif [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:f7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8849f33b-3838-4db8-b284-adf0d69e250e,network=Network(5253925b-fda9-426d-8a82-bc8924961ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8849f33b-38')
Oct 20 10:15:43 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Deleting instance files /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b_del
Oct 20 10:15:43 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Deletion of /opt/stack/data/nova/instances/7007d024-0a3b-425c-89f5-342728c2397b_del complete
Oct 20 10:15:43 user nova-compute[74311]: INFO nova.compute.manager [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Took 0.64 seconds to destroy the instance on the hypervisor.
Oct 20 10:15:43 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:15:43 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:15:44 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:15:44 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Took 0.58 seconds to deallocate network for instance.
Oct 20 10:15:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-2de00062-128a-4fe9-9708-edb58af9cc02 req-2189bf8d-74c7-41a1-9487-c2262aa8cb91 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Received event network-vif-deleted-8849f33b-3838-4db8-b284-adf0d69e250e {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:44 user nova-compute[74311]: INFO nova.compute.manager [req-2de00062-128a-4fe9-9708-edb58af9cc02 req-2189bf8d-74c7-41a1-9487-c2262aa8cb91 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Neutron deleted interface 8849f33b-3838-4db8-b284-adf0d69e250e; detaching it from the instance and deleting it from the info cache
Oct 20 10:15:44 user nova-compute[74311]: DEBUG nova.network.neutron [req-2de00062-128a-4fe9-9708-edb58af9cc02 req-2189bf8d-74c7-41a1-9487-c2262aa8cb91 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:15:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-2de00062-128a-4fe9-9708-edb58af9cc02 req-2189bf8d-74c7-41a1-9487-c2262aa8cb91 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Detach interface failed, port_id=8849f33b-3838-4db8-b284-adf0d69e250e, reason: Instance 7007d024-0a3b-425c-89f5-342728c2397b could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:15:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:44 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:15:44 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:15:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:44 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Deleted allocations for instance 7007d024-0a3b-425c-89f5-342728c2397b
Oct 20 10:15:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3303991b-23b1-45bc-a58e-1102336349e0 tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "7007d024-0a3b-425c-89f5-342728c2397b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.795s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-2092acae-ac71-448c-8dc6-968f25febbdb req-577f1bda-e0c2-4161-93eb-d9e6e7e66f48 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Received event network-vif-plugged-8849f33b-3838-4db8-b284-adf0d69e250e {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2092acae-ac71-448c-8dc6-968f25febbdb req-577f1bda-e0c2-4161-93eb-d9e6e7e66f48 service nova] Acquiring lock "7007d024-0a3b-425c-89f5-342728c2397b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2092acae-ac71-448c-8dc6-968f25febbdb req-577f1bda-e0c2-4161-93eb-d9e6e7e66f48 service nova] Lock "7007d024-0a3b-425c-89f5-342728c2397b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2092acae-ac71-448c-8dc6-968f25febbdb req-577f1bda-e0c2-4161-93eb-d9e6e7e66f48 service nova] Lock "7007d024-0a3b-425c-89f5-342728c2397b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-2092acae-ac71-448c-8dc6-968f25febbdb req-577f1bda-e0c2-4161-93eb-d9e6e7e66f48 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] No waiting events found dispatching network-vif-plugged-8849f33b-3838-4db8-b284-adf0d69e250e {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:15:45 user nova-compute[74311]: WARNING nova.compute.manager [req-2092acae-ac71-448c-8dc6-968f25febbdb req-577f1bda-e0c2-4161-93eb-d9e6e7e66f48 service nova] [instance: 7007d024-0a3b-425c-89f5-342728c2397b] Received unexpected event network-vif-plugged-8849f33b-3838-4db8-b284-adf0d69e250e for instance with vm_state deleted and task_state None.
Oct 20 10:15:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.objects.instance [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lazy-loading 'flavor' on Instance uuid 12bfda49-ce9d-4806-a982-08ce670faeb6 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-46ce2801-206e-48c8-bfa1-369c49ae660c tempest-VolumesAssistedSnapshotsTest-2090319931 tempest-VolumesAssistedSnapshotsTest-2090319931-project-admin] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 38.411s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.compute.manager [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGFkOUtV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd5d019ce-3f5d-422c-b278-2b3cb3fd594a', 'attached_at': '', 'detached_at': '', 'volume_id': '13fca40a-d3b1-4d16-860b-9ddf99381bc8', 'serial': '13fca40a-d3b1-4d16-860b-9ddf99381bc8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irFMbDQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'd5d019ce-3f5d-422c-b278-2b3cb3fd594a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 'serial'} {{(pid=74311) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGFkOUtV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:15:50 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:15:50 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:15:50 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7311a9d2-4324-4a84-a404-cd0fea70edcf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:15:50 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dbf590-95cd-4f97-aa53-ffaacfc263fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8] added
Oct 20 10:15:50 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38d66a2-ae5c-403d-b61b-6f4933dc82c2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe3ddcb-11b3-4c6b-b59e-ae25d2893d37]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGFkOUtV {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.compute.manager [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:15:50 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Creating image(s)
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Ensure instance console log exists: /opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Start _get_guest_xml network_info=[{"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'afaa0011-45c9-48c7-a1c0-18dabf75b602', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTUvAacR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cfc97865-6f94-4924-afc5-188d50543672', 'attached_at': '', 'detached_at': '', 'volume_id': '90e3e67e-92d0-4f73-992a-d967eafa7bfa', 'serial': '90e3e67e-92d0-4f73-992a-d967eafa7bfa'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGFkOUtV" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc614b2b-c545-4c25-93e4-1b2cb5a50936]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vGFkOUtV'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:50 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:15:50 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTUvAacR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:15:50 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f77eb8-4cd2-4983-9a35-b71981e55863]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff858e7f-6bb7-4e50-9a4e-d7da4b06594c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:50 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:50 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:50 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:50 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:50 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:50 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:50 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:50 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d023029b-e2a4-412f-8c52-44a7db8e001b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8, portal: 172.16.0.220,3260]
Oct 20 10:15:50 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8, portal: 172.16.0.220,3260] successful.
Oct 20 10:15:50 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d026d8-2811-4a9a-a8f1-a404e94fe144]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce603911-d735-4ebf-aca8-de5bcd4b1850]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:15:50 user nova-compute[74311]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:50 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:50 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:50 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:50 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:15:50 user nova-compute[74311]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:50 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:50 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:50 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:50 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[517193c7-2085-45b0-ba6d-415dc2e2a364]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:15:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGFkOUtV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:15:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "c8e0cb34-d304-4405-862f-a4118e729083" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "c8e0cb34-d304-4405-862f-a4118e729083" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:15:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:51 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:15:51 user nova-compute[74311]: INFO nova.compute.claims [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Claim successful on node user
Oct 20 10:15:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:15:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23666663864646564', 'path': '/dev/sde'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:15:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666663864646564', 'path': '/dev/sde'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:15:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.193s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:15:51 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:15:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:15:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:15:51 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:15:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:51 user nova-compute[74311]: DEBUG nova.objects.instance [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lazy-loading 'flavor' on Instance uuid d5d019ce-3f5d-422c-b278-2b3cb3fd594a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7db47f7-d4a4-43e3-8fe7-3d86e667269a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:15:52 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a23210-d43c-4744-9f42-e67fa8adb535]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa] added
Oct 20 10:15:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cd63da-84ec-40ca-ae5e-ef2383673267]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bec649-f77f-4224-90a0-ffb8a05bd77b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gTUvAacR {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gTUvAacR" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af4439d-41d2-4885-bde6-a128c8feee40]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gTUvAacR'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e17fbb-4808-4bd1-89dd-8e8ba3541484]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c8439f-7466-47cf-85d8-94c58604cfcf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4f172d-e13b-4fd3-87df-9579f6d0b1c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa, portal: 172.16.0.220,3260]
Oct 20 10:15:52 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa, portal: 172.16.0.220,3260] successful.
Oct 20 10:15:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f373e505-6d14-4548-b155-b798e9fcddaa]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd0faf0-4d15-4b85-b693-a3c6ad724ed7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:52 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c2f353-3d6b-4264-8b69-c7c2f7295655]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTUvAacR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG nova.network.neutron [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:15:52 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:15:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG nova.policy [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f53d41e3e16e47198a9a0381fd683244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6afc4c55cdc4c01ab172638b262a976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:15:52 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Creating image(s)
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "/opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "/opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.224s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 131072000 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.224s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk 1073741824" returned: 0 in 0.105s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.network.neutron [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Successfully created port: f83fd133-2cf9-4f2e-a6fe-944d7adc094a {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] <== connect_volume: return (2554ms) {'type': 'block', 'scsi_wwn': '23838386161353834', 'path': '/dev/sdf'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838386161353834', 'path': '/dev/sdf'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1074257695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1074257695',id=13,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090bd6a8a14d4a308e67be7a12e47ae6',ramdisk_id='',reservation_id='r-3t7g0pln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:15:03Z,user_data=None,user_id='0c6b76de1f054ca0973f2f9ba2eafaed',uuid=cfc97865-6f94-4924-afc5-188d50543672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converting VIF {"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:59:4e,bridge_name='br-int',has_traffic_filtering=True,id=2e1b0047-2f93-4f83-a6e7-514659a2faae,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1b0047-2f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.objects.instance [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'pci_devices' on Instance uuid cfc97865-6f94-4924-afc5-188d50543672 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:15:53 user nova-compute[74311]:   <uuid>cfc97865-6f94-4924-afc5-188d50543672</uuid>
Oct 20 10:15:53 user nova-compute[74311]:   <name>instance-0000000d</name>
Oct 20 10:15:53 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:15:53 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:15:53 user nova-compute[74311]:   <metadata>
Oct 20 10:15:53 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:15:53 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:15:53 user nova-compute[74311]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1074257695</nova:name>
Oct 20 10:15:53 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:15:50</nova:creationTime>
Oct 20 10:15:53 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:15:53 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:15:53 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:15:53 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:15:53 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:15:53 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:15:53 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:15:53 user nova-compute[74311]:       <nova:owner>
Oct 20 10:15:53 user nova-compute[74311]:         <nova:user uuid="0c6b76de1f054ca0973f2f9ba2eafaed">tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member</nova:user>
Oct 20 10:15:53 user nova-compute[74311]:         <nova:project uuid="090bd6a8a14d4a308e67be7a12e47ae6">tempest-ServerBootFromVolumeStableRescueTest-2019341345</nova:project>
Oct 20 10:15:53 user nova-compute[74311]:       </nova:owner>
Oct 20 10:15:53 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:15:53 user nova-compute[74311]:       <nova:ports>
Oct 20 10:15:53 user nova-compute[74311]:         <nova:port uuid="2e1b0047-2f93-4f83-a6e7-514659a2faae">
Oct 20 10:15:53 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 10:15:53 user nova-compute[74311]:         </nova:port>
Oct 20 10:15:53 user nova-compute[74311]:       </nova:ports>
Oct 20 10:15:53 user nova-compute[74311]:     </nova:instance>
Oct 20 10:15:53 user nova-compute[74311]:   </metadata>
Oct 20 10:15:53 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:15:53 user nova-compute[74311]:     <system>
Oct 20 10:15:53 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:15:53 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:15:53 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:15:53 user nova-compute[74311]:       <entry name="serial">cfc97865-6f94-4924-afc5-188d50543672</entry>
Oct 20 10:15:53 user nova-compute[74311]:       <entry name="uuid">cfc97865-6f94-4924-afc5-188d50543672</entry>
Oct 20 10:15:53 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:15:53 user nova-compute[74311]:     </system>
Oct 20 10:15:53 user nova-compute[74311]:   </sysinfo>
Oct 20 10:15:53 user nova-compute[74311]:   <os>
Oct 20 10:15:53 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:15:53 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:15:53 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:15:53 user nova-compute[74311]:   </os>
Oct 20 10:15:53 user nova-compute[74311]:   <features>
Oct 20 10:15:53 user nova-compute[74311]:     <acpi/>
Oct 20 10:15:53 user nova-compute[74311]:     <apic/>
Oct 20 10:15:53 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:15:53 user nova-compute[74311]:   </features>
Oct 20 10:15:53 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:15:53 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:15:53 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:15:53 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:15:53 user nova-compute[74311]:   </clock>
Oct 20 10:15:53 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:15:53 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:15:53 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:15:53 user nova-compute[74311]:   </cpu>
Oct 20 10:15:53 user nova-compute[74311]:   <devices>
Oct 20 10:15:53 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:15:53 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:15:53 user nova-compute[74311]:       <source dev="/dev/sdf"/>
Oct 20 10:15:53 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:15:53 user nova-compute[74311]:       <serial>90e3e67e-92d0-4f73-992a-d967eafa7bfa</serial>
Oct 20 10:15:53 user nova-compute[74311]:     </disk>
Oct 20 10:15:53 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:15:53 user nova-compute[74311]:       <mac address="fa:16:3e:2d:59:4e"/>
Oct 20 10:15:53 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:15:53 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:15:53 user nova-compute[74311]:       <target dev="tap2e1b0047-2f"/>
Oct 20 10:15:53 user nova-compute[74311]:     </interface>
Oct 20 10:15:53 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:15:53 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/console.log" append="off"/>
Oct 20 10:15:53 user nova-compute[74311]:     </serial>
Oct 20 10:15:53 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:15:53 user nova-compute[74311]:     <video>
Oct 20 10:15:53 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:15:53 user nova-compute[74311]:     </video>
Oct 20 10:15:53 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:15:53 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:15:53 user nova-compute[74311]:     </rng>
Oct 20 10:15:53 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:15:53 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:15:53 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:15:53 user nova-compute[74311]:     </memballoon>
Oct 20 10:15:53 user nova-compute[74311]:   </devices>
Oct 20 10:15:53 user nova-compute[74311]: </domain>
Oct 20 10:15:53 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1074257695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1074257695',id=13,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090bd6a8a14d4a308e67be7a12e47ae6',ramdisk_id='',reservation_id='r-3t7g0pln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:15:03Z,user_data=None,user_id='0c6b76de1f054ca0973f2f9ba2eafaed',uuid=cfc97865-6f94-4924-afc5-188d50543672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converting VIF {"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:59:4e,bridge_name='br-int',has_traffic_filtering=True,id=2e1b0047-2f93-4f83-a6e7-514659a2faae,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1b0047-2f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG os_vif [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:59:4e,bridge_name='br-int',has_traffic_filtering=True,id=2e1b0047-2f93-4f83-a6e7-514659a2faae,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1b0047-2f') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44a778be-10e6-5279-9a75-edfa7fd510e9', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e1b0047-2f, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e1b0047-2f, col_values=(('qos', UUID('1851655d-13e0-45ad-b1a5-c2b578f59403')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e1b0047-2f, col_values=(('external_ids', {'iface-id': '2e1b0047-2f93-4f83-a6e7-514659a2faae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:59:4e', 'vm-uuid': 'cfc97865-6f94-4924-afc5-188d50543672'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 309329920 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.258s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:53 user nova-compute[74311]: INFO os_vif [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:59:4e,bridge_name='br-int',has_traffic_filtering=True,id=2e1b0047-2f93-4f83-a6e7-514659a2faae,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1b0047-2f')
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] No VIF found with MAC fa:16:3e:2d:59:4e, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Cannot resize image /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Ensure instance console log exists: /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 400556032 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Successfully updated port: f83fd133-2cf9-4f2e-a6fe-944d7adc094a {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "refresh_cache-c8e0cb34-d304-4405-862f-a4118e729083" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquired lock "refresh_cache-c8e0cb34-d304-4405-862f-a4118e729083" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-ef64c9df-c6a0-4897-a334-8391f4356f8d req-08e3c8d4-6f80-4ece-927d-5e8602e4b6a2 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Received event network-changed-f83fd133-2cf9-4f2e-a6fe-944d7adc094a {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-ef64c9df-c6a0-4897-a334-8391f4356f8d req-08e3c8d4-6f80-4ece-927d-5e8602e4b6a2 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Refreshing instance network info cache due to event network-changed-f83fd133-2cf9-4f2e-a6fe-944d7adc094a. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ef64c9df-c6a0-4897-a334-8391f4356f8d req-08e3c8d4-6f80-4ece-927d-5e8602e4b6a2 service nova] Acquiring lock "refresh_cache-c8e0cb34-d304-4405-862f-a4118e729083" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 523239424 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Updating instance_info_cache with network_info: [{"id": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "address": "fa:16:3e:94:04:66", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83fd133-2c", "ovs_interfaceid": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Releasing lock "refresh_cache-c8e0cb34-d304-4405-862f-a4118e729083" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.compute.manager [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Instance network_info: |[{"id": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "address": "fa:16:3e:94:04:66", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83fd133-2c", "ovs_interfaceid": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ef64c9df-c6a0-4897-a334-8391f4356f8d req-08e3c8d4-6f80-4ece-927d-5e8602e4b6a2 service nova] Acquired lock "refresh_cache-c8e0cb34-d304-4405-862f-a4118e729083" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.network.neutron [req-ef64c9df-c6a0-4897-a334-8391f4356f8d req-08e3c8d4-6f80-4ece-927d-5e8602e4b6a2 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Refreshing network info cache for port f83fd133-2cf9-4f2e-a6fe-944d7adc094a {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Start _get_guest_xml network_info=[{"id": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "address": "fa:16:3e:94:04:66", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83fd133-2c", "ovs_interfaceid": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:15:54 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:15:54 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:15:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2095550517',display_name='tempest-VolumesAdminNegativeTest-server-2095550517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2095550517',id=14,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6afc4c55cdc4c01ab172638b262a976',ramdisk_id='',reservation_id='r-pexsdnug',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-230171363',owner_user_name='tempest-VolumesAdminNegativeTest-230171363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:15:53Z,user_data=None,user_id='f53d41e3e16e47198a9a0381fd683244',uuid=c8e0cb34-d304-4405-862f-a4118e729083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "address": "fa:16:3e:94:04:66", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83fd133-2c", "ovs_interfaceid": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Converting VIF {"id": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "address": "fa:16:3e:94:04:66", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83fd133-2c", "ovs_interfaceid": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:04:66,bridge_name='br-int',has_traffic_filtering=True,id=f83fd133-2cf9-4f2e-a6fe-944d7adc094a,network=Network(b8fa77f6-0c71-4754-a562-9f147defb87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83fd133-2c') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.objects.instance [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lazy-loading 'pci_devices' on Instance uuid c8e0cb34-d304-4405-862f-a4118e729083 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:15:54 user nova-compute[74311]:   <uuid>c8e0cb34-d304-4405-862f-a4118e729083</uuid>
Oct 20 10:15:54 user nova-compute[74311]:   <name>instance-0000000e</name>
Oct 20 10:15:54 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:15:54 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:15:54 user nova-compute[74311]:   <metadata>
Oct 20 10:15:54 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:15:54 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:15:54 user nova-compute[74311]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2095550517</nova:name>
Oct 20 10:15:54 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:15:54</nova:creationTime>
Oct 20 10:15:54 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:15:54 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:15:54 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:15:54 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:15:54 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:15:54 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:15:54 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:15:54 user nova-compute[74311]:       <nova:owner>
Oct 20 10:15:54 user nova-compute[74311]:         <nova:user uuid="f53d41e3e16e47198a9a0381fd683244">tempest-VolumesAdminNegativeTest-230171363-project-member</nova:user>
Oct 20 10:15:54 user nova-compute[74311]:         <nova:project uuid="b6afc4c55cdc4c01ab172638b262a976">tempest-VolumesAdminNegativeTest-230171363</nova:project>
Oct 20 10:15:54 user nova-compute[74311]:       </nova:owner>
Oct 20 10:15:54 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:15:54 user nova-compute[74311]:       <nova:ports>
Oct 20 10:15:54 user nova-compute[74311]:         <nova:port uuid="f83fd133-2cf9-4f2e-a6fe-944d7adc094a">
Oct 20 10:15:54 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 10:15:54 user nova-compute[74311]:         </nova:port>
Oct 20 10:15:54 user nova-compute[74311]:       </nova:ports>
Oct 20 10:15:54 user nova-compute[74311]:     </nova:instance>
Oct 20 10:15:54 user nova-compute[74311]:   </metadata>
Oct 20 10:15:54 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:15:54 user nova-compute[74311]:     <system>
Oct 20 10:15:54 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:15:54 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:15:54 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:15:54 user nova-compute[74311]:       <entry name="serial">c8e0cb34-d304-4405-862f-a4118e729083</entry>
Oct 20 10:15:54 user nova-compute[74311]:       <entry name="uuid">c8e0cb34-d304-4405-862f-a4118e729083</entry>
Oct 20 10:15:54 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:15:54 user nova-compute[74311]:     </system>
Oct 20 10:15:54 user nova-compute[74311]:   </sysinfo>
Oct 20 10:15:54 user nova-compute[74311]:   <os>
Oct 20 10:15:54 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:15:54 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:15:54 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:15:54 user nova-compute[74311]:   </os>
Oct 20 10:15:54 user nova-compute[74311]:   <features>
Oct 20 10:15:54 user nova-compute[74311]:     <acpi/>
Oct 20 10:15:54 user nova-compute[74311]:     <apic/>
Oct 20 10:15:54 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:15:54 user nova-compute[74311]:   </features>
Oct 20 10:15:54 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:15:54 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:15:54 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:15:54 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:15:54 user nova-compute[74311]:   </clock>
Oct 20 10:15:54 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:15:54 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:15:54 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:15:54 user nova-compute[74311]:   </cpu>
Oct 20 10:15:54 user nova-compute[74311]:   <devices>
Oct 20 10:15:54 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:15:54 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:15:54 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk"/>
Oct 20 10:15:54 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:15:54 user nova-compute[74311]:     </disk>
Oct 20 10:15:54 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:15:54 user nova-compute[74311]:       <mac address="fa:16:3e:94:04:66"/>
Oct 20 10:15:54 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:15:54 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:15:54 user nova-compute[74311]:       <target dev="tapf83fd133-2c"/>
Oct 20 10:15:54 user nova-compute[74311]:     </interface>
Oct 20 10:15:54 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:15:54 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/console.log" append="off"/>
Oct 20 10:15:54 user nova-compute[74311]:     </serial>
Oct 20 10:15:54 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:15:54 user nova-compute[74311]:     <video>
Oct 20 10:15:54 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:15:54 user nova-compute[74311]:     </video>
Oct 20 10:15:54 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:15:54 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:15:54 user nova-compute[74311]:     </rng>
Oct 20 10:15:54 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:15:54 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:15:54 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:15:54 user nova-compute[74311]:     </memballoon>
Oct 20 10:15:54 user nova-compute[74311]:   </devices>
Oct 20 10:15:54 user nova-compute[74311]: </domain>
Oct 20 10:15:54 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:15:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2095550517',display_name='tempest-VolumesAdminNegativeTest-server-2095550517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2095550517',id=14,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6afc4c55cdc4c01ab172638b262a976',ramdisk_id='',reservation_id='r-pexsdnug',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-230171363',owner_user_name='tempest-VolumesAdminNegativeTest-230171363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:15:53Z,user_data=None,user_id='f53d41e3e16e47198a9a0381fd683244',uuid=c8e0cb34-d304-4405-862f-a4118e729083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "address": "fa:16:3e:94:04:66", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83fd133-2c", "ovs_interfaceid": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Converting VIF {"id": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "address": "fa:16:3e:94:04:66", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83fd133-2c", "ovs_interfaceid": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:04:66,bridge_name='br-int',has_traffic_filtering=True,id=f83fd133-2cf9-4f2e-a6fe-944d7adc094a,network=Network(b8fa77f6-0c71-4754-a562-9f147defb87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83fd133-2c') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG os_vif [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:04:66,bridge_name='br-int',has_traffic_filtering=True,id=f83fd133-2cf9-4f2e-a6fe-944d7adc094a,network=Network(b8fa77f6-0c71-4754-a562-9f147defb87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83fd133-2c') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e3323d7-8388-58e1-8d11-52bc8e6bdcc0', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf83fd133-2c, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf83fd133-2c, col_values=(('qos', UUID('ae305868-c857-4389-a0ab-de0d73fda243')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf83fd133-2c, col_values=(('external_ids', {'iface-id': 'f83fd133-2cf9-4f2e-a6fe-944d7adc094a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:04:66', 'vm-uuid': 'c8e0cb34-d304-4405-862f-a4118e729083'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:15:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:54 user nova-compute[74311]: INFO os_vif [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:04:66,bridge_name='br-int',has_traffic_filtering=True,id=f83fd133-2cf9-4f2e-a6fe-944d7adc094a,network=Network(b8fa77f6-0c71-4754-a562-9f147defb87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83fd133-2c')
Oct 20 10:15:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 633339904 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:15:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:15:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] No VIF found with MAC fa:16:3e:94:04:66, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:15:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:55 user nova-compute[74311]: DEBUG nova.network.neutron [req-ef64c9df-c6a0-4897-a334-8391f4356f8d req-08e3c8d4-6f80-4ece-927d-5e8602e4b6a2 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Updated VIF entry in instance network info cache for port f83fd133-2cf9-4f2e-a6fe-944d7adc094a. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:15:55 user nova-compute[74311]: DEBUG nova.network.neutron [req-ef64c9df-c6a0-4897-a334-8391f4356f8d req-08e3c8d4-6f80-4ece-927d-5e8602e4b6a2 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Updating instance_info_cache with network_info: [{"id": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "address": "fa:16:3e:94:04:66", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83fd133-2c", "ovs_interfaceid": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:15:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ef64c9df-c6a0-4897-a334-8391f4356f8d req-08e3c8d4-6f80-4ece-927d-5e8602e4b6a2 service nova] Releasing lock "refresh_cache-c8e0cb34-d304-4405-862f-a4118e729083" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:15:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 770703360 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:15:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 903872512 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:15:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-129d5b08-4bee-4fbc-9d31-4fee77be1629 req-5f1a1866-8c6c-4471-acf8-55ef87e0497c service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-129d5b08-4bee-4fbc-9d31-4fee77be1629 req-5f1a1866-8c6c-4471-acf8-55ef87e0497c service nova] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-129d5b08-4bee-4fbc-9d31-4fee77be1629 req-5f1a1866-8c6c-4471-acf8-55ef87e0497c service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-129d5b08-4bee-4fbc-9d31-4fee77be1629 req-5f1a1866-8c6c-4471-acf8-55ef87e0497c service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-129d5b08-4bee-4fbc-9d31-4fee77be1629 req-5f1a1866-8c6c-4471-acf8-55ef87e0497c service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] No waiting events found dispatching network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:15:56 user nova-compute[74311]: WARNING nova.compute.manager [req-129d5b08-4bee-4fbc-9d31-4fee77be1629 req-5f1a1866-8c6c-4471-acf8-55ef87e0497c service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received unexpected event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae for instance with vm_state building and task_state spawning.
Oct 20 10:15:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-129d5b08-4bee-4fbc-9d31-4fee77be1629 req-5f1a1866-8c6c-4471-acf8-55ef87e0497c service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-129d5b08-4bee-4fbc-9d31-4fee77be1629 req-5f1a1866-8c6c-4471-acf8-55ef87e0497c service nova] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-129d5b08-4bee-4fbc-9d31-4fee77be1629 req-5f1a1866-8c6c-4471-acf8-55ef87e0497c service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-129d5b08-4bee-4fbc-9d31-4fee77be1629 req-5f1a1866-8c6c-4471-acf8-55ef87e0497c service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-129d5b08-4bee-4fbc-9d31-4fee77be1629 req-5f1a1866-8c6c-4471-acf8-55ef87e0497c service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] No waiting events found dispatching network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:15:56 user nova-compute[74311]: WARNING nova.compute.manager [req-129d5b08-4bee-4fbc-9d31-4fee77be1629 req-5f1a1866-8c6c-4471-acf8-55ef87e0497c service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received unexpected event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae for instance with vm_state building and task_state spawning.
Oct 20 10:15:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 1007681536 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:15:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG nova.compute.manager [req-9030a371-d309-4a7e-84e3-9ae7288b4eb4 req-5f109e24-cbd8-4418-8f74-18f4e9d417c6 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Received event network-vif-plugged-f83fd133-2cf9-4f2e-a6fe-944d7adc094a {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9030a371-d309-4a7e-84e3-9ae7288b4eb4 req-5f109e24-cbd8-4418-8f74-18f4e9d417c6 service nova] Acquiring lock "c8e0cb34-d304-4405-862f-a4118e729083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9030a371-d309-4a7e-84e3-9ae7288b4eb4 req-5f109e24-cbd8-4418-8f74-18f4e9d417c6 service nova] Lock "c8e0cb34-d304-4405-862f-a4118e729083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9030a371-d309-4a7e-84e3-9ae7288b4eb4 req-5f109e24-cbd8-4418-8f74-18f4e9d417c6 service nova] Lock "c8e0cb34-d304-4405-862f-a4118e729083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG nova.compute.manager [req-9030a371-d309-4a7e-84e3-9ae7288b4eb4 req-5f109e24-cbd8-4418-8f74-18f4e9d417c6 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] No waiting events found dispatching network-vif-plugged-f83fd133-2cf9-4f2e-a6fe-944d7adc094a {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:15:57 user nova-compute[74311]: WARNING nova.compute.manager [req-9030a371-d309-4a7e-84e3-9ae7288b4eb4 req-5f109e24-cbd8-4418-8f74-18f4e9d417c6 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Received unexpected event network-vif-plugged-f83fd133-2cf9-4f2e-a6fe-944d7adc094a for instance with vm_state building and task_state spawning.
Oct 20 10:15:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG nova.compute.manager [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irFMbDQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:15:57 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bff41c1-eda5-4f95-96e8-ec0f93c5737a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:15:57 user nova-compute[74311]: No targets found.
Oct 20 10:15:57 user nova-compute[74311]: iSNS:
Oct 20 10:15:57 user nova-compute[74311]: No targets found.
Oct 20 10:15:57 user nova-compute[74311]: STATIC:
Oct 20 10:15:57 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77
Oct 20 10:15:57 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:57 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:57 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:15:57 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:57 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:57 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16
Oct 20 10:15:57 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:57 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:57 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8
Oct 20 10:15:57 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:57 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:57 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055
Oct 20 10:15:57 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:57 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:57 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c
Oct 20 10:15:57 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:15:57 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:15:57 user nova-compute[74311]: FIRMWARE:
Oct 20 10:15:57 user nova-compute[74311]: No targets found.
Oct 20 10:15:57 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:15:57 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:15:57 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2348763c-8524-409d-bf37-c0a96509bdd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:15:57 user nova-compute[74311]: INFO nova.compute.claims [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Claim successful on node user
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[88140cf0-7d82-48f7-8d18-908ccbeb7e8f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:15:57 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:15:57 user nova-compute[74311]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:57 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:57 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:57 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:57 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:15:57 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:15:57 user nova-compute[74311]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:15:57 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:15:57 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:15:57 user nova-compute[74311]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:15:57 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1b50dba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c'): ({'sdi'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Removing single pathed devices sdi {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a866b1-ad14-46db-a268-ce7954c8bab1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7447f3a1-88dd-42a5-8af9-b9507a2d5ad2]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Flushing IO for device /dev/sdi {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d6ee3b-d505-497e-8f75-a23299fb5e7e]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.056s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd34caa-46f2-4121-bb79-fea618147fb0]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] SCSI volumes sdi have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb17aef-723a-4111-8496-b7328e26f86c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b597f5-6e2d-4a5a-b61e-71b0dd93e7de]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260]
Oct 20 10:15:57 user nova-compute[74311]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260] successful.
Oct 20 10:15:57 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[36848994-8142-47e2-8e3f-77baad8d190a]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] <== disconnect_volume: return (393ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:15:57 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.compute.manager [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGFkOUtV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'd5d019ce-3f5d-422c-b278-2b3cb3fd594a', 'attached_at': '', 'detached_at': '', 'volume_id': '13fca40a-d3b1-4d16-860b-9ddf99381bc8', 'serial'} {{(pid=74311) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.compute.manager [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] swap_volume: removing Cinder connection for volume a4c94db1-73ff-4a10-a63d-6fed1bf2f53c {{(pid=74311) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.compute.manager [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.compute.manager [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.network.neutron [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:15:58 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.compute.manager [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.objects.instance [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lazy-loading 'flavor' on Instance uuid 2fed360b-584a-4e1a-8e27-9189de7f5007 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.policy [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5eb8db6bee87451f95e4bfdc61854bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f61456f02bc4688b8cd9d66a2b1868d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.compute.manager [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:15:58 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Creating image(s)
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "/opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "/opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "/opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:58 user nova-compute[74311]: INFO nova.compute.manager [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Attaching volume 5a032ca5-d6bb-4766-93df-a1109b708ff5 to /dev/vdb
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG os_brick.utils [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0da6f24-9032-47c1-89b4-2fbfebf71cbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.230s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b097d6e0-b055-41f8-b97d-277696a287c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cfde35-21c5-459f-a459-d6f126838a09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c19ad4-4408-420b-80c9-176853f158ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:15:58 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c64344f-9bff-4bdf-909b-b2ad3fc513f4]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG os_brick.utils [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating existing volume attachment record: 7c3e6460-c75c-4bed-a30c-614247291638 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk 1073741824" returned: 0 in 0.062s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:15:59 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: cfc97865-6f94-4924-afc5-188d50543672] Instance spawned successfully.
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.217s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:15:59 user nova-compute[74311]: INFO nova.compute.manager [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Took 8.53 seconds to spawn the instance on the hypervisor.
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-99f1906b-0cc4-474e-a767-a53b072996e5 req-b2ebb5ac-f933-4796-9534-9eaf53c48140 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Received event network-vif-plugged-f83fd133-2cf9-4f2e-a6fe-944d7adc094a {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-99f1906b-0cc4-474e-a767-a53b072996e5 req-b2ebb5ac-f933-4796-9534-9eaf53c48140 service nova] Acquiring lock "c8e0cb34-d304-4405-862f-a4118e729083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-99f1906b-0cc4-474e-a767-a53b072996e5 req-b2ebb5ac-f933-4796-9534-9eaf53c48140 service nova] Lock "c8e0cb34-d304-4405-862f-a4118e729083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-99f1906b-0cc4-474e-a767-a53b072996e5 req-b2ebb5ac-f933-4796-9534-9eaf53c48140 service nova] Lock "c8e0cb34-d304-4405-862f-a4118e729083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-99f1906b-0cc4-474e-a767-a53b072996e5 req-b2ebb5ac-f933-4796-9534-9eaf53c48140 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] No waiting events found dispatching network-vif-plugged-f83fd133-2cf9-4f2e-a6fe-944d7adc094a {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:15:59 user nova-compute[74311]: WARNING nova.compute.manager [req-99f1906b-0cc4-474e-a767-a53b072996e5 req-b2ebb5ac-f933-4796-9534-9eaf53c48140 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Received unexpected event network-vif-plugged-f83fd133-2cf9-4f2e-a6fe-944d7adc094a for instance with vm_state building and task_state spawning.
Oct 20 10:15:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Cannot resize image /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Ensure instance console log exists: /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.network.neutron [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Successfully created port: 5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:15:59 user nova-compute[74311]: INFO nova.compute.manager [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Took 57.41 seconds to build instance.
Oct 20 10:15:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-621a89e3-0731-4f75-94a1-b6a0c3b19caf tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "cfc97865-6f94-4924-afc5-188d50543672" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 57.537s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:15:59 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Instance spawned successfully.
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:15:59 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Updating instance_info_cache with network_info: [{"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:16:00 user nova-compute[74311]: INFO nova.compute.manager [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Took 7.39 seconds to spawn the instance on the hypervisor.
Oct 20 10:16:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:16:00 user nova-compute[74311]: INFO nova.compute.manager [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Took 8.54 seconds to build instance.
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-59fe4e3a-2a9c-453f-b92a-dbb943a11ea1 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "c8e0cb34-d304-4405-862f-a4118e729083" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.657s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "560c41a4-79a3-461d-976d-f260bc9086f8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "560c41a4-79a3-461d-976d-f260bc9086f8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:00 user nova-compute[74311]: INFO nova.compute.manager [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Unshelving
Oct 20 10:16:00 user nova-compute[74311]: INFO nova.virt.block_device [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Booting with volume a050efae-a2e9-48ce-bcf2-696cd8e7e30e at /dev/vdc
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG nova.network.neutron [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Successfully updated port: 5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f1e3cec-7024-4663-8965-f933a79e4d2e req-987cb6f7-4767-4dbe-838a-c0d451aa44db service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received event network-changed-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f1e3cec-7024-4663-8965-f933a79e4d2e req-987cb6f7-4767-4dbe-838a-c0d451aa44db service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Refreshing instance network info cache due to event network-changed-5b30634a-aea2-4b86-b000-a108c2fb306b. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f1e3cec-7024-4663-8965-f933a79e4d2e req-987cb6f7-4767-4dbe-838a-c0d451aa44db service nova] Acquiring lock "refresh_cache-54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f1e3cec-7024-4663-8965-f933a79e4d2e req-987cb6f7-4767-4dbe-838a-c0d451aa44db service nova] Acquired lock "refresh_cache-54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG nova.network.neutron [req-7f1e3cec-7024-4663-8965-f933a79e4d2e req-987cb6f7-4767-4dbe-838a-c0d451aa44db service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Refreshing network info cache for port 5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "refresh_cache-54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG os_brick.utils [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:16:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d624dc-4a97-4755-96e1-6c068b5aca94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2608e326-c429-4c8f-a460-200d12505254]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.network.neutron [req-7f1e3cec-7024-4663-8965-f933a79e4d2e req-987cb6f7-4767-4dbe-838a-c0d451aa44db service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee336c8-d801-4a75-8dc7-5a6ea3389d84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dd0744-706f-42cb-a164-29dd43f5875a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:16:01 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f261fa0d-1e9b-4aee-be35-a9976ae78b69]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG os_brick.utils [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Updating existing volume attachment record: 781e74a4-30f0-4a92-a309-27c9fd90f42c {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.network.neutron [req-7f1e3cec-7024-4663-8965-f933a79e4d2e req-987cb6f7-4767-4dbe-838a-c0d451aa44db service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f1e3cec-7024-4663-8965-f933a79e4d2e req-987cb6f7-4767-4dbe-838a-c0d451aa44db service nova] Releasing lock "refresh_cache-54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquired lock "refresh_cache-54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.network.neutron [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.network.neutron [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.network.neutron [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Updating instance_info_cache with network_info: [{"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Releasing lock "refresh_cache-54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.compute.manager [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Instance network_info: |[{"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Start _get_guest_xml network_info=[{"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:16:01 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:16:01 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-914056221',display_name='tempest-tempest.common.compute-instance-914056221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-914056221',id=15,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPveX+yAZpnzBzilkcm82E6+RHpmB0Xb/tXYm16sLT8H7wqp8K2NVg/iZiaW1MVGWyDcchuyOYeUsUsFBwuN8qHZxREI7vXeZa+FEOEsV4eO0AeOp/iLUFR9gTFEBuIiQ==',key_name='tempest-keypair-646262168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-testi5fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=54c0cdc3-ebcd-46bf-9a6e-be7b6e450897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=5b30634a-aea2-4b86-b000-a108c2fb306b,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b30634a-ae') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.objects.instance [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lazy-loading 'pci_devices' on Instance uuid 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:16:01 user nova-compute[74311]:   <uuid>54c0cdc3-ebcd-46bf-9a6e-be7b6e450897</uuid>
Oct 20 10:16:01 user nova-compute[74311]:   <name>instance-0000000f</name>
Oct 20 10:16:01 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:16:01 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:16:01 user nova-compute[74311]:   <metadata>
Oct 20 10:16:01 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:16:01 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:16:01 user nova-compute[74311]:       <nova:name>tempest-tempest.common.compute-instance-914056221</nova:name>
Oct 20 10:16:01 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:16:01</nova:creationTime>
Oct 20 10:16:01 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:16:01 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:16:01 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:16:01 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:16:01 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:16:01 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:16:01 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:16:01 user nova-compute[74311]:       <nova:owner>
Oct 20 10:16:01 user nova-compute[74311]:         <nova:user uuid="5eb8db6bee87451f95e4bfdc61854bc5">tempest-ServerActionsTestOtherA-2000022938-project-member</nova:user>
Oct 20 10:16:01 user nova-compute[74311]:         <nova:project uuid="2f61456f02bc4688b8cd9d66a2b1868d">tempest-ServerActionsTestOtherA-2000022938</nova:project>
Oct 20 10:16:01 user nova-compute[74311]:       </nova:owner>
Oct 20 10:16:01 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:16:01 user nova-compute[74311]:       <nova:ports>
Oct 20 10:16:01 user nova-compute[74311]:         <nova:port uuid="5b30634a-aea2-4b86-b000-a108c2fb306b">
Oct 20 10:16:01 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 10:16:01 user nova-compute[74311]:         </nova:port>
Oct 20 10:16:01 user nova-compute[74311]:       </nova:ports>
Oct 20 10:16:01 user nova-compute[74311]:     </nova:instance>
Oct 20 10:16:01 user nova-compute[74311]:   </metadata>
Oct 20 10:16:01 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:16:01 user nova-compute[74311]:     <system>
Oct 20 10:16:01 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:16:01 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:16:01 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:16:01 user nova-compute[74311]:       <entry name="serial">54c0cdc3-ebcd-46bf-9a6e-be7b6e450897</entry>
Oct 20 10:16:01 user nova-compute[74311]:       <entry name="uuid">54c0cdc3-ebcd-46bf-9a6e-be7b6e450897</entry>
Oct 20 10:16:01 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:16:01 user nova-compute[74311]:     </system>
Oct 20 10:16:01 user nova-compute[74311]:   </sysinfo>
Oct 20 10:16:01 user nova-compute[74311]:   <os>
Oct 20 10:16:01 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:16:01 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:16:01 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:16:01 user nova-compute[74311]:   </os>
Oct 20 10:16:01 user nova-compute[74311]:   <features>
Oct 20 10:16:01 user nova-compute[74311]:     <acpi/>
Oct 20 10:16:01 user nova-compute[74311]:     <apic/>
Oct 20 10:16:01 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:16:01 user nova-compute[74311]:   </features>
Oct 20 10:16:01 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:16:01 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:16:01 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:16:01 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:16:01 user nova-compute[74311]:   </clock>
Oct 20 10:16:01 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:16:01 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:16:01 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:16:01 user nova-compute[74311]:   </cpu>
Oct 20 10:16:01 user nova-compute[74311]:   <devices>
Oct 20 10:16:01 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:16:01 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:16:01 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk"/>
Oct 20 10:16:01 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:16:01 user nova-compute[74311]:     </disk>
Oct 20 10:16:01 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:16:01 user nova-compute[74311]:       <mac address="fa:16:3e:67:96:1e"/>
Oct 20 10:16:01 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:16:01 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:16:01 user nova-compute[74311]:       <target dev="tap5b30634a-ae"/>
Oct 20 10:16:01 user nova-compute[74311]:     </interface>
Oct 20 10:16:01 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:16:01 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/console.log" append="off"/>
Oct 20 10:16:01 user nova-compute[74311]:     </serial>
Oct 20 10:16:01 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:16:01 user nova-compute[74311]:     <video>
Oct 20 10:16:01 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:16:01 user nova-compute[74311]:     </video>
Oct 20 10:16:01 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:16:01 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:16:01 user nova-compute[74311]:     </rng>
Oct 20 10:16:01 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:16:01 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:16:01 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:16:01 user nova-compute[74311]:     </memballoon>
Oct 20 10:16:01 user nova-compute[74311]:   </devices>
Oct 20 10:16:01 user nova-compute[74311]: </domain>
Oct 20 10:16:01 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-914056221',display_name='tempest-tempest.common.compute-instance-914056221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-914056221',id=15,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPveX+yAZpnzBzilkcm82E6+RHpmB0Xb/tXYm16sLT8H7wqp8K2NVg/iZiaW1MVGWyDcchuyOYeUsUsFBwuN8qHZxREI7vXeZa+FEOEsV4eO0AeOp/iLUFR9gTFEBuIiQ==',key_name='tempest-keypair-646262168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-testi5fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=54c0cdc3-ebcd-46bf-9a6e-be7b6e450897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=5b30634a-aea2-4b86-b000-a108c2fb306b,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b30634a-ae') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG os_vif [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=5b30634a-aea2-4b86-b000-a108c2fb306b,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b30634a-ae') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6818e4c6-ff6a-5fcf-a751-764f294dad12', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b30634a-ae, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b30634a-ae, col_values=(('qos', UUID('4b95d8d0-3a12-4ddd-a44a-d1ed646fb4cc')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b30634a-ae, col_values=(('external_ids', {'iface-id': '5b30634a-aea2-4b86-b000-a108c2fb306b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:96:1e', 'vm-uuid': '54c0cdc3-ebcd-46bf-9a6e-be7b6e450897'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:01 user nova-compute[74311]: INFO os_vif [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=5b30634a-aea2-4b86-b000-a108c2fb306b,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b30634a-ae')
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] No VIF found with MAC fa:16:3e:67:96:1e, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG nova.compute.manager [req-d8636a0e-4ebf-491d-86e5-86482fac14c4 req-dea07cd6-b710-4468-9199-936274e8c1c0 service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received event network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d8636a0e-4ebf-491d-86e5-86482fac14c4 req-dea07cd6-b710-4468-9199-936274e8c1c0 service nova] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d8636a0e-4ebf-491d-86e5-86482fac14c4 req-dea07cd6-b710-4468-9199-936274e8c1c0 service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d8636a0e-4ebf-491d-86e5-86482fac14c4 req-dea07cd6-b710-4468-9199-936274e8c1c0 service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG nova.compute.manager [req-d8636a0e-4ebf-491d-86e5-86482fac14c4 req-dea07cd6-b710-4468-9199-936274e8c1c0 service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] No waiting events found dispatching network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:03 user nova-compute[74311]: WARNING nova.compute.manager [req-d8636a0e-4ebf-491d-86e5-86482fac14c4 req-dea07cd6-b710-4468-9199-936274e8c1c0 service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received unexpected event network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b for instance with vm_state building and task_state spawning.
Oct 20 10:16:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:16:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.compute.manager [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:16:05 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:16:05 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7489MB free_disk=25.445735931396484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:05 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Instance spawned successfully.
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.compute.manager [req-bb12fef0-3137-4f43-8392-255f976aae70 req-9b40b6be-fffd-4252-a7f5-46647bc49ba6 service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received event network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bb12fef0-3137-4f43-8392-255f976aae70 req-9b40b6be-fffd-4252-a7f5-46647bc49ba6 service nova] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bb12fef0-3137-4f43-8392-255f976aae70 req-9b40b6be-fffd-4252-a7f5-46647bc49ba6 service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bb12fef0-3137-4f43-8392-255f976aae70 req-9b40b6be-fffd-4252-a7f5-46647bc49ba6 service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.compute.manager [req-bb12fef0-3137-4f43-8392-255f976aae70 req-9b40b6be-fffd-4252-a7f5-46647bc49ba6 service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] No waiting events found dispatching network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:05 user nova-compute[74311]: WARNING nova.compute.manager [req-bb12fef0-3137-4f43-8392-255f976aae70 req-9b40b6be-fffd-4252-a7f5-46647bc49ba6 service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received unexpected event network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b for instance with vm_state building and task_state spawning.
Oct 20 10:16:05 user nova-compute[74311]: INFO nova.compute.manager [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Took 7.53 seconds to spawn the instance on the hypervisor.
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.compute.manager [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 023498fa-b18b-4947-9b09-e9f6caafa931 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:16:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance d604a60d-cb10-46a9-8b53-adec39a93a84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance d5d019ce-3f5d-422c-b278-2b3cb3fd594a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c8e0cb34-d304-4405-862f-a4118e729083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ed823684-5b31-4b43-a601-bb5e303e0863 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 12bfda49-ce9d-4806-a982-08ce670faeb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 47a30844-242f-4a7f-ad9f-232a6e76b4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2fed360b-584a-4e1a-8e27-9189de7f5007 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:16:06 user nova-compute[74311]: INFO nova.compute.manager [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Took 8.56 seconds to build instance.
Oct 20 10:16:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a528142-cf0e-4469-85da-ab38141bba32 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.681s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.718s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:16:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:16:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:11 user nova-compute[74311]: DEBUG nova.compute.manager [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] swap_volume: Updating volume a4c94db1-73ff-4a10-a63d-6fed1bf2f53c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "vGFkOUtV", "auth_password": "XpUdGfAmY0FJBO", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "13fca40a-d3b1-4d16-860b-9ddf99381bc8"}, "status": "reserved", "instance": "d5d019ce-3f5d-422c-b278-2b3cb3fd594a", "attached_at": "", "detached_at": "", "volume_id": "13fca40a-d3b1-4d16-860b-9ddf99381bc8", "serial": "13fca40a-d3b1-4d16-860b-9ddf99381bc8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '13fca40a-d3b1-4d16-860b-9ddf99381bc8', 'no_device': None, 'attachment_id': 'f5dc380d-0ba2-464f-963b-70be0a879a37'} {{(pid=74311) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 20 10:16:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c24ed670-0257-4fe3-a3aa-625cef449498 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 55.418s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.volume.cinder [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Update attachment failed for attachment 781e74a4-30f0-4a92-a309-27c9fd90f42c. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7b7a7881-8bc5-4e89-b90d-eae5e557bba5) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7b7a7881-8bc5-4e89-b90d-eae5e557bba5)
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7b7a7881-8bc5-4e89-b90d-eae5e557bba5)
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Traceback (most recent call last):
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     driver_block_device.attach_block_devices(
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     _log_and_attach(device)
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     bdm.attach(*attach_args, **attach_kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     ret_val = method(obj, context, *args, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     self._do_attach(context, instance, volume, volume_api,
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     self._volume_attach(context, volume, connector, instance,
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     connection_info = volume_api.attachment_update(
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     res = method(self, ctx, *args, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     with excutils.save_and_reraise_exception():
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     self.force_reraise()
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     raise self.value
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     return method.func(obj, *args, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     resp = self._update('/attachments/%s' % id, body)
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     return self.request(url, method, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8]     raise exceptions.from_response(resp, body)
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7b7a7881-8bc5-4e89-b90d-eae5e557bba5)
Oct 20 10:16:12 user nova-compute[74311]: ERROR nova.compute.manager [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] 
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "560c41a4-79a3-461d-976d-f260bc9086f8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.471s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:12 user nova-compute[74311]: INFO nova.compute.manager [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 560c41a4-79a3-461d-976d-f260bc9086f8] Successfully reverted task state from spawning on failure for instance.
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server [None req-9fa13d4a-8607-4c42-988c-08bab21f4104 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7b7a7881-8bc5-4e89-b90d-eae5e557bba5)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7b7a7881-8bc5-4e89-b90d-eae5e557bba5)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server 
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server 
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7082, in unshelve_instance
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     do_unshelve_instance()
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7079, in do_unshelve_instance
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     self._unshelve_instance(
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7111, in _unshelve_instance
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     block_device_info = self._prep_block_device(context, instance, bdms)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7b7a7881-8bc5-4e89-b90d-eae5e557bba5)
Oct 20 10:16:12 user nova-compute[74311]: ERROR oslo_messaging.rpc.server 
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "023498fa-b18b-4947-9b09-e9f6caafa931" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "023498fa-b18b-4947-9b09-e9f6caafa931" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:12 user nova-compute[74311]: INFO nova.compute.manager [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Terminating instance
Oct 20 10:16:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Acquiring lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG os_brick.utils [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d27aad-c9d8-4ba5-b522-008acc1230fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d4b805-979e-449b-a007-3da96a23f5be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2376c520-2f68-4947-b184-cb6e8bb326aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f573c57-a029-409a-b0f0-d05537639b5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-f3a3f162-bb2e-4eeb-b0b2-1c5fdcb16702 req-5e4a9f20-970b-48c1-a491-4ed8d2dce02c service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received event network-vif-unplugged-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f3a3f162-bb2e-4eeb-b0b2-1c5fdcb16702 req-5e4a9f20-970b-48c1-a491-4ed8d2dce02c service nova] Acquiring lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f3a3f162-bb2e-4eeb-b0b2-1c5fdcb16702 req-5e4a9f20-970b-48c1-a491-4ed8d2dce02c service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f3a3f162-bb2e-4eeb-b0b2-1c5fdcb16702 req-5e4a9f20-970b-48c1-a491-4ed8d2dce02c service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-f3a3f162-bb2e-4eeb-b0b2-1c5fdcb16702 req-5e4a9f20-970b-48c1-a491-4ed8d2dce02c service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] No waiting events found dispatching network-vif-unplugged-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-f3a3f162-bb2e-4eeb-b0b2-1c5fdcb16702 req-5e4a9f20-970b-48c1-a491-4ed8d2dce02c service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received event network-vif-unplugged-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:16:12 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:16:12 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c15cb25-24b8-4401-81ec-63dfab2894ed]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:16:12 user nova-compute[74311]: DEBUG os_brick.utils [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:16:13 user nova-compute[74311]: INFO nova.compute.manager [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Swapping volume 13fca40a-d3b1-4d16-860b-9ddf99381bc8 for a4c94db1-73ff-4a10-a63d-6fed1bf2f53c
Oct 20 10:16:13 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Instance destroyed successfully.
Oct 20 10:16:13 user nova-compute[74311]: DEBUG nova.objects.instance [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lazy-loading 'resources' on Instance uuid 023498fa-b18b-4947-9b09-e9f6caafa931 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-683979222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-683979222',id=8,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAka0fGmXxuri5svjkz2HGnAAMwNmV/IgeCY0qqOdRgNIDrai8wjXmgODQlUjDOkNgT+vtqR0NIIR/7gHXjzK406sjo8EG1oh8DP0FT7lElr/8iMYNu2UdW9vM5ZOr2qnw==',key_name='tempest-keypair-2115206596',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16b3aaaa066740fa913e22537f799e86',ramdisk_id='',reservation_id='r-4t98aki2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-340750198',owner_user_name='tempest-TaggedAttachmentsTest-340750198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ba84b7bf6a7418a821a22bbd3b0569c',uuid=023498fa-b18b-4947-9b09-e9f6caafa931,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Converting VIF {"id": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "address": "fa:16:3e:6e:29:a6", "network": {"id": "181b9e45-9e42-4c1f-a95a-aecf69bc252d", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-288340281-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16b3aaaa066740fa913e22537f799e86", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap465bad7c-bd", "ovs_interfaceid": "465bad7c-bd36-492a-bd18-a8fcbd8bfd42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:29:a6,bridge_name='br-int',has_traffic_filtering=True,id=465bad7c-bd36-492a-bd18-a8fcbd8bfd42,network=Network(181b9e45-9e42-4c1f-a95a-aecf69bc252d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465bad7c-bd') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG os_vif [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:29:a6,bridge_name='br-int',has_traffic_filtering=True,id=465bad7c-bd36-492a-bd18-a8fcbd8bfd42,network=Network(181b9e45-9e42-4c1f-a95a-aecf69bc252d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465bad7c-bd') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap465bad7c-bd, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94a41260-dfff-4bb5-b76a-654a6bef4e99) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:13 user nova-compute[74311]: INFO os_vif [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:29:a6,bridge_name='br-int',has_traffic_filtering=True,id=465bad7c-bd36-492a-bd18-a8fcbd8bfd42,network=Network(181b9e45-9e42-4c1f-a95a-aecf69bc252d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap465bad7c-bd')
Oct 20 10:16:13 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Deleting instance files /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931_del
Oct 20 10:16:13 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Deletion of /opt/stack/data/nova/instances/023498fa-b18b-4947-9b09-e9f6caafa931_del complete
Oct 20 10:16:13 user nova-compute[74311]: INFO nova.compute.manager [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 20 10:16:13 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:16:13 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:16:14 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:16:14 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Took 0.94 seconds to deallocate network for instance.
Oct 20 10:16:14 user nova-compute[74311]: DEBUG nova.compute.manager [req-f88522d3-307d-4577-83e1-1534d94f0ad6 req-ae9a831c-b785-41de-9624-0cb0b6028849 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received event network-vif-deleted-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:14 user nova-compute[74311]: INFO nova.compute.manager [req-f88522d3-307d-4577-83e1-1534d94f0ad6 req-ae9a831c-b785-41de-9624-0cb0b6028849 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Neutron deleted interface 465bad7c-bd36-492a-bd18-a8fcbd8bfd42; detaching it from the instance and deleting it from the info cache
Oct 20 10:16:14 user nova-compute[74311]: DEBUG nova.network.neutron [req-f88522d3-307d-4577-83e1-1534d94f0ad6 req-ae9a831c-b785-41de-9624-0cb0b6028849 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:16:14 user nova-compute[74311]: DEBUG nova.compute.manager [req-f88522d3-307d-4577-83e1-1534d94f0ad6 req-ae9a831c-b785-41de-9624-0cb0b6028849 service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Detach interface failed, port_id=465bad7c-bd36-492a-bd18-a8fcbd8bfd42, reason: Instance 023498fa-b18b-4947-9b09-e9f6caafa931 could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:16:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:14 user nova-compute[74311]: DEBUG nova.compute.manager [req-eb210818-815c-4e12-bec8-629f38c39ec5 req-2eac23a1-ce2a-44f6-a818-21eb1f1137be service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received event network-vif-plugged-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-eb210818-815c-4e12-bec8-629f38c39ec5 req-2eac23a1-ce2a-44f6-a818-21eb1f1137be service nova] Acquiring lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-eb210818-815c-4e12-bec8-629f38c39ec5 req-2eac23a1-ce2a-44f6-a818-21eb1f1137be service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-eb210818-815c-4e12-bec8-629f38c39ec5 req-2eac23a1-ce2a-44f6-a818-21eb1f1137be service nova] Lock "023498fa-b18b-4947-9b09-e9f6caafa931-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:14 user nova-compute[74311]: DEBUG nova.compute.manager [req-eb210818-815c-4e12-bec8-629f38c39ec5 req-2eac23a1-ce2a-44f6-a818-21eb1f1137be service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] No waiting events found dispatching network-vif-plugged-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:14 user nova-compute[74311]: WARNING nova.compute.manager [req-eb210818-815c-4e12-bec8-629f38c39ec5 req-2eac23a1-ce2a-44f6-a818-21eb1f1137be service nova] [instance: 023498fa-b18b-4947-9b09-e9f6caafa931] Received unexpected event network-vif-plugged-465bad7c-bd36-492a-bd18-a8fcbd8bfd42 for instance with vm_state deleted and task_state None.
Oct 20 10:16:14 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:16:14 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:16:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:15 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Deleted allocations for instance 023498fa-b18b-4947-9b09-e9f6caafa931
Oct 20 10:16:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ef25ab73-bb0b-4b01-a490-614cadf1b8d3 tempest-TaggedAttachmentsTest-340750198 tempest-TaggedAttachmentsTest-340750198-project-member] Lock "023498fa-b18b-4947-9b09-e9f6caafa931" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.727s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mRenVUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:16:19 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:16:19 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.009s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:16:19 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c075119-8842-4548-b11e-db9a06031b47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:16:19 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[334d3600-990c-4610-8962-88cb44a79936]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5] added
Oct 20 10:16:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6533f5f-5a40-4bfa-a919-25e55877a40e]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a45467e-57cd-476e-9781-b335f8249103]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mRenVUQx {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mRenVUQx" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e543a23f-cc3f-4d03-9d38-64f8c6bef155]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mRenVUQx'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0680fbd-cf89-47e4-8155-9008119bb3cc]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eb0d78-9557-49af-baa6-370148929388]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bf2ca5-33ea-4ea9-b124-7b75db440738]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260]
Oct 20 10:16:19 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260] successful.
Oct 20 10:16:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa5cd31-094d-412e-8a36-972e4996262f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3318d59b-341a-4e4a-9d4b-00a5a6ec9120]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:16:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fe76aa-1c28-44bd-93a6-28c5d3bbd9dc]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG nova.compute.manager [req-4fad3312-7587-4139-a4f0-3efacbac5e92 req-c27f0204-71bf-4ff3-987f-5ed977d5e04f service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-changed-1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG nova.compute.manager [req-4fad3312-7587-4139-a4f0-3efacbac5e92 req-c27f0204-71bf-4ff3-987f-5ed977d5e04f service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing instance network info cache due to event network-changed-1945a62d-3b78-4092-92cf-3609131863fd. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4fad3312-7587-4139-a4f0-3efacbac5e92 req-c27f0204-71bf-4ff3-987f-5ed977d5e04f service nova] Acquiring lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4fad3312-7587-4139-a4f0-3efacbac5e92 req-c27f0204-71bf-4ff3-987f-5ed977d5e04f service nova] Acquired lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:16:19 user nova-compute[74311]: DEBUG nova.network.neutron [req-4fad3312-7587-4139-a4f0-3efacbac5e92 req-c27f0204-71bf-4ff3-987f-5ed977d5e04f service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Refreshing network info cache for port 1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:16:20 user nova-compute[74311]: DEBUG nova.network.neutron [req-4fad3312-7587-4139-a4f0-3efacbac5e92 req-c27f0204-71bf-4ff3-987f-5ed977d5e04f service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updated VIF entry in instance network info cache for port 1945a62d-3b78-4092-92cf-3609131863fd. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:16:20 user nova-compute[74311]: DEBUG nova.network.neutron [req-4fad3312-7587-4139-a4f0-3efacbac5e92 req-c27f0204-71bf-4ff3-987f-5ed977d5e04f service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updating instance_info_cache with network_info: [{"id": "1945a62d-3b78-4092-92cf-3609131863fd", "address": "fa:16:3e:88:e7:48", "network": {"id": "37a1d6c5-3fc8-482c-bdf2-08694d929f66", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1387148929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1945a62d-3b", "ovs_interfaceid": "1945a62d-3b78-4092-92cf-3609131863fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "address": "fa:16:3e:a4:4c:e3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b06e65-3d", "ovs_interfaceid": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "address": "fa:16:3e:58:d3:49", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4b55ba-9c", "ovs_interfaceid": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9e19dda-eda1-4115-9028-3d814859462c", "address": "fa:16:3e:d8:03:d3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e19dda-ed", "ovs_interfaceid": "f9e19dda-eda1-4115-9028-3d814859462c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6213339-1858-41a4-b0ed-db8897a2dca7", "address": "fa:16:3e:1e:ef:d4", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6213339-18", "ovs_interfaceid": "d6213339-1858-41a4-b0ed-db8897a2dca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f7fdb4-ccdf-488d-9725-c15f461af479", "address": "fa:16:3e:f7:27:e0", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f7fdb4-cc", "ovs_interfaceid": "45f7fdb4-ccdf-488d-9725-c15f461af479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84d098d4-3ea0-41bf-8abc-c6d340094630", "address": "fa:16:3e:e2:ae:b4", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d098d4-3e", "ovs_interfaceid": "84d098d4-3ea0-41bf-8abc-c6d340094630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:16:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4fad3312-7587-4139-a4f0-3efacbac5e92 req-c27f0204-71bf-4ff3-987f-5ed977d5e04f service nova] Releasing lock "refresh_cache-d604a60d-cb10-46a9-8b53-adec39a93a84" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:16:20 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:16:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mRenVUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:16:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:16:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23735386434363531', 'path': '/dev/sdg'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:16:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735386434363531', 'path': '/dev/sdg'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:16:20 user nova-compute[74311]: DEBUG nova.objects.instance [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lazy-loading 'flavor' on Instance uuid 2fed360b-584a-4e1a-8e27-9189de7f5007 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:16:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:16:20 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:16:20 user nova-compute[74311]:   <source dev="/dev/sdg"/>
Oct 20 10:16:20 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:16:20 user nova-compute[74311]:   <serial>5a032ca5-d6bb-4766-93df-a1109b708ff5</serial>
Oct 20 10:16:20 user nova-compute[74311]: </disk>
Oct 20 10:16:20 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:16:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:16:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:16:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] No VIF found with MAC fa:16:3e:08:6f:b2, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:16:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-73922dc5-5dec-492d-8635-45b22ca578d2 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.728s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Acquiring lock "12bfda49-ce9d-4806-a982-08ce670faeb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Acquiring lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:22 user nova-compute[74311]: INFO nova.compute.manager [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Terminating instance
Oct 20 10:16:22 user nova-compute[74311]: DEBUG nova.compute.manager [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:22 user nova-compute[74311]: INFO nova.compute.manager [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Terminating instance
Oct 20 10:16:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG nova.compute.manager [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-dc88f4b7-d041-4ec1-bf07-35f301e7ee1f req-e195a8ca-7b55-4633-802f-539b5849c655 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Received event network-vif-unplugged-9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-dc88f4b7-d041-4ec1-bf07-35f301e7ee1f req-e195a8ca-7b55-4633-802f-539b5849c655 service nova] Acquiring lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-dc88f4b7-d041-4ec1-bf07-35f301e7ee1f req-e195a8ca-7b55-4633-802f-539b5849c655 service nova] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-dc88f4b7-d041-4ec1-bf07-35f301e7ee1f req-e195a8ca-7b55-4633-802f-539b5849c655 service nova] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-dc88f4b7-d041-4ec1-bf07-35f301e7ee1f req-e195a8ca-7b55-4633-802f-539b5849c655 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] No waiting events found dispatching network-vif-unplugged-9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-dc88f4b7-d041-4ec1-bf07-35f301e7ee1f req-e195a8ca-7b55-4633-802f-539b5849c655 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Received event network-vif-unplugged-9610009e-e341-4814-a3c3-523081eb0c8b for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Instance destroyed successfully.
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG nova.objects.instance [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lazy-loading 'resources' on Instance uuid 12bfda49-ce9d-4806-a982-08ce670faeb6 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1968721568',display_name='tempest-VolumesAssistedSnapshotsTest-server-1968721568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1968721568',id=9,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmxf0U5l/9UCpnIsZGpfk0uEuvtIh81UGGvaN1MxelxoAcvWpERQkTx3l1hHmIHU7ss7q+XBZuf+0ghSR08MtV80NAs/Fhr4owGoYyvp0faI26PAAGVHPRTrW316ve9Qg==',key_name='tempest-keypair-1030875735',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:13:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb286be870f14bc89403febfdb4bff45',ramdisk_id='',reservation_id='r-59njym3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1587958436',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1587958436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb29689c6d448fe9c5e848415511394',uuid=12bfda49-ce9d-4806-a982-08ce670faeb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9610009e-e341-4814-a3c3-523081eb0c8b", "address": "fa:16:3e:8b:94:00", "network": {"id": "b7d019f1-b3d9-472b-b369-db22786af195", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2011103604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb286be870f14bc89403febfdb4bff45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9610009e-e3", "ovs_interfaceid": "9610009e-e341-4814-a3c3-523081eb0c8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Converting VIF {"id": "9610009e-e341-4814-a3c3-523081eb0c8b", "address": "fa:16:3e:8b:94:00", "network": {"id": "b7d019f1-b3d9-472b-b369-db22786af195", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2011103604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb286be870f14bc89403febfdb4bff45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9610009e-e3", "ovs_interfaceid": "9610009e-e341-4814-a3c3-523081eb0c8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:94:00,bridge_name='br-int',has_traffic_filtering=True,id=9610009e-e341-4814-a3c3-523081eb0c8b,network=Network(b7d019f1-b3d9-472b-b369-db22786af195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9610009e-e3') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG os_vif [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:94:00,bridge_name='br-int',has_traffic_filtering=True,id=9610009e-e341-4814-a3c3-523081eb0c8b,network=Network(b7d019f1-b3d9-472b-b369-db22786af195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9610009e-e3') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9610009e-e3, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-5c938cbc-d36d-4923-ae45-4dff9c311d11 req-add8d300-0d42-4659-8545-817d2e0f5d11 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-unplugged-51b06e65-3d65-4b26-9f2c-9b1098f034f4 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5c938cbc-d36d-4923-ae45-4dff9c311d11 req-add8d300-0d42-4659-8545-817d2e0f5d11 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5c938cbc-d36d-4923-ae45-4dff9c311d11 req-add8d300-0d42-4659-8545-817d2e0f5d11 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5c938cbc-d36d-4923-ae45-4dff9c311d11 req-add8d300-0d42-4659-8545-817d2e0f5d11 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-5c938cbc-d36d-4923-ae45-4dff9c311d11 req-add8d300-0d42-4659-8545-817d2e0f5d11 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-unplugged-51b06e65-3d65-4b26-9f2c-9b1098f034f4 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-5c938cbc-d36d-4923-ae45-4dff9c311d11 req-add8d300-0d42-4659-8545-817d2e0f5d11 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-unplugged-51b06e65-3d65-4b26-9f2c-9b1098f034f4 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ed1c98a-d614-4732-bca6-ad87672ce37f) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: INFO os_vif [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:94:00,bridge_name='br-int',has_traffic_filtering=True,id=9610009e-e341-4814-a3c3-523081eb0c8b,network=Network(b7d019f1-b3d9-472b-b369-db22786af195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9610009e-e3')
Oct 20 10:16:23 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Deleting instance files /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6_del
Oct 20 10:16:23 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Deletion of /opt/stack/data/nova/instances/12bfda49-ce9d-4806-a982-08ce670faeb6_del complete
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: INFO nova.compute.manager [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Took 1.27 seconds to destroy the instance on the hypervisor.
Oct 20 10:16:23 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:23 user nova-compute[74311]: DEBUG nova.compute.manager [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Stashing vm_state: active {{(pid=74311) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:16:24 user nova-compute[74311]: INFO nova.compute.claims [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Claim successful on node user
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:24 user nova-compute[74311]: INFO nova.compute.resource_tracker [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating resource usage from migration dd8a86a6-bba1-457d-8599-8dbfac07dcec
Oct 20 10:16:24 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Instance destroyed successfully.
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.objects.instance [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lazy-loading 'resources' on Instance uuid d604a60d-cb10-46a9-8b53-adec39a93a84 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1945a62d-3b78-4092-92cf-3609131863fd", "address": "fa:16:3e:88:e7:48", "network": {"id": "37a1d6c5-3fc8-482c-bdf2-08694d929f66", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1387148929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1945a62d-3b", "ovs_interfaceid": "1945a62d-3b78-4092-92cf-3609131863fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "1945a62d-3b78-4092-92cf-3609131863fd", "address": "fa:16:3e:88:e7:48", "network": {"id": "37a1d6c5-3fc8-482c-bdf2-08694d929f66", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1387148929-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1945a62d-3b", "ovs_interfaceid": "1945a62d-3b78-4092-92cf-3609131863fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:e7:48,bridge_name='br-int',has_traffic_filtering=True,id=1945a62d-3b78-4092-92cf-3609131863fd,network=Network(37a1d6c5-3fc8-482c-bdf2-08694d929f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1945a62d-3b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG os_vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:e7:48,bridge_name='br-int',has_traffic_filtering=True,id=1945a62d-3b78-4092-92cf-3609131863fd,network=Network(37a1d6c5-3fc8-482c-bdf2-08694d929f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1945a62d-3b') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1945a62d-3b, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Received event network-vif-plugged-9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Acquiring lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] No waiting events found dispatching network-vif-plugged-9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:24 user nova-compute[74311]: WARNING nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Received unexpected event network-vif-plugged-9610009e-e341-4814-a3c3-523081eb0c8b for instance with vm_state active and task_state deleting.
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-unplugged-1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-unplugged-1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-unplugged-1945a62d-3b78-4092-92cf-3609131863fd for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:24 user nova-compute[74311]: WARNING nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-1945a62d-3b78-4092-92cf-3609131863fd for instance with vm_state active and task_state deleting.
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-unplugged-2d4b55ba-9c6e-4784-a967-8b0ab34053a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-unplugged-2d4b55ba-9c6e-4784-a967-8b0ab34053a7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-unplugged-2d4b55ba-9c6e-4784-a967-8b0ab34053a7 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-2d4b55ba-9c6e-4784-a967-8b0ab34053a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-2d4b55ba-9c6e-4784-a967-8b0ab34053a7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:24 user nova-compute[74311]: WARNING nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-2d4b55ba-9c6e-4784-a967-8b0ab34053a7 for instance with vm_state active and task_state deleting.
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-unplugged-f9e19dda-eda1-4115-9028-3d814859462c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-unplugged-f9e19dda-eda1-4115-9028-3d814859462c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-01093823-0a98-42b2-8f30-2d9af797ee83 req-5cefd88f-d2eb-48fd-a2bb-2d3923cd3e05 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-unplugged-f9e19dda-eda1-4115-9028-3d814859462c for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa7b29bf-b939-4ce8-b9a3-5f7d59887e14) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:24 user nova-compute[74311]: INFO os_vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:e7:48,bridge_name='br-int',has_traffic_filtering=True,id=1945a62d-3b78-4092-92cf-3609131863fd,network=Network(37a1d6c5-3fc8-482c-bdf2-08694d929f66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1945a62d-3b')
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "address": "fa:16:3e:a4:4c:e3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b06e65-3d", "ovs_interfaceid": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "address": "fa:16:3e:a4:4c:e3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b06e65-3d", "ovs_interfaceid": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4c:e3,bridge_name='br-int',has_traffic_filtering=True,id=51b06e65-3d65-4b26-9f2c-9b1098f034f4,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51b06e65-3d') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG os_vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4c:e3,bridge_name='br-int',has_traffic_filtering=True,id=51b06e65-3d65-4b26-9f2c-9b1098f034f4,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51b06e65-3d') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51b06e65-3d, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:16:24 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Took 1.35 seconds to deallocate network for instance.
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c999491-f616-4474-9185-c8979cc9e6a1) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.869s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:24 user nova-compute[74311]: INFO nova.compute.manager [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Migrating
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:16:24 user nova-compute[74311]: INFO nova.compute.rpcapi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 20 10:16:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:24 user nova-compute[74311]: INFO os_vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:4c:e3,bridge_name='br-int',has_traffic_filtering=True,id=51b06e65-3d65-4b26-9f2c-9b1098f034f4,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51b06e65-3d')
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "address": "fa:16:3e:58:d3:49", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4b55ba-9c", "ovs_interfaceid": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "address": "fa:16:3e:58:d3:49", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4b55ba-9c", "ovs_interfaceid": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:d3:49,bridge_name='br-int',has_traffic_filtering=True,id=2d4b55ba-9c6e-4784-a967-8b0ab34053a7,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d4b55ba-9c') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:24 user nova-compute[74311]: DEBUG os_vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d3:49,bridge_name='br-int',has_traffic_filtering=True,id=2d4b55ba-9c6e-4784-a967-8b0ab34053a7,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d4b55ba-9c') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d4b55ba-9c, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquired lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.network.neutron [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2233a00e-ad02-4918-b71f-f10cacbc66e7) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: INFO os_vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:d3:49,bridge_name='br-int',has_traffic_filtering=True,id=2d4b55ba-9c6e-4784-a967-8b0ab34053a7,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2d4b55ba-9c')
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9e19dda-eda1-4115-9028-3d814859462c", "address": "fa:16:3e:d8:03:d3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e19dda-ed", "ovs_interfaceid": "f9e19dda-eda1-4115-9028-3d814859462c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "f9e19dda-eda1-4115-9028-3d814859462c", "address": "fa:16:3e:d8:03:d3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e19dda-ed", "ovs_interfaceid": "f9e19dda-eda1-4115-9028-3d814859462c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:03:d3,bridge_name='br-int',has_traffic_filtering=True,id=f9e19dda-eda1-4115-9028-3d814859462c,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e19dda-ed') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:03:d3,bridge_name='br-int',has_traffic_filtering=True,id=f9e19dda-eda1-4115-9028-3d814859462c,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e19dda-ed') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9e19dda-ed, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d91d21fc-56c5-48ef-822d-66c12e36fce2) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: INFO os_vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:03:d3,bridge_name='br-int',has_traffic_filtering=True,id=f9e19dda-eda1-4115-9028-3d814859462c,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e19dda-ed')
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6213339-1858-41a4-b0ed-db8897a2dca7", "address": "fa:16:3e:1e:ef:d4", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6213339-18", "ovs_interfaceid": "d6213339-1858-41a4-b0ed-db8897a2dca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "d6213339-1858-41a4-b0ed-db8897a2dca7", "address": "fa:16:3e:1e:ef:d4", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6213339-18", "ovs_interfaceid": "d6213339-1858-41a4-b0ed-db8897a2dca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ef:d4,bridge_name='br-int',has_traffic_filtering=True,id=d6213339-1858-41a4-b0ed-db8897a2dca7,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6213339-18') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ef:d4,bridge_name='br-int',has_traffic_filtering=True,id=d6213339-1858-41a4-b0ed-db8897a2dca7,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6213339-18') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6213339-18, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d75dbbd-d820-4528-8a60-6d9a573d9532) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-51b06e65-3d65-4b26-9f2c-9b1098f034f4 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-51b06e65-3d65-4b26-9f2c-9b1098f034f4 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:25 user nova-compute[74311]: WARNING nova.compute.manager [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-51b06e65-3d65-4b26-9f2c-9b1098f034f4 for instance with vm_state active and task_state deleting.
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-unplugged-d6213339-1858-41a4-b0ed-db8897a2dca7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-unplugged-d6213339-1858-41a4-b0ed-db8897a2dca7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-unplugged-d6213339-1858-41a4-b0ed-db8897a2dca7 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-d6213339-1858-41a4-b0ed-db8897a2dca7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-d6213339-1858-41a4-b0ed-db8897a2dca7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:25 user nova-compute[74311]: WARNING nova.compute.manager [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-d6213339-1858-41a4-b0ed-db8897a2dca7 for instance with vm_state active and task_state deleting.
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-4bbc1243-f23a-4314-b2af-3d8683a83b31 req-d5848ae9-5b8e-4e65-9628-f092d16ca881 service nova] [instance: 12bfda49-ce9d-4806-a982-08ce670faeb6] Received event network-vif-deleted-9610009e-e341-4814-a3c3-523081eb0c8b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:25 user nova-compute[74311]: INFO os_vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:ef:d4,bridge_name='br-int',has_traffic_filtering=True,id=d6213339-1858-41a4-b0ed-db8897a2dca7,network=Network(0a10b6c8-952d-460c-ad05-75a57bc09abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6213339-18')
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45f7fdb4-ccdf-488d-9725-c15f461af479", "address": "fa:16:3e:f7:27:e0", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f7fdb4-cc", "ovs_interfaceid": "45f7fdb4-ccdf-488d-9725-c15f461af479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "45f7fdb4-ccdf-488d-9725-c15f461af479", "address": "fa:16:3e:f7:27:e0", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f7fdb4-cc", "ovs_interfaceid": "45f7fdb4-ccdf-488d-9725-c15f461af479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:27:e0,bridge_name='br-int',has_traffic_filtering=True,id=45f7fdb4-ccdf-488d-9725-c15f461af479,network=Network(5198fb67-a161-45d6-8909-997c0683fd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45f7fdb4-cc') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:27:e0,bridge_name='br-int',has_traffic_filtering=True,id=45f7fdb4-ccdf-488d-9725-c15f461af479,network=Network(5198fb67-a161-45d6-8909-997c0683fd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45f7fdb4-cc') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45f7fdb4-cc, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=276a32ab-2516-4de7-85ab-7a9dac110954) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: INFO os_vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:27:e0,bridge_name='br-int',has_traffic_filtering=True,id=45f7fdb4-ccdf-488d-9725-c15f461af479,network=Network(5198fb67-a161-45d6-8909-997c0683fd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45f7fdb4-cc')
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-220304069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-220304069',id=11,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1bjZQika1ONd1726QK9zxrIyXUH0ULR3zFOFs+aj19cQfdf9sbSG97I26nsr2dfcBt543wFVoGC4+9UyteOeTNyKZvJhONAXcsbILRjQ4Tbf62OC26RY133E9U7Q3vuw==',key_name='tempest-keypair-1793521302',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f86d5595c8844db8ccdd70600dde9bf',ramdisk_id='',reservation_id='r-a8owe2k2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-332152516',owner_user_name='tempest-TaggedBootDevicesTest-332152516-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81b9fee1eb946ce98e8f8e9705ca429',uuid=d604a60d-cb10-46a9-8b53-adec39a93a84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84d098d4-3ea0-41bf-8abc-c6d340094630", "address": "fa:16:3e:e2:ae:b4", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d098d4-3e", "ovs_interfaceid": "84d098d4-3ea0-41bf-8abc-c6d340094630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converting VIF {"id": "84d098d4-3ea0-41bf-8abc-c6d340094630", "address": "fa:16:3e:e2:ae:b4", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d098d4-3e", "ovs_interfaceid": "84d098d4-3ea0-41bf-8abc-c6d340094630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ae:b4,bridge_name='br-int',has_traffic_filtering=True,id=84d098d4-3ea0-41bf-8abc-c6d340094630,network=Network(5198fb67-a161-45d6-8909-997c0683fd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d098d4-3e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ae:b4,bridge_name='br-int',has_traffic_filtering=True,id=84d098d4-3ea0-41bf-8abc-c6d340094630,network=Network(5198fb67-a161-45d6-8909-997c0683fd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d098d4-3e') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84d098d4-3e, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2a063b8-e218-466a-a969-829c7c712470) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: INFO os_vif [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:ae:b4,bridge_name='br-int',has_traffic_filtering=True,id=84d098d4-3ea0-41bf-8abc-c6d340094630,network=Network(5198fb67-a161-45d6-8909-997c0683fd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84d098d4-3e')
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lthyROHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:16:25 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4754bb75-b539-418c-8ec3-f7ae58ec15e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:16:25 user nova-compute[74311]: No targets found.
Oct 20 10:16:25 user nova-compute[74311]: iSNS:
Oct 20 10:16:25 user nova-compute[74311]: No targets found.
Oct 20 10:16:25 user nova-compute[74311]: STATIC:
Oct 20 10:16:25 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77
Oct 20 10:16:25 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:25 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:25 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:16:25 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:25 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:25 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16
Oct 20 10:16:25 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:25 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:25 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5
Oct 20 10:16:25 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:25 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:25 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8
Oct 20 10:16:25 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:25 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:25 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055
Oct 20 10:16:25 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:25 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:25 user nova-compute[74311]: FIRMWARE:
Oct 20 10:16:25 user nova-compute[74311]: No targets found.
Oct 20 10:16:25 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:16:25 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:16:25 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcef0c6-2fbc-412d-9ae1-6a0cb9b151ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5096809b-3f69-45b8-836c-126fb03ffa8d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb18862a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2201511b-1267-49c5-9d73-e2358a07dc00]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a598d5f-1c66-4acc-a6a1-3fc6813a3055]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.network.neutron [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating instance_info_cache with network_info: [{"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb4fa3d-5dd9-4304-b0b7-99f13c96a214]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Releasing lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.627s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[17821db1-9835-40a7-a13b-72d9628ccf70]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Deleted allocations for instance 12bfda49-ce9d-4806-a982-08ce670faeb6
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1a039e-bb16-49e5-b0c2-6fdc8355ee1f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b25cda-603b-44b0-9e87-31bb94802f27]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77, portal: 172.16.0.220,3260]
Oct 20 10:16:25 user nova-compute[74311]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77, portal: 172.16.0.220,3260] successful.
Oct 20 10:16:25 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Starting migrate_disk_and_power_off {{(pid=74311) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8012eb7-bb26-4fd8-8845-e83f7eb4255a tempest-VolumesAssistedSnapshotsTest-1587958436 tempest-VolumesAssistedSnapshotsTest-1587958436-project-member] Lock "12bfda49-ce9d-4806-a982-08ce670faeb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.540s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2003efea-b3e5-4085-9290-fecb0dc99d77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac9a75a-21a4-463d-b0b8-f258ad82fe68]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] <== disconnect_volume: return (379ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tJzHlLca', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:16:25 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fc4278-c6b5-4ece-b5d5-a329b4609aa7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:16:25 user nova-compute[74311]: No targets found.
Oct 20 10:16:25 user nova-compute[74311]: iSNS:
Oct 20 10:16:25 user nova-compute[74311]: No targets found.
Oct 20 10:16:25 user nova-compute[74311]: STATIC:
Oct 20 10:16:25 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:16:25 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:25 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:25 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16
Oct 20 10:16:25 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:25 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:25 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5
Oct 20 10:16:25 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:25 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:25 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8
Oct 20 10:16:25 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:25 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:25 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055
Oct 20 10:16:25 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:25 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:25 user nova-compute[74311]: FIRMWARE:
Oct 20 10:16:25 user nova-compute[74311]: No targets found.
Oct 20 10:16:25 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:16:25 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:16:25 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e086d1-4f54-4fd7-945e-79d543cb3f97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2996b895-b80e-432d-abb8-6633c813c0d2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:16:25 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164fae0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055'): ({'sdc'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Removing single pathed devices sdc {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2479190c-2d7e-4494-a3b3-ce16d5df24e8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ae3807-0458-4723-a733-8702a24cf053]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Flushing IO for device /dev/sdc {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4ca753-f1a7-4598-806f-efb021717c31]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:16:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa789e9-130c-4795-addd-8edac3895763]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53e874f-f09b-4e0a-b9ee-88e877cee7f1]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[157b0aff-380d-4aab-b06a-e28d392557c5]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055, portal: 172.16.0.220,3260]
Oct 20 10:16:26 user nova-compute[74311]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055, portal: 172.16.0.220,3260] successful.
Oct 20 10:16:26 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5eb5a5d-f10a-40d2-a8f0-955866b28055 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[418f3df8-960c-4872-9514-cd75d4877797]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] <== disconnect_volume: return (353ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPxObQAR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:16:26 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e8d75b-6225-494c-aaa3-fcc88a25cfa8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:16:26 user nova-compute[74311]: No targets found.
Oct 20 10:16:26 user nova-compute[74311]: iSNS:
Oct 20 10:16:26 user nova-compute[74311]: No targets found.
Oct 20 10:16:26 user nova-compute[74311]: STATIC:
Oct 20 10:16:26 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:16:26 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:26 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:26 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16
Oct 20 10:16:26 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:26 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:26 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5
Oct 20 10:16:26 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:26 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:26 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8
Oct 20 10:16:26 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:26 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:26 user nova-compute[74311]: FIRMWARE:
Oct 20 10:16:26 user nova-compute[74311]: No targets found.
Oct 20 10:16:26 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:16:26 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:16:26 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2858321-7a52-4c8c-a61c-e5681fbe51b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccb47e9-f4c8-407a-8e89-effab7ce9157]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:26 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:26 user nova-compute[74311]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:16:26 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:16:26 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:26 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:26 user nova-compute[74311]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:16:26 user nova-compute[74311]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 (non-flash)
Oct 20 10:16:26 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1b50d9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16'): ({'sdd'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Removing single pathed devices sdd {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c2f1fc-8e40-4813-8811-eae533144135]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4b55da-472f-44fc-ba2a-0cb0ab51b373]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Flushing IO for device /dev/sdd {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e45335-08a1-4e7a-85c7-0ccb01b9607d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acc310c-716d-44d7-9da3-1f887b6dc888]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d9829b-0657-49e4-8657-8cbbd812627f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e79839-a5f5-4728-a496-b5e1178fd68c]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16, portal: 172.16.0.220,3260]
Oct 20 10:16:26 user nova-compute[74311]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16, portal: 172.16.0.220,3260] successful.
Oct 20 10:16:26 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6744400-dc37-4058-8a21-5f6511e68e16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[122b52c7-f788-4272-9944-ead4c5a3257f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] <== disconnect_volume: return (343ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:16:26 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Deleting instance files /opt/stack/data/nova/instances/d604a60d-cb10-46a9-8b53-adec39a93a84_del
Oct 20 10:16:26 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Deletion of /opt/stack/data/nova/instances/d604a60d-cb10-46a9-8b53-adec39a93a84_del complete
Oct 20 10:16:26 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Instance destroyed successfully.
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1040491951',display_name='tempest-ServerActionsTestOtherB-server-1040491951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1040491951',id=3,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYMmO8U1tJG2uyGm7rRRFIfa2RGpjFLZUdepKCTj1HHDZcXkXVS7OOg3Lk+mu44EcWQu9Fu9KdlNYR4A7PzrCGtqSSIRfDMJT14TIDOTSonr8dNWJPGqynHBYamRxl9rg==',key_name='tempest-keypair-849637715',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d174f4a262b044e58e8f211b06a41d40',ramdisk_id='',reservation_id='r-z4cepc28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1319179529',owner_user_name='tempest-ServerActionsTestOtherB-1319179529-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:16:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b357b019ce2a4153af47b9e4c5586148',uuid=2fed360b-584a-4e1a-8e27-9189de7f5007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-767903600-network", "vif_mac": "fa:16:3e:08:6f:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converting VIF {"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-767903600-network", "vif_mac": "fa:16:3e:08:6f:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_vif [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa042b1af-30, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5fa8f30-5136-4ac8-8624-1980fd11b5c5) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:26 user nova-compute[74311]: INFO os_vif [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30')
Oct 20 10:16:26 user nova-compute[74311]: INFO nova.compute.manager [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Took 3.99 seconds to destroy the instance on the hypervisor.
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mRenVUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:16:26 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca179d4c-2778-4654-9fe2-6c5f3a19e3f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:16:26 user nova-compute[74311]: No targets found.
Oct 20 10:16:26 user nova-compute[74311]: iSNS:
Oct 20 10:16:26 user nova-compute[74311]: No targets found.
Oct 20 10:16:26 user nova-compute[74311]: STATIC:
Oct 20 10:16:26 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:16:26 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:26 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:26 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5
Oct 20 10:16:26 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:26 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:26 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8
Oct 20 10:16:26 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:26 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:26 user nova-compute[74311]: FIRMWARE:
Oct 20 10:16:26 user nova-compute[74311]: No targets found.
Oct 20 10:16:26 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:16:26 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:16:26 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b906bbc-3afe-4dd2-b420-57d0f40b40e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5826d7ff-f88f-49f7-9607-873cc903a54d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:26 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:26 user nova-compute[74311]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:16:26 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:26 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:26 user nova-compute[74311]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:16:26 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1ac3d77f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5'): ({'sdg'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Removing single pathed devices sdg {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc8a96e-a283-401f-9723-9715759524ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1df53d-c7e8-42bd-ab06-20ff28313df5]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Flushing IO for device /dev/sdg {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0b2534-de5d-44aa-bae2-d239ea09f20d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-f9e19dda-eda1-4115-9028-3d814859462c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-f9e19dda-eda1-4115-9028-3d814859462c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:26 user nova-compute[74311]: WARNING nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-f9e19dda-eda1-4115-9028-3d814859462c for instance with vm_state active and task_state deleting.
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-unplugged-45f7fdb4-ccdf-488d-9725-c15f461af479 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-unplugged-45f7fdb4-ccdf-488d-9725-c15f461af479 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-unplugged-45f7fdb4-ccdf-488d-9725-c15f461af479 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-45f7fdb4-ccdf-488d-9725-c15f461af479 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-45f7fdb4-ccdf-488d-9725-c15f461af479 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:26 user nova-compute[74311]: WARNING nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-45f7fdb4-ccdf-488d-9725-c15f461af479 for instance with vm_state active and task_state deleting.
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-unplugged-84d098d4-3ea0-41bf-8abc-c6d340094630 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-unplugged-84d098d4-3ea0-41bf-8abc-c6d340094630 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-unplugged-84d098d4-3ea0-41bf-8abc-c6d340094630 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-plugged-84d098d4-3ea0-41bf-8abc-c6d340094630 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Acquiring lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] No waiting events found dispatching network-vif-plugged-84d098d4-3ea0-41bf-8abc-c6d340094630 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:26 user nova-compute[74311]: WARNING nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received unexpected event network-vif-plugged-84d098d4-3ea0-41bf-8abc-c6d340094630 for instance with vm_state active and task_state deleting.
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-vif-unplugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] No waiting events found dispatching network-vif-unplugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:26 user nova-compute[74311]: WARNING nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received unexpected event network-vif-unplugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 for instance with vm_state active and task_state resize_migrating.
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] No waiting events found dispatching network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:26 user nova-compute[74311]: WARNING nova.compute.manager [req-a8a86b69-b5f0-4acb-8b61-64d1b7f1d78b req-647d05da-f35f-420b-a01e-7a6927a29285 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received unexpected event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 for instance with vm_state active and task_state resize_migrating.
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19307e5-9203-493a-a587-72e876857f73]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] SCSI volumes sdg have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d90925-f439-4b33-9f7c-bb4e3ff7cf9e]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ede79d-1737-4745-af47-ec9492e32b73]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260]
Oct 20 10:16:26 user nova-compute[74311]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260] successful.
Oct 20 10:16:26 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[336e7e20-3792-42e1-96c2-7cd7ebe54feb]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] <== disconnect_volume: return (334ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:16:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:16:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007_resize/disk /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CMD "cp -r /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007_resize/disk /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk" returned: 0 in 0.558s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007_resize/disk.info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk.info {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CMD "cp -r /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007_resize/disk.info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk.info" returned: 0 in 0.040s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:28 user nova-compute[74311]: DEBUG nova.compute.manager [req-4a22e15b-7ae8-4b91-b73f-17036dce5a5c req-95eae16c-8d6d-4e24-86c3-af4c58ceb323 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-deleted-1945a62d-3b78-4092-92cf-3609131863fd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:28 user nova-compute[74311]: INFO nova.compute.manager [req-4a22e15b-7ae8-4b91-b73f-17036dce5a5c req-95eae16c-8d6d-4e24-86c3-af4c58ceb323 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Neutron deleted interface 1945a62d-3b78-4092-92cf-3609131863fd; detaching it from the instance and deleting it from the info cache
Oct 20 10:16:28 user nova-compute[74311]: DEBUG nova.network.neutron [req-4a22e15b-7ae8-4b91-b73f-17036dce5a5c req-95eae16c-8d6d-4e24-86c3-af4c58ceb323 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updating instance_info_cache with network_info: [{"id": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "address": "fa:16:3e:a4:4c:e3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.214", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b06e65-3d", "ovs_interfaceid": "51b06e65-3d65-4b26-9f2c-9b1098f034f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "address": "fa:16:3e:58:d3:49", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4b55ba-9c", "ovs_interfaceid": "2d4b55ba-9c6e-4784-a967-8b0ab34053a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f9e19dda-eda1-4115-9028-3d814859462c", "address": "fa:16:3e:d8:03:d3", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e19dda-ed", "ovs_interfaceid": "f9e19dda-eda1-4115-9028-3d814859462c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d6213339-1858-41a4-b0ed-db8897a2dca7", "address": "fa:16:3e:1e:ef:d4", "network": {"id": "0a10b6c8-952d-460c-ad05-75a57bc09abd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1459139743", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6213339-18", "ovs_interfaceid": "d6213339-1858-41a4-b0ed-db8897a2dca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45f7fdb4-ccdf-488d-9725-c15f461af479", "address": "fa:16:3e:f7:27:e0", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45f7fdb4-cc", "ovs_interfaceid": "45f7fdb4-ccdf-488d-9725-c15f461af479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84d098d4-3ea0-41bf-8abc-c6d340094630", "address": "fa:16:3e:e2:ae:b4", "network": {"id": "5198fb67-a161-45d6-8909-997c0683fd68", "bridge": "br-int", "label": "tempest-device-tagging-net2-1773352751", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3f86d5595c8844db8ccdd70600dde9bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84d098d4-3e", "ovs_interfaceid": "84d098d4-3ea0-41bf-8abc-c6d340094630", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:16:28 user nova-compute[74311]: DEBUG nova.compute.manager [req-4a22e15b-7ae8-4b91-b73f-17036dce5a5c req-95eae16c-8d6d-4e24-86c3-af4c58ceb323 service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Detach interface failed, port_id=1945a62d-3b78-4092-92cf-3609131863fd, reason: Instance d604a60d-cb10-46a9-8b53-adec39a93a84 could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:16:29 user nova-compute[74311]: DEBUG nova.network.neutron [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Port a042b1af-3064-4133-97dc-eaf5e3bf4859 binding to destination host user is already ACTIVE {{(pid=74311) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 10:16:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:16:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquired lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:16:29 user nova-compute[74311]: DEBUG nova.network.neutron [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG nova.network.neutron [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating instance_info_cache with network_info: [{"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Releasing lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG os_brick.utils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af9b01c-93e8-4392-bd14-a999f46e0152]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa3f10c-e79c-4d37-a5d6-f631a2e22c9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28b6e70-e47e-4891-adf9-7638abdb132d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[805a04a4-c58d-427a-ac87-37c9e73bf1e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:16:30 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:16:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f51e97-8b6c-47fe-8849-663273edc125]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG os_brick.utils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:16:30 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Took 3.76 seconds to deallocate network for instance.
Oct 20 10:16:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-c3999502-3fd6-406c-8618-bb05f11a1f67 req-e7e8aeea-6e20-4a89-a5c6-866be921bb9c service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-deleted-84d098d4-3ea0-41bf-8abc-c6d340094630 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-c3999502-3fd6-406c-8618-bb05f11a1f67 req-e7e8aeea-6e20-4a89-a5c6-866be921bb9c service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-deleted-d6213339-1858-41a4-b0ed-db8897a2dca7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-c3999502-3fd6-406c-8618-bb05f11a1f67 req-e7e8aeea-6e20-4a89-a5c6-866be921bb9c service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-deleted-45f7fdb4-ccdf-488d-9725-c15f461af479 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-c3999502-3fd6-406c-8618-bb05f11a1f67 req-e7e8aeea-6e20-4a89-a5c6-866be921bb9c service nova] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Received event network-vif-deleted-f9e19dda-eda1-4115-9028-3d814859462c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irFMbDQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd5d019ce-3f5d-422c-b278-2b3cb3fd594a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 'serial': 'a4c94db1-73ff-4a10-a63d-6fed1bf2f53c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGFkOUtV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '13fca40a-d3b1-4d16-860b-9ddf99381bc8'}, 'status': 'reserved', 'instance': 'd5d019ce-3f5d-422c-b278-2b3cb3fd594a', 'attached_at': '', 'detached_at': '', 'volume_id': '13fca40a-d3b1-4d16-860b-9ddf99381bc8', 'serial'} {{(pid=74311) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irFMbDQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:16:33 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:16:33 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:16:33 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:33 user nova-compute[74311]: INFO nova.compute.manager [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] [instance: d604a60d-cb10-46a9-8b53-adec39a93a84] Took 3.11 seconds to detach 3 volumes for instance.
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1a2894-df10-4ca6-90c6-c247d2c1c078]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:16:33 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe2cf31-61df-402d-86a9-2379052dd68c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c] added
Oct 20 10:16:33 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f808716-bc49-4104-9167-592044ed6ade]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b095da8f-5cd9-4a38-9bf0-5c2dada181de]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v irFMbDQW {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v irFMbDQW" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94089c2-d982-4292-b664-9c6e52545c88]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'irFMbDQW'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3120747a-48cc-4b05-a821-c9e415ac43cf]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f65e2f8-a2cf-4a02-af91-119d639fe7c7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:33 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:33 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:33 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:33 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed34cfd7-2ae0-4738-8722-fd7a48cc241d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260]
Oct 20 10:16:33 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260] successful.
Oct 20 10:16:33 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4680a095-1214-475d-879c-86fdaa315920]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6648542f-4294-4aac-ade2-802baacfc029]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:33 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:33 user nova-compute[74311]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:16:33 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:33 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:33 user nova-compute[74311]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:16:33 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c36f835-f9a6-4f7f-9c41-fbdf17f6689a]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:16:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irFMbDQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:16:34 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:16:34 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:16:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:34 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Deleted allocations for instance d604a60d-cb10-46a9-8b53-adec39a93a84
Oct 20 10:16:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-938545ea-3858-4e01-b97e-b0ca96c923b4 tempest-TaggedBootDevicesTest-332152516 tempest-TaggedBootDevicesTest-332152516-project-member] Lock "d604a60d-cb10-46a9-8b53-adec39a93a84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.607s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:16:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23961336637336664', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:16:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961336637336664', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:16:34 user nova-compute[74311]: DEBUG nova.objects.instance [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lazy-loading 'flavor' on Instance uuid d5d019ce-3f5d-422c-b278-2b3cb3fd594a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:16:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:16:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 123731968 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:16:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 209715200 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:16:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 381681664 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:16:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 525336576 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:16:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 611319808 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:16:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 748683264 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:16:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 911212544 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:16:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 1050673152 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:16:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGFkOUtV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '13fca40a-d3b1-4d16-860b-9ddf99381bc8'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:16:40 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6ab5c7-5431-4db6-8425-bf376b00d4b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:16:40 user nova-compute[74311]: No targets found.
Oct 20 10:16:40 user nova-compute[74311]: iSNS:
Oct 20 10:16:40 user nova-compute[74311]: No targets found.
Oct 20 10:16:40 user nova-compute[74311]: STATIC:
Oct 20 10:16:40 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:16:40 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:40 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:40 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8
Oct 20 10:16:40 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:40 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:40 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c
Oct 20 10:16:40 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:16:40 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:16:40 user nova-compute[74311]: FIRMWARE:
Oct 20 10:16:40 user nova-compute[74311]: No targets found.
Oct 20 10:16:40 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:16:40 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:16:40 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d9aadb-c55b-4541-9a36-fa4955fab7e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b246202-52dc-40fd-922b-2d16ff35d6fb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:40 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:40 user nova-compute[74311]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:16:40 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 (non-flash)
Oct 20 10:16:40 user nova-compute[74311]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:40 user nova-compute[74311]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:16:40 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164fc1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8'): ({'sde'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Removing single pathed devices sde {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[32711417-ccc8-41f4-93a6-3fc25b35c676]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[072f34f7-d6b6-4db2-8acc-c928bf52190b]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Flushing IO for device /dev/sde {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7462de9-7078-4508-ba6c-e4344ad942da]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dc78a8-f875-4aeb-8057-7d20b6145f24]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] SCSI volumes sde have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ff5e65-f25b-411c-9071-cdf768d56852]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bffd647-d2e8-4a8c-9f42-3c2bbb7c5594]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8, portal: 172.16.0.220,3260]
Oct 20 10:16:40 user nova-compute[74311]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8, portal: 172.16.0.220,3260] successful.
Oct 20 10:16:40 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13fca40a-d3b1-4d16-860b-9ddf99381bc8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.065s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6605e5-c96e-410c-9af4-57f4ac04f7ee]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] <== disconnect_volume: return (348ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irFMbDQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd5d019ce-3f5d-422c-b278-2b3cb3fd594a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 'serial'} {{(pid=74311) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 20 10:16:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] swap_volume: removing Cinder connection for volume 13fca40a-d3b1-4d16-860b-9ddf99381bc8 {{(pid=74311) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 20 10:16:41 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] swap_volume: Updating volume 13fca40a-d3b1-4d16-860b-9ddf99381bc8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "irFMbDQW", "auth_password": "wHgX57KAIa4U2O", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "a4c94db1-73ff-4a10-a63d-6fed1bf2f53c"}, "status": "reserved", "instance": "d5d019ce-3f5d-422c-b278-2b3cb3fd594a", "attached_at": "", "detached_at": "", "volume_id": "a4c94db1-73ff-4a10-a63d-6fed1bf2f53c", "serial": "a4c94db1-73ff-4a10-a63d-6fed1bf2f53c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 'no_device': None, 'attachment_id': '5236c6d0-063f-4e9d-a1ff-0a399635f8f2'} {{(pid=74311) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 20 10:16:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5e7302c6-77ac-418f-8634-be923a0b6b63 tempest-TestVolumeSwap-1576045731 tempest-TestVolumeSwap-1576045731-project-admin] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 28.896s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:42 user nova-compute[74311]: INFO nova.compute.manager [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Detaching volume a4c94db1-73ff-4a10-a63d-6fed1bf2f53c
Oct 20 10:16:42 user nova-compute[74311]: INFO nova.virt.block_device [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Attempting to driver detach volume a4c94db1-73ff-4a10-a63d-6fed1bf2f53c from mountpoint /dev/vdb
Oct 20 10:16:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Attempting to detach device vdb from instance d5d019ce-3f5d-422c-b278-2b3cb3fd594a from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:16:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:16:42 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:16:42 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:16:42 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:16:42 user nova-compute[74311]:   <serial>a4c94db1-73ff-4a10-a63d-6fed1bf2f53c</serial>
Oct 20 10:16:42 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:16:42 user nova-compute[74311]: </disk>
Oct 20 10:16:42 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:16:42 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Successfully detached device vdb from instance d5d019ce-3f5d-422c-b278-2b3cb3fd594a from the persistent domain config.
Oct 20 10:16:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d5d019ce-3f5d-422c-b278-2b3cb3fd594a from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:16:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:16:42 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:16:42 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:16:42 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:16:42 user nova-compute[74311]:   <serial>a4c94db1-73ff-4a10-a63d-6fed1bf2f53c</serial>
Oct 20 10:16:42 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:16:42 user nova-compute[74311]: </disk>
Oct 20 10:16:42 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:16:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d5d019ce-3f5d-422c-b278-2b3cb3fd594a {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:16:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Starting finish_migration {{(pid=74311) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Instance directory exists: not creating {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 10:16:49 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Creating image(s)
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk. size=21474836480 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk 21474836480 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk 21474836480" returned: 0 in 0.066s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Ensure instance console log exists: /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Start _get_guest_xml network_info=[{"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-767903600-network", "vif_mac": "fa:16:3e:08:6f:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '8d22e140-0440-4ac6-abe9-080755907d09', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mRenVUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2fed360b-584a-4e1a-8e27-9189de7f5007', 'attached_at': '2023-10-20T10:16:49.000000', 'detached_at': '', 'volume_id': '5a032ca5-d6bb-4766-93df-a1109b708ff5', 'serial': '5a032ca5-d6bb-4766-93df-a1109b708ff5'}, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:16:49 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:16:49 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mRenVUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:16:49 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:16:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:16:49 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:16:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:16:49 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a127cc-7880-4c2e-8ddc-dbac51d23bfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:16:49 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21aa46f-c52b-453b-aba3-175bbbf6fd3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5] added
Oct 20 10:16:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7807ea5f-bf05-4800-bff0-0afb1beba0af]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f67944f-76f1-4f5b-9d82-cd159cb45b6e]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mRenVUQx {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mRenVUQx" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[604740d1-3db2-42ea-89ed-707992be50ae]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mRenVUQx'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb22c09-1dcc-43aa-a951-9e83c8661be2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99ddd6c-9e3f-4a43-8bf5-0a6369e9bf0d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:49 user nova-compute[74311]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:16:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:49 user nova-compute[74311]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:16:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[913d1651-10e0-486b-929a-3f3cba6195ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260]
Oct 20 10:16:49 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260] successful.
Oct 20 10:16:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c8d033-d02b-4c92-9524-c8b0e3b5185f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eca3a2f-30bd-43d0-8f6e-b180f3a666fb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:50 user nova-compute[74311]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:16:50 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:16:50 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:16:50 user nova-compute[74311]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:16:50 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:16:50 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dfaf10-7522-47a6-ab24-37be73e6cdde]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mRenVUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:16:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23735386434363531', 'path': '/dev/sdc'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735386434363531', 'path': '/dev/sdc'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1040491951',display_name='tempest-ServerActionsTestOtherB-server-1040491951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1040491951',id=3,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYMmO8U1tJG2uyGm7rRRFIfa2RGpjFLZUdepKCTj1HHDZcXkXVS7OOg3Lk+mu44EcWQu9Fu9KdlNYR4A7PzrCGtqSSIRfDMJT14TIDOTSonr8dNWJPGqynHBYamRxl9rg==',key_name='tempest-keypair-849637715',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d174f4a262b044e58e8f211b06a41d40',ramdisk_id='',reservation_id='r-z4cepc28',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1319179529',owner_user_name='tempest-ServerActionsTestOtherB-1319179529-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b357b019ce2a4153af47b9e4c5586148',uuid=2fed360b-584a-4e1a-8e27-9189de7f5007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-767903600-network", "vif_mac": "fa:16:3e:08:6f:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converting VIF {"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-767903600-network", "vif_mac": "fa:16:3e:08:6f:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:16:51 user nova-compute[74311]:   <uuid>2fed360b-584a-4e1a-8e27-9189de7f5007</uuid>
Oct 20 10:16:51 user nova-compute[74311]:   <name>instance-00000003</name>
Oct 20 10:16:51 user nova-compute[74311]:   <memory>2097152</memory>
Oct 20 10:16:51 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:16:51 user nova-compute[74311]:   <metadata>
Oct 20 10:16:51 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:16:51 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:16:51 user nova-compute[74311]:       <nova:name>tempest-ServerActionsTestOtherB-server-1040491951</nova:name>
Oct 20 10:16:51 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:16:49</nova:creationTime>
Oct 20 10:16:51 user nova-compute[74311]:       <nova:flavor name="m1.small">
Oct 20 10:16:51 user nova-compute[74311]:         <nova:memory>2048</nova:memory>
Oct 20 10:16:51 user nova-compute[74311]:         <nova:disk>20</nova:disk>
Oct 20 10:16:51 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:16:51 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:16:51 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:16:51 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:16:51 user nova-compute[74311]:       <nova:owner>
Oct 20 10:16:51 user nova-compute[74311]:         <nova:user uuid="b357b019ce2a4153af47b9e4c5586148">tempest-ServerActionsTestOtherB-1319179529-project-member</nova:user>
Oct 20 10:16:51 user nova-compute[74311]:         <nova:project uuid="d174f4a262b044e58e8f211b06a41d40">tempest-ServerActionsTestOtherB-1319179529</nova:project>
Oct 20 10:16:51 user nova-compute[74311]:       </nova:owner>
Oct 20 10:16:51 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:16:51 user nova-compute[74311]:       <nova:ports>
Oct 20 10:16:51 user nova-compute[74311]:         <nova:port uuid="a042b1af-3064-4133-97dc-eaf5e3bf4859">
Oct 20 10:16:51 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 10:16:51 user nova-compute[74311]:         </nova:port>
Oct 20 10:16:51 user nova-compute[74311]:       </nova:ports>
Oct 20 10:16:51 user nova-compute[74311]:     </nova:instance>
Oct 20 10:16:51 user nova-compute[74311]:   </metadata>
Oct 20 10:16:51 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:16:51 user nova-compute[74311]:     <system>
Oct 20 10:16:51 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:16:51 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:16:51 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:16:51 user nova-compute[74311]:       <entry name="serial">2fed360b-584a-4e1a-8e27-9189de7f5007</entry>
Oct 20 10:16:51 user nova-compute[74311]:       <entry name="uuid">2fed360b-584a-4e1a-8e27-9189de7f5007</entry>
Oct 20 10:16:51 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:16:51 user nova-compute[74311]:     </system>
Oct 20 10:16:51 user nova-compute[74311]:   </sysinfo>
Oct 20 10:16:51 user nova-compute[74311]:   <os>
Oct 20 10:16:51 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:16:51 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:16:51 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:16:51 user nova-compute[74311]:   </os>
Oct 20 10:16:51 user nova-compute[74311]:   <features>
Oct 20 10:16:51 user nova-compute[74311]:     <acpi/>
Oct 20 10:16:51 user nova-compute[74311]:     <apic/>
Oct 20 10:16:51 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:16:51 user nova-compute[74311]:   </features>
Oct 20 10:16:51 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:16:51 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:16:51 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:16:51 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:16:51 user nova-compute[74311]:   </clock>
Oct 20 10:16:51 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:16:51 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:16:51 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:16:51 user nova-compute[74311]:   </cpu>
Oct 20 10:16:51 user nova-compute[74311]:   <devices>
Oct 20 10:16:51 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:16:51 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:16:51 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk"/>
Oct 20 10:16:51 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:16:51 user nova-compute[74311]:     </disk>
Oct 20 10:16:51 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:16:51 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:16:51 user nova-compute[74311]:       <source dev="/dev/sdc"/>
Oct 20 10:16:51 user nova-compute[74311]:       <target dev="vdb" bus="virtio"/>
Oct 20 10:16:51 user nova-compute[74311]:       <serial>5a032ca5-d6bb-4766-93df-a1109b708ff5</serial>
Oct 20 10:16:51 user nova-compute[74311]:     </disk>
Oct 20 10:16:51 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:16:51 user nova-compute[74311]:       <mac address="fa:16:3e:08:6f:b2"/>
Oct 20 10:16:51 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:16:51 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:16:51 user nova-compute[74311]:       <target dev="tapa042b1af-30"/>
Oct 20 10:16:51 user nova-compute[74311]:     </interface>
Oct 20 10:16:51 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:16:51 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/console.log" append="off"/>
Oct 20 10:16:51 user nova-compute[74311]:     </serial>
Oct 20 10:16:51 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:16:51 user nova-compute[74311]:     <video>
Oct 20 10:16:51 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:16:51 user nova-compute[74311]:     </video>
Oct 20 10:16:51 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:16:51 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:16:51 user nova-compute[74311]:     </rng>
Oct 20 10:16:51 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:16:51 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:16:51 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:16:51 user nova-compute[74311]:     </memballoon>
Oct 20 10:16:51 user nova-compute[74311]:   </devices>
Oct 20 10:16:51 user nova-compute[74311]: </domain>
Oct 20 10:16:51 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1040491951',display_name='tempest-ServerActionsTestOtherB-server-1040491951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1040491951',id=3,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYMmO8U1tJG2uyGm7rRRFIfa2RGpjFLZUdepKCTj1HHDZcXkXVS7OOg3Lk+mu44EcWQu9Fu9KdlNYR4A7PzrCGtqSSIRfDMJT14TIDOTSonr8dNWJPGqynHBYamRxl9rg==',key_name='tempest-keypair-849637715',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d174f4a262b044e58e8f211b06a41d40',ramdisk_id='',reservation_id='r-z4cepc28',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1319179529',owner_user_name='tempest-ServerActionsTestOtherB-1319179529-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:16:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b357b019ce2a4153af47b9e4c5586148',uuid=2fed360b-584a-4e1a-8e27-9189de7f5007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-767903600-network", "vif_mac": "fa:16:3e:08:6f:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converting VIF {"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-767903600-network", "vif_mac": "fa:16:3e:08:6f:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG os_vif [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '952d5d0e-0445-5182-8a21-eafe36663d7b', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa042b1af-30, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa042b1af-30, col_values=(('qos', UUID('1cfaeb50-008d-435a-8f80-1b438ab6ac1e')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa042b1af-30, col_values=(('external_ids', {'iface-id': 'a042b1af-3064-4133-97dc-eaf5e3bf4859', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:6f:b2', 'vm-uuid': '2fed360b-584a-4e1a-8e27-9189de7f5007'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:51 user nova-compute[74311]: INFO os_vif [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30')
Oct 20 10:16:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] No VIF found with MAC fa:16:3e:08:6f:b2, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquiring lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:16:52 user nova-compute[74311]: INFO nova.compute.claims [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Claim successful on node user
Oct 20 10:16:52 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:52 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:16:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG nova.policy [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f7ebf77d5d2460482d0d7c26ac709e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20f2ab9ee4d04ea18abdf86db56293ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-4fe0c5dd-65d1-40fb-9d6c-b5bd1f30c62b req-39f643e8-5f01-447f-bf83-68101e2ff0d7 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4fe0c5dd-65d1-40fb-9d6c-b5bd1f30c62b req-39f643e8-5f01-447f-bf83-68101e2ff0d7 service nova] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4fe0c5dd-65d1-40fb-9d6c-b5bd1f30c62b req-39f643e8-5f01-447f-bf83-68101e2ff0d7 service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4fe0c5dd-65d1-40fb-9d6c-b5bd1f30c62b req-39f643e8-5f01-447f-bf83-68101e2ff0d7 service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-4fe0c5dd-65d1-40fb-9d6c-b5bd1f30c62b req-39f643e8-5f01-447f-bf83-68101e2ff0d7 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] No waiting events found dispatching network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:52 user nova-compute[74311]: WARNING nova.compute.manager [req-4fe0c5dd-65d1-40fb-9d6c-b5bd1f30c62b req-39f643e8-5f01-447f-bf83-68101e2ff0d7 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received unexpected event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 for instance with vm_state active and task_state resize_finish.
Oct 20 10:16:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:16:52 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Creating image(s)
Oct 20 10:16:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquiring lock "/opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "/opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "/opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.035s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.199s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk 1073741824" returned: 0 in 0.084s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Cannot resize image /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Ensure instance console log exists: /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:53 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Successfully created port: 0dc858ad-91da-4d3e-b2bc-91dca6b1687d {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Successfully updated port: 0dc858ad-91da-4d3e-b2bc-91dca6b1687d {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquiring lock "refresh_cache-710afd4b-9962-4ba4-b4ca-92c5d86a37d3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquired lock "refresh_cache-710afd4b-9962-4ba4-b4ca-92c5d86a37d3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-89226fee-5404-4811-8422-198d39bf33fd req-524f3d59-e1b2-4ff3-b71e-999405d360f8 service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Received event network-changed-0dc858ad-91da-4d3e-b2bc-91dca6b1687d {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-89226fee-5404-4811-8422-198d39bf33fd req-524f3d59-e1b2-4ff3-b71e-999405d360f8 service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Refreshing instance network info cache due to event network-changed-0dc858ad-91da-4d3e-b2bc-91dca6b1687d. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-89226fee-5404-4811-8422-198d39bf33fd req-524f3d59-e1b2-4ff3-b71e-999405d360f8 service nova] Acquiring lock "refresh_cache-710afd4b-9962-4ba4-b4ca-92c5d86a37d3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Updating instance_info_cache with network_info: [{"id": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "address": "fa:16:3e:f7:18:4e", "network": {"id": "2e0f174c-0d25-4e75-b715-2236fbcd5643", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1888182482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20f2ab9ee4d04ea18abdf86db56293ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc858ad-91", "ovs_interfaceid": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Releasing lock "refresh_cache-710afd4b-9962-4ba4-b4ca-92c5d86a37d3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Instance network_info: |[{"id": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "address": "fa:16:3e:f7:18:4e", "network": {"id": "2e0f174c-0d25-4e75-b715-2236fbcd5643", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1888182482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20f2ab9ee4d04ea18abdf86db56293ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc858ad-91", "ovs_interfaceid": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-89226fee-5404-4811-8422-198d39bf33fd req-524f3d59-e1b2-4ff3-b71e-999405d360f8 service nova] Acquired lock "refresh_cache-710afd4b-9962-4ba4-b4ca-92c5d86a37d3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.network.neutron [req-89226fee-5404-4811-8422-198d39bf33fd req-524f3d59-e1b2-4ff3-b71e-999405d360f8 service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Refreshing network info cache for port 0dc858ad-91da-4d3e-b2bc-91dca6b1687d {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Start _get_guest_xml network_info=[{"id": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "address": "fa:16:3e:f7:18:4e", "network": {"id": "2e0f174c-0d25-4e75-b715-2236fbcd5643", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1888182482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20f2ab9ee4d04ea18abdf86db56293ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc858ad-91", "ovs_interfaceid": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:16:54 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:16:54 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1445055521',display_name='tempest-DeleteServersTestJSON-server-1445055521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1445055521',id=16,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20f2ab9ee4d04ea18abdf86db56293ed',ramdisk_id='',reservation_id='r-wnmnyx8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-72673855',owner_user_name='tempest-DeleteServersTestJSON-72673855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:16:53Z,user_data=None,user_id='3f7ebf77d5d2460482d0d7c26ac709e0',uuid=710afd4b-9962-4ba4-b4ca-92c5d86a37d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "address": "fa:16:3e:f7:18:4e", "network": {"id": "2e0f174c-0d25-4e75-b715-2236fbcd5643", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1888182482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20f2ab9ee4d04ea18abdf86db56293ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc858ad-91", "ovs_interfaceid": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Converting VIF {"id": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "address": "fa:16:3e:f7:18:4e", "network": {"id": "2e0f174c-0d25-4e75-b715-2236fbcd5643", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1888182482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20f2ab9ee4d04ea18abdf86db56293ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc858ad-91", "ovs_interfaceid": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:18:4e,bridge_name='br-int',has_traffic_filtering=True,id=0dc858ad-91da-4d3e-b2bc-91dca6b1687d,network=Network(2e0f174c-0d25-4e75-b715-2236fbcd5643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dc858ad-91') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.objects.instance [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lazy-loading 'pci_devices' on Instance uuid 710afd4b-9962-4ba4-b4ca-92c5d86a37d3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-e302cb6c-12aa-4a05-9d15-5ac2c4216ef7 req-460354a0-f532-47ae-98ec-f3668dadb9e3 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e302cb6c-12aa-4a05-9d15-5ac2c4216ef7 req-460354a0-f532-47ae-98ec-f3668dadb9e3 service nova] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e302cb6c-12aa-4a05-9d15-5ac2c4216ef7 req-460354a0-f532-47ae-98ec-f3668dadb9e3 service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e302cb6c-12aa-4a05-9d15-5ac2c4216ef7 req-460354a0-f532-47ae-98ec-f3668dadb9e3 service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-e302cb6c-12aa-4a05-9d15-5ac2c4216ef7 req-460354a0-f532-47ae-98ec-f3668dadb9e3 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] No waiting events found dispatching network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:54 user nova-compute[74311]: WARNING nova.compute.manager [req-e302cb6c-12aa-4a05-9d15-5ac2c4216ef7 req-460354a0-f532-47ae-98ec-f3668dadb9e3 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received unexpected event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 for instance with vm_state active and task_state resize_finish.
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:16:54 user nova-compute[74311]:   <uuid>710afd4b-9962-4ba4-b4ca-92c5d86a37d3</uuid>
Oct 20 10:16:54 user nova-compute[74311]:   <name>instance-00000010</name>
Oct 20 10:16:54 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:16:54 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:16:54 user nova-compute[74311]:   <metadata>
Oct 20 10:16:54 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:16:54 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:16:54 user nova-compute[74311]:       <nova:name>tempest-DeleteServersTestJSON-server-1445055521</nova:name>
Oct 20 10:16:54 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:16:54</nova:creationTime>
Oct 20 10:16:54 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:16:54 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:16:54 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:16:54 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:16:54 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:16:54 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:16:54 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:16:54 user nova-compute[74311]:       <nova:owner>
Oct 20 10:16:54 user nova-compute[74311]:         <nova:user uuid="3f7ebf77d5d2460482d0d7c26ac709e0">tempest-DeleteServersTestJSON-72673855-project-member</nova:user>
Oct 20 10:16:54 user nova-compute[74311]:         <nova:project uuid="20f2ab9ee4d04ea18abdf86db56293ed">tempest-DeleteServersTestJSON-72673855</nova:project>
Oct 20 10:16:54 user nova-compute[74311]:       </nova:owner>
Oct 20 10:16:54 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:16:54 user nova-compute[74311]:       <nova:ports>
Oct 20 10:16:54 user nova-compute[74311]:         <nova:port uuid="0dc858ad-91da-4d3e-b2bc-91dca6b1687d">
Oct 20 10:16:54 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 10:16:54 user nova-compute[74311]:         </nova:port>
Oct 20 10:16:54 user nova-compute[74311]:       </nova:ports>
Oct 20 10:16:54 user nova-compute[74311]:     </nova:instance>
Oct 20 10:16:54 user nova-compute[74311]:   </metadata>
Oct 20 10:16:54 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:16:54 user nova-compute[74311]:     <system>
Oct 20 10:16:54 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:16:54 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:16:54 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:16:54 user nova-compute[74311]:       <entry name="serial">710afd4b-9962-4ba4-b4ca-92c5d86a37d3</entry>
Oct 20 10:16:54 user nova-compute[74311]:       <entry name="uuid">710afd4b-9962-4ba4-b4ca-92c5d86a37d3</entry>
Oct 20 10:16:54 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:16:54 user nova-compute[74311]:     </system>
Oct 20 10:16:54 user nova-compute[74311]:   </sysinfo>
Oct 20 10:16:54 user nova-compute[74311]:   <os>
Oct 20 10:16:54 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:16:54 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:16:54 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:16:54 user nova-compute[74311]:   </os>
Oct 20 10:16:54 user nova-compute[74311]:   <features>
Oct 20 10:16:54 user nova-compute[74311]:     <acpi/>
Oct 20 10:16:54 user nova-compute[74311]:     <apic/>
Oct 20 10:16:54 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:16:54 user nova-compute[74311]:   </features>
Oct 20 10:16:54 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:16:54 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:16:54 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:16:54 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:16:54 user nova-compute[74311]:   </clock>
Oct 20 10:16:54 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:16:54 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:16:54 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:16:54 user nova-compute[74311]:   </cpu>
Oct 20 10:16:54 user nova-compute[74311]:   <devices>
Oct 20 10:16:54 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:16:54 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:16:54 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk"/>
Oct 20 10:16:54 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:16:54 user nova-compute[74311]:     </disk>
Oct 20 10:16:54 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:16:54 user nova-compute[74311]:       <mac address="fa:16:3e:f7:18:4e"/>
Oct 20 10:16:54 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:16:54 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:16:54 user nova-compute[74311]:       <target dev="tap0dc858ad-91"/>
Oct 20 10:16:54 user nova-compute[74311]:     </interface>
Oct 20 10:16:54 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:16:54 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/console.log" append="off"/>
Oct 20 10:16:54 user nova-compute[74311]:     </serial>
Oct 20 10:16:54 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:16:54 user nova-compute[74311]:     <video>
Oct 20 10:16:54 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:16:54 user nova-compute[74311]:     </video>
Oct 20 10:16:54 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:16:54 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:16:54 user nova-compute[74311]:     </rng>
Oct 20 10:16:54 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:16:54 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:16:54 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:16:54 user nova-compute[74311]:     </memballoon>
Oct 20 10:16:54 user nova-compute[74311]:   </devices>
Oct 20 10:16:54 user nova-compute[74311]: </domain>
Oct 20 10:16:54 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1445055521',display_name='tempest-DeleteServersTestJSON-server-1445055521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1445055521',id=16,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20f2ab9ee4d04ea18abdf86db56293ed',ramdisk_id='',reservation_id='r-wnmnyx8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-72673855',owner_user_name='tempest-DeleteServersTestJSON-72673855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:16:53Z,user_data=None,user_id='3f7ebf77d5d2460482d0d7c26ac709e0',uuid=710afd4b-9962-4ba4-b4ca-92c5d86a37d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "address": "fa:16:3e:f7:18:4e", "network": {"id": "2e0f174c-0d25-4e75-b715-2236fbcd5643", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1888182482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20f2ab9ee4d04ea18abdf86db56293ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc858ad-91", "ovs_interfaceid": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Converting VIF {"id": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "address": "fa:16:3e:f7:18:4e", "network": {"id": "2e0f174c-0d25-4e75-b715-2236fbcd5643", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1888182482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20f2ab9ee4d04ea18abdf86db56293ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc858ad-91", "ovs_interfaceid": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:18:4e,bridge_name='br-int',has_traffic_filtering=True,id=0dc858ad-91da-4d3e-b2bc-91dca6b1687d,network=Network(2e0f174c-0d25-4e75-b715-2236fbcd5643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dc858ad-91') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG os_vif [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:18:4e,bridge_name='br-int',has_traffic_filtering=True,id=0dc858ad-91da-4d3e-b2bc-91dca6b1687d,network=Network(2e0f174c-0d25-4e75-b715-2236fbcd5643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dc858ad-91') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10e27cad-59a1-5690-9dae-78626e22a538', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dc858ad-91, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dc858ad-91, col_values=(('qos', UUID('9caf1b32-d3de-4f96-a3e1-bd3e9b8d2ce2')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dc858ad-91, col_values=(('external_ids', {'iface-id': '0dc858ad-91da-4d3e-b2bc-91dca6b1687d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:18:4e', 'vm-uuid': '710afd4b-9962-4ba4-b4ca-92c5d86a37d3'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:54 user nova-compute[74311]: INFO os_vif [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:18:4e,bridge_name='br-int',has_traffic_filtering=True,id=0dc858ad-91da-4d3e-b2bc-91dca6b1687d,network=Network(2e0f174c-0d25-4e75-b715-2236fbcd5643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dc858ad-91')
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.compute.manager [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:16:54 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Instance running successfully.
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Failed to set time: agent not configured {{(pid=74311) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa07f329-a347-40e0-994f-aaae1381954e tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] finish_migration finished successfully. {{(pid=74311) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:16:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] No VIF found with MAC fa:16:3e:f7:18:4e, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:16:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:16:55 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:16:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-ed823684-5b31-4b43-a601-bb5e303e0863" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:16:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-ed823684-5b31-4b43-a601-bb5e303e0863" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:16:55 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:16:55 user nova-compute[74311]: DEBUG nova.network.neutron [req-89226fee-5404-4811-8422-198d39bf33fd req-524f3d59-e1b2-4ff3-b71e-999405d360f8 service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Updated VIF entry in instance network info cache for port 0dc858ad-91da-4d3e-b2bc-91dca6b1687d. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:16:55 user nova-compute[74311]: DEBUG nova.network.neutron [req-89226fee-5404-4811-8422-198d39bf33fd req-524f3d59-e1b2-4ff3-b71e-999405d360f8 service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Updating instance_info_cache with network_info: [{"id": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "address": "fa:16:3e:f7:18:4e", "network": {"id": "2e0f174c-0d25-4e75-b715-2236fbcd5643", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1888182482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20f2ab9ee4d04ea18abdf86db56293ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc858ad-91", "ovs_interfaceid": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:16:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-89226fee-5404-4811-8422-198d39bf33fd req-524f3d59-e1b2-4ff3-b71e-999405d360f8 service nova] Releasing lock "refresh_cache-710afd4b-9962-4ba4-b4ca-92c5d86a37d3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:16:55 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Updating instance_info_cache with network_info: [{"id": "24cefeda-ceaf-460b-b902-a5895a6bb394", "address": "fa:16:3e:08:f0:9b", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cefeda-ce", "ovs_interfaceid": "24cefeda-ceaf-460b-b902-a5895a6bb394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:16:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-ed823684-5b31-4b43-a601-bb5e303e0863" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:16:55 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:16:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:16:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:57 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:16:57 user nova-compute[74311]: DEBUG nova.compute.manager [req-acfb380d-26a5-4778-9be6-2db3a126d8b4 req-f700b80a-e709-4b9e-9c69-ed996e2aad2f service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Received event network-vif-plugged-0dc858ad-91da-4d3e-b2bc-91dca6b1687d {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-acfb380d-26a5-4778-9be6-2db3a126d8b4 req-f700b80a-e709-4b9e-9c69-ed996e2aad2f service nova] Acquiring lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-acfb380d-26a5-4778-9be6-2db3a126d8b4 req-f700b80a-e709-4b9e-9c69-ed996e2aad2f service nova] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-acfb380d-26a5-4778-9be6-2db3a126d8b4 req-f700b80a-e709-4b9e-9c69-ed996e2aad2f service nova] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:57 user nova-compute[74311]: DEBUG nova.compute.manager [req-acfb380d-26a5-4778-9be6-2db3a126d8b4 req-f700b80a-e709-4b9e-9c69-ed996e2aad2f service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] No waiting events found dispatching network-vif-plugged-0dc858ad-91da-4d3e-b2bc-91dca6b1687d {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:57 user nova-compute[74311]: WARNING nova.compute.manager [req-acfb380d-26a5-4778-9be6-2db3a126d8b4 req-f700b80a-e709-4b9e-9c69-ed996e2aad2f service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Received unexpected event network-vif-plugged-0dc858ad-91da-4d3e-b2bc-91dca6b1687d for instance with vm_state building and task_state spawning.
Oct 20 10:16:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:16:57 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:16:58 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:16:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:16:58 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Instance spawned successfully.
Oct 20 10:16:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:16:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:16:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:16:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:16:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:16:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:16:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:16:58 user nova-compute[74311]: INFO nova.compute.manager [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Took 5.92 seconds to spawn the instance on the hypervisor.
Oct 20 10:16:58 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:16:58 user nova-compute[74311]: INFO nova.compute.manager [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Took 6.82 seconds to build instance.
Oct 20 10:16:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4d4d0044-c3ac-485f-b939-706466067039 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.957s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:59 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:16:59 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:16:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-9abf251a-9e88-41df-b65e-417ee3771fe2 req-8b1d28f4-1db2-4928-8668-ea7990c5f26b service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Received event network-vif-plugged-0dc858ad-91da-4d3e-b2bc-91dca6b1687d {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:16:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9abf251a-9e88-41df-b65e-417ee3771fe2 req-8b1d28f4-1db2-4928-8668-ea7990c5f26b service nova] Acquiring lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:16:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9abf251a-9e88-41df-b65e-417ee3771fe2 req-8b1d28f4-1db2-4928-8668-ea7990c5f26b service nova] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:16:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9abf251a-9e88-41df-b65e-417ee3771fe2 req-8b1d28f4-1db2-4928-8668-ea7990c5f26b service nova] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:16:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-9abf251a-9e88-41df-b65e-417ee3771fe2 req-8b1d28f4-1db2-4928-8668-ea7990c5f26b service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] No waiting events found dispatching network-vif-plugged-0dc858ad-91da-4d3e-b2bc-91dca6b1687d {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:16:59 user nova-compute[74311]: WARNING nova.compute.manager [req-9abf251a-9e88-41df-b65e-417ee3771fe2 req-8b1d28f4-1db2-4928-8668-ea7990c5f26b service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Received unexpected event network-vif-plugged-0dc858ad-91da-4d3e-b2bc-91dca6b1687d for instance with vm_state active and task_state None.
Oct 20 10:16:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:00 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:17:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:00 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:17:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:02 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:17:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:02 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:03 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d5d019ce-3f5d-422c-b278-2b3cb3fd594a is timed out.
Oct 20 10:17:03 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Successfully detached device vdb from instance d5d019ce-3f5d-422c-b278-2b3cb3fd594a from the live domain config.
Oct 20 10:17:03 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'irFMbDQW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'a4c94db1-73ff-4a10-a63d-6fed1bf2f53c'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:17:03 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f757f17-e4c8-49dd-ab5e-ef82fba7ec1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:17:03 user nova-compute[74311]: No targets found.
Oct 20 10:17:03 user nova-compute[74311]: iSNS:
Oct 20 10:17:03 user nova-compute[74311]: No targets found.
Oct 20 10:17:03 user nova-compute[74311]: STATIC:
Oct 20 10:17:03 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:17:03 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:17:03 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:17:03 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5
Oct 20 10:17:03 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:17:03 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:17:03 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c
Oct 20 10:17:03 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:17:03 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:17:03 user nova-compute[74311]: FIRMWARE:
Oct 20 10:17:03 user nova-compute[74311]: No targets found.
Oct 20 10:17:03 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:17:03 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:17:03 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[27583676-3830-4d49-a1cc-99e06ad155bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb6e3e4-0658-4a66-8b82-c7ec8157f852]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:17:03 user nova-compute[74311]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:17:03 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:17:03 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:17:03 user nova-compute[74311]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c (non-flash)
Oct 20 10:17:03 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:17:03 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164e43be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c41f0d-2a4a-40c9-a761-23a68b14565a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b639b24d-22ea-4f9f-8636-6b77534eb506]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb521c18-aa2e-4927-90fd-40bfd7369e8f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed9ebc5-2185-46c0-badb-847574767d56]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e396ae6d-9910-4593-b798-494b47ffd66c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b022155-2f22-4b51-a25a-c4354714e19e]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260]
Oct 20 10:17:03 user nova-compute[74311]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c, portal: 172.16.0.220,3260] successful.
Oct 20 10:17:03 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4c94db1-73ff-4a10-a63d-6fed1bf2f53c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3fb0c0-34cc-461d-b233-d1aa40eeb5d1]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.822s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] <== disconnect_volume: return (824ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:17:04 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:17:04 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7637MB free_disk=25.434776306152344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Applying migration context for instance 2fed360b-584a-4e1a-8e27-9189de7f5007 as it has an incoming, in-progress migration dd8a86a6-bba1-457d-8599-8dbfac07dcec. Migration status is finished {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 10:17:04 user nova-compute[74311]: INFO nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating resource usage from migration dd8a86a6-bba1-457d-8599-8dbfac07dcec
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 47a30844-242f-4a7f-ad9f-232a6e76b4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ed823684-5b31-4b43-a601-bb5e303e0863 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance d5d019ce-3f5d-422c-b278-2b3cb3fd594a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c8e0cb34-d304-4405-862f-a4118e729083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Migration dd8a86a6-bba1-457d-8599-8dbfac07dcec is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2fed360b-584a-4e1a-8e27-9189de7f5007 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 710afd4b-9962-4ba4-b4ca-92c5d86a37d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:17:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:05 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:17:05 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:17:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:17:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.791s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:05 user nova-compute[74311]: DEBUG nova.objects.instance [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lazy-loading 'flavor' on Instance uuid d5d019ce-3f5d-422c-b278-2b3cb3fd594a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:17:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9597a61b-ba3f-48a7-90cf-6553f9700953 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.824s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:06 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:17:06 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:17:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:17:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:16 user nova-compute[74311]: DEBUG nova.compute.manager [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:17:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:16 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:17:16 user nova-compute[74311]: INFO nova.compute.claims [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Claim successful on node user
Oct 20 10:17:17 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.609s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG nova.compute.manager [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG nova.compute.manager [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG nova.network.neutron [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:17:17 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:17:17 user nova-compute[74311]: DEBUG nova.compute.manager [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG nova.policy [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d74f45f32004531a84f76f16254d459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dd35c1e7d774f1db10dce2f42915a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:17:17 user nova-compute[74311]: INFO nova.virt.block_device [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Booting with volume 472b7899-fb18-4cf3-aed5-dd75907cc03f at /dev/vda
Oct 20 10:17:17 user nova-compute[74311]: DEBUG os_brick.utils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e371267-a624-4257-9e4f-be89e8037afd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3363a25-59c8-4a15-8805-24955873c3b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[91be2f95-2166-4626-b104-b666900a52c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e75f51-9e61-420a-a279-ae4a2d22e3ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:17:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:17:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:17:18 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:17:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef17eb29-6ac6-49c1-a85d-d9980f8ed40d]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:17:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:17:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:17:18 user nova-compute[74311]: DEBUG os_brick.utils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:17:18 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updating existing volume attachment record: 9193190c-bf66-4e1a-82e3-10cd5e7a5acb {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:17:19 user nova-compute[74311]: DEBUG nova.network.neutron [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Successfully created port: 75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:17:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Successfully updated port: 75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:17:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:17:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquired lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:17:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:17:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-4f23c9cd-a832-41c3-889f-0141a17d80ef req-1e3a2044-fbfd-4a5c-b7d9-f6a989fce00b service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-changed-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-4f23c9cd-a832-41c3-889f-0141a17d80ef req-1e3a2044-fbfd-4a5c-b7d9-f6a989fce00b service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Refreshing instance network info cache due to event network-changed-75daa4b7-a58b-4b60-afe8-97f535c09013. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:17:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4f23c9cd-a832-41c3-889f-0141a17d80ef req-1e3a2044-fbfd-4a5c-b7d9-f6a989fce00b service nova] Acquiring lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:17:21 user nova-compute[74311]: DEBUG nova.network.neutron [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:17:21 user nova-compute[74311]: DEBUG nova.network.neutron [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updating instance_info_cache with network_info: [{"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:17:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Releasing lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:17:21 user nova-compute[74311]: DEBUG nova.compute.manager [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Instance network_info: |[{"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:17:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4f23c9cd-a832-41c3-889f-0141a17d80ef req-1e3a2044-fbfd-4a5c-b7d9-f6a989fce00b service nova] Acquired lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:17:21 user nova-compute[74311]: DEBUG nova.network.neutron [req-4f23c9cd-a832-41c3-889f-0141a17d80ef req-1e3a2044-fbfd-4a5c-b7d9-f6a989fce00b service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Refreshing network info cache for port 75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:17:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:22 user nova-compute[74311]: DEBUG nova.network.neutron [req-4f23c9cd-a832-41c3-889f-0141a17d80ef req-1e3a2044-fbfd-4a5c-b7d9-f6a989fce00b service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updated VIF entry in instance network info cache for port 75daa4b7-a58b-4b60-afe8-97f535c09013. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:17:22 user nova-compute[74311]: DEBUG nova.network.neutron [req-4f23c9cd-a832-41c3-889f-0141a17d80ef req-1e3a2044-fbfd-4a5c-b7d9-f6a989fce00b service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updating instance_info_cache with network_info: [{"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:17:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4f23c9cd-a832-41c3-889f-0141a17d80ef req-1e3a2044-fbfd-4a5c-b7d9-f6a989fce00b service nova] Releasing lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:17:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:33 user nova-compute[74311]: INFO nova.compute.manager [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Terminating instance
Oct 20 10:17:33 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-422fc29f-0928-4c84-9830-95bd73f2b187 req-3824477e-304d-4697-8364-c2a269a36ea2 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Received event network-vif-unplugged-e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-422fc29f-0928-4c84-9830-95bd73f2b187 req-3824477e-304d-4697-8364-c2a269a36ea2 service nova] Acquiring lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-422fc29f-0928-4c84-9830-95bd73f2b187 req-3824477e-304d-4697-8364-c2a269a36ea2 service nova] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-422fc29f-0928-4c84-9830-95bd73f2b187 req-3824477e-304d-4697-8364-c2a269a36ea2 service nova] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-422fc29f-0928-4c84-9830-95bd73f2b187 req-3824477e-304d-4697-8364-c2a269a36ea2 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] No waiting events found dispatching network-vif-unplugged-e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:17:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-422fc29f-0928-4c84-9830-95bd73f2b187 req-3824477e-304d-4697-8364-c2a269a36ea2 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Received event network-vif-unplugged-e147adef-a22c-42a1-918d-12fcf3203eb7 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:17:34 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Instance destroyed successfully.
Oct 20 10:17:34 user nova-compute[74311]: DEBUG nova.objects.instance [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lazy-loading 'resources' on Instance uuid d5d019ce-3f5d-422c-b278-2b3cb3fd594a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1208823009',display_name='tempest-TestVolumeSwap-server-1208823009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1208823009',id=10,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8HCBfT+LhLY/EWh5/L1zh3OI6zildNojXskaKWO27zVxcHxuSVHV1Iscr5cNp2N+R0Jy9qm4n5eKtkf2voufStnvoOZwddUuRjz2v5ZJ5UVDLM73IWm8CWZPG83uCAIw==',key_name='tempest-keypair-1478848687',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:13:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abab5999f8db4c76b520f5988643941f',ramdisk_id='',reservation_id='r-9g192dr2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-72109064',owner_user_name='tempest-TestVolumeSwap-72109064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:13:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbf471485c5947698b36ed81a4b784ad',uuid=d5d019ce-3f5d-422c-b278-2b3cb3fd594a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e147adef-a22c-42a1-918d-12fcf3203eb7", "address": "fa:16:3e:05:ab:49", "network": {"id": "f43a19cd-be0a-44a9-9e9d-4710422e489e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942278319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abab5999f8db4c76b520f5988643941f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape147adef-a2", "ovs_interfaceid": "e147adef-a22c-42a1-918d-12fcf3203eb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Converting VIF {"id": "e147adef-a22c-42a1-918d-12fcf3203eb7", "address": "fa:16:3e:05:ab:49", "network": {"id": "f43a19cd-be0a-44a9-9e9d-4710422e489e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942278319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abab5999f8db4c76b520f5988643941f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape147adef-a2", "ovs_interfaceid": "e147adef-a22c-42a1-918d-12fcf3203eb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:ab:49,bridge_name='br-int',has_traffic_filtering=True,id=e147adef-a22c-42a1-918d-12fcf3203eb7,network=Network(f43a19cd-be0a-44a9-9e9d-4710422e489e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape147adef-a2') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG os_vif [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:ab:49,bridge_name='br-int',has_traffic_filtering=True,id=e147adef-a22c-42a1-918d-12fcf3203eb7,network=Network(f43a19cd-be0a-44a9-9e9d-4710422e489e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape147adef-a2') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape147adef-a2, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=115d2efd-5f03-447d-aa22-f15f8548abc2) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:34 user nova-compute[74311]: INFO os_vif [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:ab:49,bridge_name='br-int',has_traffic_filtering=True,id=e147adef-a22c-42a1-918d-12fcf3203eb7,network=Network(f43a19cd-be0a-44a9-9e9d-4710422e489e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape147adef-a2')
Oct 20 10:17:34 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Deleting instance files /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a_del
Oct 20 10:17:34 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Deletion of /opt/stack/data/nova/instances/d5d019ce-3f5d-422c-b278-2b3cb3fd594a_del complete
Oct 20 10:17:34 user nova-compute[74311]: INFO nova.compute.manager [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 20 10:17:34 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:17:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:35 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:17:35 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Took 1.27 seconds to deallocate network for instance.
Oct 20 10:17:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-4714c62a-2a03-44bb-8ff5-c550dcc48cc3 req-1acfcdfa-ef3a-406b-98b0-5e4c9b3d2db3 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Received event network-vif-plugged-e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4714c62a-2a03-44bb-8ff5-c550dcc48cc3 req-1acfcdfa-ef3a-406b-98b0-5e4c9b3d2db3 service nova] Acquiring lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4714c62a-2a03-44bb-8ff5-c550dcc48cc3 req-1acfcdfa-ef3a-406b-98b0-5e4c9b3d2db3 service nova] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4714c62a-2a03-44bb-8ff5-c550dcc48cc3 req-1acfcdfa-ef3a-406b-98b0-5e4c9b3d2db3 service nova] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-4714c62a-2a03-44bb-8ff5-c550dcc48cc3 req-1acfcdfa-ef3a-406b-98b0-5e4c9b3d2db3 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] No waiting events found dispatching network-vif-plugged-e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:17:35 user nova-compute[74311]: WARNING nova.compute.manager [req-4714c62a-2a03-44bb-8ff5-c550dcc48cc3 req-1acfcdfa-ef3a-406b-98b0-5e4c9b3d2db3 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Received unexpected event network-vif-plugged-e147adef-a22c-42a1-918d-12fcf3203eb7 for instance with vm_state deleted and task_state None.
Oct 20 10:17:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-4714c62a-2a03-44bb-8ff5-c550dcc48cc3 req-1acfcdfa-ef3a-406b-98b0-5e4c9b3d2db3 service nova] [instance: d5d019ce-3f5d-422c-b278-2b3cb3fd594a] Received event network-vif-deleted-e147adef-a22c-42a1-918d-12fcf3203eb7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:35 user nova-compute[74311]: DEBUG nova.compute.manager [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:17:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:36 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:17:36 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:17:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.605s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.167s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:17:36 user nova-compute[74311]: INFO nova.compute.claims [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Claim successful on node user
Oct 20 10:17:36 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Deleted allocations for instance d5d019ce-3f5d-422c-b278-2b3cb3fd594a
Oct 20 10:17:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b3b6f6da-bc6b-46d9-a340-bbc913992609 tempest-TestVolumeSwap-72109064 tempest-TestVolumeSwap-72109064-project-member] Lock "d5d019ce-3f5d-422c-b278-2b3cb3fd594a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.042s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:36 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:17:36 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:17:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:36 user nova-compute[74311]: DEBUG nova.compute.manager [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:17:36 user nova-compute[74311]: DEBUG nova.compute.manager [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:17:36 user nova-compute[74311]: DEBUG nova.network.neutron [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:17:36 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:17:36 user nova-compute[74311]: DEBUG nova.compute.manager [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:17:36 user nova-compute[74311]: DEBUG nova.policy [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3599c6c5ec984a3599dbdd732ffd0977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f725dba626242d6ada4ccceab72c55c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.compute.manager [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:17:37 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Creating image(s)
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "/opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "/opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk 1073741824" returned: 0 in 0.051s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.network.neutron [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Successfully created port: 98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Cannot resize image /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Ensure instance console log exists: /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.compute.manager [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:17:37 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Creating image(s)
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Ensure instance console log exists: /opt/stack/data/nova/instances/dcecd43c-0d21-4413-8fa5-02856f450b6a/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Start _get_guest_xml network_info=[{"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '9193190c-bf66-4e1a-82e3-10cd5e7a5acb', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGCHmwir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dcecd43c-0d21-4413-8fa5-02856f450b6a', 'attached_at': '', 'detached_at': '', 'volume_id': '472b7899-fb18-4cf3-aed5-dd75907cc03f', 'serial': '472b7899-fb18-4cf3-aed5-dd75907cc03f'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:17:37 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:17:37 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGCHmwir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:17:37 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:17:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:17:37 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:17:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:17:37 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ef2117-1571-4718-b8fd-2533a219cbe3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:17:37 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7a5e2b-79ba-4304-a1e8-ceb3409b1166]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f] added
Oct 20 10:17:37 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e145274-dff5-4eef-8850-89cf5b7d7f87]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.101s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffd38f4-0d2a-4047-b073-dfbbcb7e2223]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGCHmwir {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGCHmwir" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0782d87-6ac2-4dfa-89df-aa284858d5a5]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pGCHmwir'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c280b625-2c2a-477e-9c8c-f05b9f63a401]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e911733-f8ee-4149-922c-b4c78436ff6c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:17:38 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:17:38 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:17:38 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:17:38 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7f201d-951c-4af5-a63f-538f0202522d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260]
Oct 20 10:17:38 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260] successful.
Oct 20 10:17:38 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bffb9c-ec64-4b18-a9d9-78597c31e96b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fde4c2c-dbcb-46f1-8938-49d07921881b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:17:38 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:17:38 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:17:38 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:17:38 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:17:38 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:17:38 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ad5bf5-096c-4a3f-8bf5-d0bd15169c31]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGCHmwir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.network.neutron [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Successfully updated port: 98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquired lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.network.neutron [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.compute.manager [req-ca13123a-5ea7-403f-8da6-6b8381a27521 req-63e2c0f8-8404-47e7-8cc0-db2caa4c900f service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-changed-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.compute.manager [req-ca13123a-5ea7-403f-8da6-6b8381a27521 req-63e2c0f8-8404-47e7-8cc0-db2caa4c900f service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Refreshing instance network info cache due to event network-changed-98eb8ce2-6b43-43ac-99f6-e908d0688d20. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ca13123a-5ea7-403f-8da6-6b8381a27521 req-63e2c0f8-8404-47e7-8cc0-db2caa4c900f service nova] Acquiring lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.network.neutron [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.network.neutron [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Updating instance_info_cache with network_info: [{"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Releasing lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Instance network_info: |[{"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ca13123a-5ea7-403f-8da6-6b8381a27521 req-63e2c0f8-8404-47e7-8cc0-db2caa4c900f service nova] Acquired lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.network.neutron [req-ca13123a-5ea7-403f-8da6-6b8381a27521 req-63e2c0f8-8404-47e7-8cc0-db2caa4c900f service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Refreshing network info cache for port 98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Start _get_guest_xml network_info=[{"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:17:38 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:17:38 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1673768130',display_name='tempest-AttachVolumeTestJSON-server-1673768130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1673768130',id=18,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJYcmNlzLpysvhxPxGUSP0j7sh5O9o25thL4eCR81ZsGW+B6UHXUeUQVHkIIazQJidMRU0G/6rN9EQv2+Mt89HRMjWiUYCfGHIzOVJ/WhTEW9pqoD8o/FnFRAAvE/JYDw==',key_name='tempest-keypair-2078286093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f725dba626242d6ada4ccceab72c55c',ramdisk_id='',reservation_id='r-dtf2wxoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1992975846',owner_user_name='tempest-AttachVolumeTestJSON-1992975846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3599c6c5ec984a3599dbdd732ffd0977',uuid=6a964d89-1f48-405b-bf64-31b9eef9ece3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converting VIF {"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.objects.instance [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:17:38 user nova-compute[74311]: INFO nova.compute.claims [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Claim successful on node user
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:17:38 user nova-compute[74311]:   <uuid>6a964d89-1f48-405b-bf64-31b9eef9ece3</uuid>
Oct 20 10:17:38 user nova-compute[74311]:   <name>instance-00000012</name>
Oct 20 10:17:38 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:17:38 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:17:38 user nova-compute[74311]:   <metadata>
Oct 20 10:17:38 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:17:38 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:17:38 user nova-compute[74311]:       <nova:name>tempest-AttachVolumeTestJSON-server-1673768130</nova:name>
Oct 20 10:17:38 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:17:38</nova:creationTime>
Oct 20 10:17:38 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:17:38 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:17:38 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:17:38 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:17:38 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:17:38 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:17:38 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:17:38 user nova-compute[74311]:       <nova:owner>
Oct 20 10:17:38 user nova-compute[74311]:         <nova:user uuid="3599c6c5ec984a3599dbdd732ffd0977">tempest-AttachVolumeTestJSON-1992975846-project-member</nova:user>
Oct 20 10:17:38 user nova-compute[74311]:         <nova:project uuid="5f725dba626242d6ada4ccceab72c55c">tempest-AttachVolumeTestJSON-1992975846</nova:project>
Oct 20 10:17:38 user nova-compute[74311]:       </nova:owner>
Oct 20 10:17:38 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:17:38 user nova-compute[74311]:       <nova:ports>
Oct 20 10:17:38 user nova-compute[74311]:         <nova:port uuid="98eb8ce2-6b43-43ac-99f6-e908d0688d20">
Oct 20 10:17:38 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 10:17:38 user nova-compute[74311]:         </nova:port>
Oct 20 10:17:38 user nova-compute[74311]:       </nova:ports>
Oct 20 10:17:38 user nova-compute[74311]:     </nova:instance>
Oct 20 10:17:38 user nova-compute[74311]:   </metadata>
Oct 20 10:17:38 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:17:38 user nova-compute[74311]:     <system>
Oct 20 10:17:38 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:17:38 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:17:38 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:17:38 user nova-compute[74311]:       <entry name="serial">6a964d89-1f48-405b-bf64-31b9eef9ece3</entry>
Oct 20 10:17:38 user nova-compute[74311]:       <entry name="uuid">6a964d89-1f48-405b-bf64-31b9eef9ece3</entry>
Oct 20 10:17:38 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:17:38 user nova-compute[74311]:     </system>
Oct 20 10:17:38 user nova-compute[74311]:   </sysinfo>
Oct 20 10:17:38 user nova-compute[74311]:   <os>
Oct 20 10:17:38 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:17:38 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:17:38 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:17:38 user nova-compute[74311]:   </os>
Oct 20 10:17:38 user nova-compute[74311]:   <features>
Oct 20 10:17:38 user nova-compute[74311]:     <acpi/>
Oct 20 10:17:38 user nova-compute[74311]:     <apic/>
Oct 20 10:17:38 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:17:38 user nova-compute[74311]:   </features>
Oct 20 10:17:38 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:17:38 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:17:38 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:17:38 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:17:38 user nova-compute[74311]:   </clock>
Oct 20 10:17:38 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:17:38 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:17:38 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:17:38 user nova-compute[74311]:   </cpu>
Oct 20 10:17:38 user nova-compute[74311]:   <devices>
Oct 20 10:17:38 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:17:38 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:17:38 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk"/>
Oct 20 10:17:38 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:17:38 user nova-compute[74311]:     </disk>
Oct 20 10:17:38 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:17:38 user nova-compute[74311]:       <mac address="fa:16:3e:6e:64:47"/>
Oct 20 10:17:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:17:38 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:17:38 user nova-compute[74311]:       <target dev="tap98eb8ce2-6b"/>
Oct 20 10:17:38 user nova-compute[74311]:     </interface>
Oct 20 10:17:38 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:17:38 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/console.log" append="off"/>
Oct 20 10:17:38 user nova-compute[74311]:     </serial>
Oct 20 10:17:38 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:17:38 user nova-compute[74311]:     <video>
Oct 20 10:17:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:17:38 user nova-compute[74311]:     </video>
Oct 20 10:17:38 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:17:38 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:17:38 user nova-compute[74311]:     </rng>
Oct 20 10:17:38 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:17:38 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:17:38 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:17:38 user nova-compute[74311]:     </memballoon>
Oct 20 10:17:38 user nova-compute[74311]:   </devices>
Oct 20 10:17:38 user nova-compute[74311]: </domain>
Oct 20 10:17:38 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1673768130',display_name='tempest-AttachVolumeTestJSON-server-1673768130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1673768130',id=18,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJYcmNlzLpysvhxPxGUSP0j7sh5O9o25thL4eCR81ZsGW+B6UHXUeUQVHkIIazQJidMRU0G/6rN9EQv2+Mt89HRMjWiUYCfGHIzOVJ/WhTEW9pqoD8o/FnFRAAvE/JYDw==',key_name='tempest-keypair-2078286093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f725dba626242d6ada4ccceab72c55c',ramdisk_id='',reservation_id='r-dtf2wxoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1992975846',owner_user_name='tempest-AttachVolumeTestJSON-1992975846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3599c6c5ec984a3599dbdd732ffd0977',uuid=6a964d89-1f48-405b-bf64-31b9eef9ece3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converting VIF {"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG os_vif [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f2e914d-200e-57a1-807d-49598e3fc93d', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98eb8ce2-6b, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98eb8ce2-6b, col_values=(('qos', UUID('a32808cb-ae38-4ef5-99bc-ae4ff36117d8')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98eb8ce2-6b, col_values=(('external_ids', {'iface-id': '98eb8ce2-6b43-43ac-99f6-e908d0688d20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:64:47', 'vm-uuid': '6a964d89-1f48-405b-bf64-31b9eef9ece3'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:17:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:38 user nova-compute[74311]: INFO os_vif [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b')
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] No VIF found with MAC fa:16:3e:6e:64:47, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.network.neutron [req-ca13123a-5ea7-403f-8da6-6b8381a27521 req-63e2c0f8-8404-47e7-8cc0-db2caa4c900f service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Updated VIF entry in instance network info cache for port 98eb8ce2-6b43-43ac-99f6-e908d0688d20. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.network.neutron [req-ca13123a-5ea7-403f-8da6-6b8381a27521 req-63e2c0f8-8404-47e7-8cc0-db2caa4c900f service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Updating instance_info_cache with network_info: [{"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ca13123a-5ea7-403f-8da6-6b8381a27521 req-63e2c0f8-8404-47e7-8cc0-db2caa4c900f service nova] Releasing lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '26538376264316335', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538376264316335', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1629854730',display_name='tempest-TestShelveInstance-server-1629854730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1629854730',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2UxbbXgt1Yjqj2Jy+4hK+bHV+8XArE1GdXdX6r3BeFQkm5c7q7uB2eCMejr9+vfpzUQXSvTiWFoqEOQyEZWoIyoI17DF/JmFIRD9vSrs/u5ApnK+LyZ3AJ/6PG25kn0w==',key_name='tempest-TestShelveInstance-252767667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dd35c1e7d774f1db10dce2f42915a80',ramdisk_id='',reservation_id='r-norxghh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1328079289',owner_user_name='tempest-TestShelveInstance-1328079289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:17:18Z,user_data=None,user_id='7d74f45f32004531a84f76f16254d459',uuid=dcecd43c-0d21-4413-8fa5-02856f450b6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Converting VIF {"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=75daa4b7-a58b-4b60-afe8-97f535c09013,network=Network(b5d1e6f9-d369-41f2-a536-07de25499fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75daa4b7-a5') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.objects.instance [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lazy-loading 'pci_devices' on Instance uuid dcecd43c-0d21-4413-8fa5-02856f450b6a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:17:39 user nova-compute[74311]:   <uuid>dcecd43c-0d21-4413-8fa5-02856f450b6a</uuid>
Oct 20 10:17:39 user nova-compute[74311]:   <name>instance-00000011</name>
Oct 20 10:17:39 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:17:39 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:17:39 user nova-compute[74311]:   <metadata>
Oct 20 10:17:39 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:17:39 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:17:39 user nova-compute[74311]:       <nova:name>tempest-TestShelveInstance-server-1629854730</nova:name>
Oct 20 10:17:39 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:17:37</nova:creationTime>
Oct 20 10:17:39 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:17:39 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:17:39 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:17:39 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:17:39 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:17:39 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:17:39 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:17:39 user nova-compute[74311]:       <nova:owner>
Oct 20 10:17:39 user nova-compute[74311]:         <nova:user uuid="7d74f45f32004531a84f76f16254d459">tempest-TestShelveInstance-1328079289-project-member</nova:user>
Oct 20 10:17:39 user nova-compute[74311]:         <nova:project uuid="9dd35c1e7d774f1db10dce2f42915a80">tempest-TestShelveInstance-1328079289</nova:project>
Oct 20 10:17:39 user nova-compute[74311]:       </nova:owner>
Oct 20 10:17:39 user nova-compute[74311]:       <nova:ports>
Oct 20 10:17:39 user nova-compute[74311]:         <nova:port uuid="75daa4b7-a58b-4b60-afe8-97f535c09013">
Oct 20 10:17:39 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 10:17:39 user nova-compute[74311]:         </nova:port>
Oct 20 10:17:39 user nova-compute[74311]:       </nova:ports>
Oct 20 10:17:39 user nova-compute[74311]:     </nova:instance>
Oct 20 10:17:39 user nova-compute[74311]:   </metadata>
Oct 20 10:17:39 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:17:39 user nova-compute[74311]:     <system>
Oct 20 10:17:39 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:17:39 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:17:39 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:17:39 user nova-compute[74311]:       <entry name="serial">dcecd43c-0d21-4413-8fa5-02856f450b6a</entry>
Oct 20 10:17:39 user nova-compute[74311]:       <entry name="uuid">dcecd43c-0d21-4413-8fa5-02856f450b6a</entry>
Oct 20 10:17:39 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:17:39 user nova-compute[74311]:     </system>
Oct 20 10:17:39 user nova-compute[74311]:   </sysinfo>
Oct 20 10:17:39 user nova-compute[74311]:   <os>
Oct 20 10:17:39 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:17:39 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:17:39 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:17:39 user nova-compute[74311]:   </os>
Oct 20 10:17:39 user nova-compute[74311]:   <features>
Oct 20 10:17:39 user nova-compute[74311]:     <acpi/>
Oct 20 10:17:39 user nova-compute[74311]:     <apic/>
Oct 20 10:17:39 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:17:39 user nova-compute[74311]:   </features>
Oct 20 10:17:39 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:17:39 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:17:39 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:17:39 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:17:39 user nova-compute[74311]:   </clock>
Oct 20 10:17:39 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:17:39 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:17:39 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:17:39 user nova-compute[74311]:   </cpu>
Oct 20 10:17:39 user nova-compute[74311]:   <devices>
Oct 20 10:17:39 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:17:39 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:17:39 user nova-compute[74311]:       <source dev="/dev/sdb"/>
Oct 20 10:17:39 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:17:39 user nova-compute[74311]:       <serial>472b7899-fb18-4cf3-aed5-dd75907cc03f</serial>
Oct 20 10:17:39 user nova-compute[74311]:     </disk>
Oct 20 10:17:39 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:17:39 user nova-compute[74311]:       <mac address="fa:16:3e:d0:c5:3e"/>
Oct 20 10:17:39 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:17:39 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:17:39 user nova-compute[74311]:       <target dev="tap75daa4b7-a5"/>
Oct 20 10:17:39 user nova-compute[74311]:     </interface>
Oct 20 10:17:39 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:17:39 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/dcecd43c-0d21-4413-8fa5-02856f450b6a/console.log" append="off"/>
Oct 20 10:17:39 user nova-compute[74311]:     </serial>
Oct 20 10:17:39 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:17:39 user nova-compute[74311]:     <video>
Oct 20 10:17:39 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:17:39 user nova-compute[74311]:     </video>
Oct 20 10:17:39 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:17:39 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:17:39 user nova-compute[74311]:     </rng>
Oct 20 10:17:39 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:17:39 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:17:39 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:17:39 user nova-compute[74311]:     </memballoon>
Oct 20 10:17:39 user nova-compute[74311]:   </devices>
Oct 20 10:17:39 user nova-compute[74311]: </domain>
Oct 20 10:17:39 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1629854730',display_name='tempest-TestShelveInstance-server-1629854730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1629854730',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2UxbbXgt1Yjqj2Jy+4hK+bHV+8XArE1GdXdX6r3BeFQkm5c7q7uB2eCMejr9+vfpzUQXSvTiWFoqEOQyEZWoIyoI17DF/JmFIRD9vSrs/u5ApnK+LyZ3AJ/6PG25kn0w==',key_name='tempest-TestShelveInstance-252767667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dd35c1e7d774f1db10dce2f42915a80',ramdisk_id='',reservation_id='r-norxghh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1328079289',owner_user_name='tempest-TestShelveInstance-1328079289-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:17:18Z,user_data=None,user_id='7d74f45f32004531a84f76f16254d459',uuid=dcecd43c-0d21-4413-8fa5-02856f450b6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Converting VIF {"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=75daa4b7-a58b-4b60-afe8-97f535c09013,network=Network(b5d1e6f9-d369-41f2-a536-07de25499fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75daa4b7-a5') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG os_vif [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=75daa4b7-a58b-4b60-afe8-97f535c09013,network=Network(b5d1e6f9-d369-41f2-a536-07de25499fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75daa4b7-a5') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f328a08-9808-5e64-bd23-09db71849aa3', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75daa4b7-a5, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75daa4b7-a5, col_values=(('qos', UUID('77e82702-3b01-466c-879e-3398b8a2aef9')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75daa4b7-a5, col_values=(('external_ids', {'iface-id': '75daa4b7-a58b-4b60-afe8-97f535c09013', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:c5:3e', 'vm-uuid': 'dcecd43c-0d21-4413-8fa5-02856f450b6a'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:39 user nova-compute[74311]: INFO os_vif [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=75daa4b7-a58b-4b60-afe8-97f535c09013,network=Network(b5d1e6f9-d369-41f2-a536-07de25499fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75daa4b7-a5')
Oct 20 10:17:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.613s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] No VIF found with MAC fa:16:3e:d0:c5:3e, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.network.neutron [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:17:39 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:17:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "60618091-1d8e-477c-8ea8-63973626a7e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "60618091-1d8e-477c-8ea8-63973626a7e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.policy [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '302a265253b14a19be48546953baaebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b7c2a684a3466eba4799473c725066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:17:39 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Creating image(s)
Oct 20 10:17:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "/opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "/opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:17:39 user nova-compute[74311]: INFO nova.compute.claims [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Claim successful on node user
Oct 20 10:17:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.207s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.224s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG nova.network.neutron [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Successfully created port: 131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk 1073741824" returned: 0 in 0.061s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.209s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.818s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG nova.network.neutron [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:17:40 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Cannot resize image /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Ensure instance console log exists: /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:17:40 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Creating image(s)
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "/opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "/opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "/opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.054s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:40 user nova-compute[74311]: DEBUG nova.policy [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '302a265253b14a19be48546953baaebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b7c2a684a3466eba4799473c725066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.248s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Successfully updated port: 131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquired lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-24613a5f-7849-468d-9dab-16c735aac4c1 req-a9055354-1413-4770-aa55-26234a74e21e service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-changed-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-24613a5f-7849-468d-9dab-16c735aac4c1 req-a9055354-1413-4770-aa55-26234a74e21e service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Refreshing instance network info cache due to event network-changed-131d4c92-ce07-4319-9261-609009fbdaee. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-24613a5f-7849-468d-9dab-16c735aac4c1 req-a9055354-1413-4770-aa55-26234a74e21e service nova] Acquiring lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk 1073741824" returned: 0 in 0.057s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Checking if we can resize image /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Cannot resize image /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Ensure instance console log exists: /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-4a7aa165-0253-47da-ae39-8622c199eed2 req-694beda6-9407-4c09-bb8a-d784fad42a74 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4a7aa165-0253-47da-ae39-8622c199eed2 req-694beda6-9407-4c09-bb8a-d784fad42a74 service nova] Acquiring lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4a7aa165-0253-47da-ae39-8622c199eed2 req-694beda6-9407-4c09-bb8a-d784fad42a74 service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4a7aa165-0253-47da-ae39-8622c199eed2 req-694beda6-9407-4c09-bb8a-d784fad42a74 service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-4a7aa165-0253-47da-ae39-8622c199eed2 req-694beda6-9407-4c09-bb8a-d784fad42a74 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] No waiting events found dispatching network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:17:42 user nova-compute[74311]: WARNING nova.compute.manager [req-4a7aa165-0253-47da-ae39-8622c199eed2 req-694beda6-9407-4c09-bb8a-d784fad42a74 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received unexpected event network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 for instance with vm_state building and task_state spawning.
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.network.neutron [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Updating instance_info_cache with network_info: [{"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.network.neutron [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Successfully created port: 395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Releasing lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Instance network_info: |[{"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-24613a5f-7849-468d-9dab-16c735aac4c1 req-a9055354-1413-4770-aa55-26234a74e21e service nova] Acquired lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.network.neutron [req-24613a5f-7849-468d-9dab-16c735aac4c1 req-a9055354-1413-4770-aa55-26234a74e21e service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Refreshing network info cache for port 131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Start _get_guest_xml network_info=[{"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:17:42 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:17:42 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-175292247',display_name='tempest-ServerRescueNegativeTestJSON-server-175292247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-175292247',id=19,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07b7c2a684a3466eba4799473c725066',ramdisk_id='',reservation_id='r-iqhej24v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-320006607',owner_user_name='tempest-ServerRescueNegativeTestJSON-320006607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:17:40Z,user_data=None,user_id='302a265253b14a19be48546953baaebf',uuid=c0f944dd-b256-4b47-9e2e-7ba50188f636,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converting VIF {"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ce:2a,bridge_name='br-int',has_traffic_filtering=True,id=131d4c92-ce07-4319-9261-609009fbdaee,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d4c92-ce') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.objects.instance [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'pci_devices' on Instance uuid c0f944dd-b256-4b47-9e2e-7ba50188f636 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:17:42 user nova-compute[74311]:   <uuid>c0f944dd-b256-4b47-9e2e-7ba50188f636</uuid>
Oct 20 10:17:42 user nova-compute[74311]:   <name>instance-00000013</name>
Oct 20 10:17:42 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:17:42 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:17:42 user nova-compute[74311]:   <metadata>
Oct 20 10:17:42 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:17:42 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:17:42 user nova-compute[74311]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-175292247</nova:name>
Oct 20 10:17:42 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:17:42</nova:creationTime>
Oct 20 10:17:42 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:17:42 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:17:42 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:17:42 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:17:42 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:17:42 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:17:42 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:17:42 user nova-compute[74311]:       <nova:owner>
Oct 20 10:17:42 user nova-compute[74311]:         <nova:user uuid="302a265253b14a19be48546953baaebf">tempest-ServerRescueNegativeTestJSON-320006607-project-member</nova:user>
Oct 20 10:17:42 user nova-compute[74311]:         <nova:project uuid="07b7c2a684a3466eba4799473c725066">tempest-ServerRescueNegativeTestJSON-320006607</nova:project>
Oct 20 10:17:42 user nova-compute[74311]:       </nova:owner>
Oct 20 10:17:42 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:17:42 user nova-compute[74311]:       <nova:ports>
Oct 20 10:17:42 user nova-compute[74311]:         <nova:port uuid="131d4c92-ce07-4319-9261-609009fbdaee">
Oct 20 10:17:42 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 10:17:42 user nova-compute[74311]:         </nova:port>
Oct 20 10:17:42 user nova-compute[74311]:       </nova:ports>
Oct 20 10:17:42 user nova-compute[74311]:     </nova:instance>
Oct 20 10:17:42 user nova-compute[74311]:   </metadata>
Oct 20 10:17:42 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:17:42 user nova-compute[74311]:     <system>
Oct 20 10:17:42 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:17:42 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:17:42 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:17:42 user nova-compute[74311]:       <entry name="serial">c0f944dd-b256-4b47-9e2e-7ba50188f636</entry>
Oct 20 10:17:42 user nova-compute[74311]:       <entry name="uuid">c0f944dd-b256-4b47-9e2e-7ba50188f636</entry>
Oct 20 10:17:42 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:17:42 user nova-compute[74311]:     </system>
Oct 20 10:17:42 user nova-compute[74311]:   </sysinfo>
Oct 20 10:17:42 user nova-compute[74311]:   <os>
Oct 20 10:17:42 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:17:42 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:17:42 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:17:42 user nova-compute[74311]:   </os>
Oct 20 10:17:42 user nova-compute[74311]:   <features>
Oct 20 10:17:42 user nova-compute[74311]:     <acpi/>
Oct 20 10:17:42 user nova-compute[74311]:     <apic/>
Oct 20 10:17:42 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:17:42 user nova-compute[74311]:   </features>
Oct 20 10:17:42 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:17:42 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:17:42 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:17:42 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:17:42 user nova-compute[74311]:   </clock>
Oct 20 10:17:42 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:17:42 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:17:42 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:17:42 user nova-compute[74311]:   </cpu>
Oct 20 10:17:42 user nova-compute[74311]:   <devices>
Oct 20 10:17:42 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:17:42 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:17:42 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk"/>
Oct 20 10:17:42 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:17:42 user nova-compute[74311]:     </disk>
Oct 20 10:17:42 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:17:42 user nova-compute[74311]:       <mac address="fa:16:3e:8a:ce:2a"/>
Oct 20 10:17:42 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:17:42 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:17:42 user nova-compute[74311]:       <target dev="tap131d4c92-ce"/>
Oct 20 10:17:42 user nova-compute[74311]:     </interface>
Oct 20 10:17:42 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:17:42 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/console.log" append="off"/>
Oct 20 10:17:42 user nova-compute[74311]:     </serial>
Oct 20 10:17:42 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:17:42 user nova-compute[74311]:     <video>
Oct 20 10:17:42 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:17:42 user nova-compute[74311]:     </video>
Oct 20 10:17:42 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:17:42 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:17:42 user nova-compute[74311]:     </rng>
Oct 20 10:17:42 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:17:42 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:17:42 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:17:42 user nova-compute[74311]:     </memballoon>
Oct 20 10:17:42 user nova-compute[74311]:   </devices>
Oct 20 10:17:42 user nova-compute[74311]: </domain>
Oct 20 10:17:42 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-175292247',display_name='tempest-ServerRescueNegativeTestJSON-server-175292247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-175292247',id=19,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07b7c2a684a3466eba4799473c725066',ramdisk_id='',reservation_id='r-iqhej24v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-320006607',owner_user_name='tempest-ServerRescueNegativeTestJSON-320006607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:17:40Z,user_data=None,user_id='302a265253b14a19be48546953baaebf',uuid=c0f944dd-b256-4b47-9e2e-7ba50188f636,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converting VIF {"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ce:2a,bridge_name='br-int',has_traffic_filtering=True,id=131d4c92-ce07-4319-9261-609009fbdaee,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d4c92-ce') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG os_vif [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ce:2a,bridge_name='br-int',has_traffic_filtering=True,id=131d4c92-ce07-4319-9261-609009fbdaee,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d4c92-ce') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15155863-9566-51fd-8c62-80f7f8186ad1', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap131d4c92-ce, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap131d4c92-ce, col_values=(('qos', UUID('18afaee0-6892-4c48-b79b-c19aae6fa2ba')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap131d4c92-ce, col_values=(('external_ids', {'iface-id': '131d4c92-ce07-4319-9261-609009fbdaee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:ce:2a', 'vm-uuid': 'c0f944dd-b256-4b47-9e2e-7ba50188f636'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: INFO os_vif [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ce:2a,bridge_name='br-int',has_traffic_filtering=True,id=131d4c92-ce07-4319-9261-609009fbdaee,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d4c92-ce')
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No VIF found with MAC fa:16:3e:8a:ce:2a, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.network.neutron [req-24613a5f-7849-468d-9dab-16c735aac4c1 req-a9055354-1413-4770-aa55-26234a74e21e service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Updated VIF entry in instance network info cache for port 131d4c92-ce07-4319-9261-609009fbdaee. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG nova.network.neutron [req-24613a5f-7849-468d-9dab-16c735aac4c1 req-a9055354-1413-4770-aa55-26234a74e21e service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Updating instance_info_cache with network_info: [{"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-24613a5f-7849-468d-9dab-16c735aac4c1 req-a9055354-1413-4770-aa55-26234a74e21e service nova] Releasing lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:17:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-96501eaa-148a-4d6d-be54-57f1f589cb60 req-9d0d4d6f-b6ab-446a-ba82-418773a9f046 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-96501eaa-148a-4d6d-be54-57f1f589cb60 req-9d0d4d6f-b6ab-446a-ba82-418773a9f046 service nova] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-96501eaa-148a-4d6d-be54-57f1f589cb60 req-9d0d4d6f-b6ab-446a-ba82-418773a9f046 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-96501eaa-148a-4d6d-be54-57f1f589cb60 req-9d0d4d6f-b6ab-446a-ba82-418773a9f046 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-96501eaa-148a-4d6d-be54-57f1f589cb60 req-9d0d4d6f-b6ab-446a-ba82-418773a9f046 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] No waiting events found dispatching network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:17:43 user nova-compute[74311]: WARNING nova.compute.manager [req-96501eaa-148a-4d6d-be54-57f1f589cb60 req-9d0d4d6f-b6ab-446a-ba82-418773a9f046 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received unexpected event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 for instance with vm_state building and task_state spawning.
Oct 20 10:17:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-96501eaa-148a-4d6d-be54-57f1f589cb60 req-9d0d4d6f-b6ab-446a-ba82-418773a9f046 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-96501eaa-148a-4d6d-be54-57f1f589cb60 req-9d0d4d6f-b6ab-446a-ba82-418773a9f046 service nova] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-96501eaa-148a-4d6d-be54-57f1f589cb60 req-9d0d4d6f-b6ab-446a-ba82-418773a9f046 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-96501eaa-148a-4d6d-be54-57f1f589cb60 req-9d0d4d6f-b6ab-446a-ba82-418773a9f046 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-96501eaa-148a-4d6d-be54-57f1f589cb60 req-9d0d4d6f-b6ab-446a-ba82-418773a9f046 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] No waiting events found dispatching network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:17:43 user nova-compute[74311]: WARNING nova.compute.manager [req-96501eaa-148a-4d6d-be54-57f1f589cb60 req-9d0d4d6f-b6ab-446a-ba82-418773a9f046 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received unexpected event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 for instance with vm_state building and task_state spawning.
Oct 20 10:17:43 user nova-compute[74311]: DEBUG nova.network.neutron [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Successfully updated port: 395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquired lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG nova.network.neutron [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:17:43 user nova-compute[74311]: INFO nova.compute.manager [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Rescuing
Oct 20 10:17:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquired lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG nova.network.neutron [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:17:43 user nova-compute[74311]: DEBUG nova.network.neutron [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.network.neutron [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Updating instance_info_cache with network_info: [{"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Releasing lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.compute.manager [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Instance network_info: |[{"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Start _get_guest_xml network_info=[{"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:17:44 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:17:44 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-920633096',display_name='tempest-ServerRescueNegativeTestJSON-server-920633096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-920633096',id=20,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07b7c2a684a3466eba4799473c725066',ramdisk_id='',reservation_id='r-2icjmpaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-320006607',owner_user_name='tempest-ServerRescueNegativeTestJSON-320006607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:17:41Z,user_data=None,user_id='302a265253b14a19be48546953baaebf',uuid=60618091-1d8e-477c-8ea8-63973626a7e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converting VIF {"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:8a,bridge_name='br-int',has_traffic_filtering=True,id=395a6652-12b5-404b-81e4-2beb52c164ca,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395a6652-12') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.objects.instance [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'pci_devices' on Instance uuid 60618091-1d8e-477c-8ea8-63973626a7e2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.network.neutron [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Updating instance_info_cache with network_info: [{"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:17:44 user nova-compute[74311]:   <uuid>60618091-1d8e-477c-8ea8-63973626a7e2</uuid>
Oct 20 10:17:44 user nova-compute[74311]:   <name>instance-00000014</name>
Oct 20 10:17:44 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:17:44 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:17:44 user nova-compute[74311]:   <metadata>
Oct 20 10:17:44 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:17:44 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:17:44 user nova-compute[74311]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-920633096</nova:name>
Oct 20 10:17:44 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:17:44</nova:creationTime>
Oct 20 10:17:44 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:17:44 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:17:44 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:17:44 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:17:44 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:17:44 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:17:44 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:17:44 user nova-compute[74311]:       <nova:owner>
Oct 20 10:17:44 user nova-compute[74311]:         <nova:user uuid="302a265253b14a19be48546953baaebf">tempest-ServerRescueNegativeTestJSON-320006607-project-member</nova:user>
Oct 20 10:17:44 user nova-compute[74311]:         <nova:project uuid="07b7c2a684a3466eba4799473c725066">tempest-ServerRescueNegativeTestJSON-320006607</nova:project>
Oct 20 10:17:44 user nova-compute[74311]:       </nova:owner>
Oct 20 10:17:44 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:17:44 user nova-compute[74311]:       <nova:ports>
Oct 20 10:17:44 user nova-compute[74311]:         <nova:port uuid="395a6652-12b5-404b-81e4-2beb52c164ca">
Oct 20 10:17:44 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 10:17:44 user nova-compute[74311]:         </nova:port>
Oct 20 10:17:44 user nova-compute[74311]:       </nova:ports>
Oct 20 10:17:44 user nova-compute[74311]:     </nova:instance>
Oct 20 10:17:44 user nova-compute[74311]:   </metadata>
Oct 20 10:17:44 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:17:44 user nova-compute[74311]:     <system>
Oct 20 10:17:44 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:17:44 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:17:44 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:17:44 user nova-compute[74311]:       <entry name="serial">60618091-1d8e-477c-8ea8-63973626a7e2</entry>
Oct 20 10:17:44 user nova-compute[74311]:       <entry name="uuid">60618091-1d8e-477c-8ea8-63973626a7e2</entry>
Oct 20 10:17:44 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:17:44 user nova-compute[74311]:     </system>
Oct 20 10:17:44 user nova-compute[74311]:   </sysinfo>
Oct 20 10:17:44 user nova-compute[74311]:   <os>
Oct 20 10:17:44 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:17:44 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:17:44 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:17:44 user nova-compute[74311]:   </os>
Oct 20 10:17:44 user nova-compute[74311]:   <features>
Oct 20 10:17:44 user nova-compute[74311]:     <acpi/>
Oct 20 10:17:44 user nova-compute[74311]:     <apic/>
Oct 20 10:17:44 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:17:44 user nova-compute[74311]:   </features>
Oct 20 10:17:44 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:17:44 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:17:44 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:17:44 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:17:44 user nova-compute[74311]:   </clock>
Oct 20 10:17:44 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:17:44 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:17:44 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:17:44 user nova-compute[74311]:   </cpu>
Oct 20 10:17:44 user nova-compute[74311]:   <devices>
Oct 20 10:17:44 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:17:44 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:17:44 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk"/>
Oct 20 10:17:44 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:17:44 user nova-compute[74311]:     </disk>
Oct 20 10:17:44 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:17:44 user nova-compute[74311]:       <mac address="fa:16:3e:3f:dc:8a"/>
Oct 20 10:17:44 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:17:44 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:17:44 user nova-compute[74311]:       <target dev="tap395a6652-12"/>
Oct 20 10:17:44 user nova-compute[74311]:     </interface>
Oct 20 10:17:44 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:17:44 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/console.log" append="off"/>
Oct 20 10:17:44 user nova-compute[74311]:     </serial>
Oct 20 10:17:44 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:17:44 user nova-compute[74311]:     <video>
Oct 20 10:17:44 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:17:44 user nova-compute[74311]:     </video>
Oct 20 10:17:44 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:17:44 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:17:44 user nova-compute[74311]:     </rng>
Oct 20 10:17:44 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:17:44 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:17:44 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:17:44 user nova-compute[74311]:     </memballoon>
Oct 20 10:17:44 user nova-compute[74311]:   </devices>
Oct 20 10:17:44 user nova-compute[74311]: </domain>
Oct 20 10:17:44 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-920633096',display_name='tempest-ServerRescueNegativeTestJSON-server-920633096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-920633096',id=20,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07b7c2a684a3466eba4799473c725066',ramdisk_id='',reservation_id='r-2icjmpaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-320006607',owner_user_name='tempest-ServerRescueNegativeTestJSON-320006607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:17:41Z,user_data=None,user_id='302a265253b14a19be48546953baaebf',uuid=60618091-1d8e-477c-8ea8-63973626a7e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converting VIF {"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:8a,bridge_name='br-int',has_traffic_filtering=True,id=395a6652-12b5-404b-81e4-2beb52c164ca,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395a6652-12') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG os_vif [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:8a,bridge_name='br-int',has_traffic_filtering=True,id=395a6652-12b5-404b-81e4-2beb52c164ca,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395a6652-12') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-fa9d5968-f624-4aef-9501-904ed470491c req-160f316e-ecc3-4f7b-a407-5d86e25a05be service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fa9d5968-f624-4aef-9501-904ed470491c req-160f316e-ecc3-4f7b-a407-5d86e25a05be service nova] Acquiring lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fa9d5968-f624-4aef-9501-904ed470491c req-160f316e-ecc3-4f7b-a407-5d86e25a05be service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fa9d5968-f624-4aef-9501-904ed470491c req-160f316e-ecc3-4f7b-a407-5d86e25a05be service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-fa9d5968-f624-4aef-9501-904ed470491c req-160f316e-ecc3-4f7b-a407-5d86e25a05be service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] No waiting events found dispatching network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:17:44 user nova-compute[74311]: WARNING nova.compute.manager [req-fa9d5968-f624-4aef-9501-904ed470491c req-160f316e-ecc3-4f7b-a407-5d86e25a05be service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received unexpected event network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 for instance with vm_state building and task_state spawning.
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Releasing lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e534f90-9e79-50e7-86d3-d0c5db679fea', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap395a6652-12, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap395a6652-12, col_values=(('qos', UUID('e9e7a49e-ca50-4f56-9bed-2ca1e09164fb')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap395a6652-12, col_values=(('external_ids', {'iface-id': '395a6652-12b5-404b-81e4-2beb52c164ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:dc:8a', 'vm-uuid': '60618091-1d8e-477c-8ea8-63973626a7e2'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:44 user nova-compute[74311]: INFO os_vif [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:dc:8a,bridge_name='br-int',has_traffic_filtering=True,id=395a6652-12b5-404b-81e4-2beb52c164ca,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395a6652-12')
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No VIF found with MAC fa:16:3e:3f:dc:8a, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-03395521-903a-463f-9b83-52825b7e13b7 req-b1315a5e-458f-4347-9d82-ead142b03407 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-03395521-903a-463f-9b83-52825b7e13b7 req-b1315a5e-458f-4347-9d82-ead142b03407 service nova] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-03395521-903a-463f-9b83-52825b7e13b7 req-b1315a5e-458f-4347-9d82-ead142b03407 service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-03395521-903a-463f-9b83-52825b7e13b7 req-b1315a5e-458f-4347-9d82-ead142b03407 service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-03395521-903a-463f-9b83-52825b7e13b7 req-b1315a5e-458f-4347-9d82-ead142b03407 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] No waiting events found dispatching network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:17:44 user nova-compute[74311]: WARNING nova.compute.manager [req-03395521-903a-463f-9b83-52825b7e13b7 req-b1315a5e-458f-4347-9d82-ead142b03407 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received unexpected event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee for instance with vm_state building and task_state spawning.
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received event network-changed-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Refreshing instance network info cache due to event network-changed-395a6652-12b5-404b-81e4-2beb52c164ca. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] Acquiring lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] Acquired lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG nova.network.neutron [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Refreshing network info cache for port 395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG nova.network.neutron [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Updated VIF entry in instance network info cache for port 395a6652-12b5-404b-81e4-2beb52c164ca. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG nova.network.neutron [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Updating instance_info_cache with network_info: [{"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] Releasing lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-vif-unplugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] No waiting events found dispatching network-vif-unplugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:17:45 user nova-compute[74311]: WARNING nova.compute.manager [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received unexpected event network-vif-unplugged-2e1b0047-2f93-4f83-a6e7-514659a2faae for instance with vm_state active and task_state rescuing.
Oct 20 10:17:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] No waiting events found dispatching network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:17:45 user nova-compute[74311]: WARNING nova.compute.manager [req-1c7cec91-afda-403d-8f76-28097ac3c595 req-2a21da41-777c-433c-aae2-7bccd8100839 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received unexpected event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae for instance with vm_state active and task_state rescuing.
Oct 20 10:17:46 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: cfc97865-6f94-4924-afc5-188d50543672] Instance destroyed successfully.
Oct 20 10:17:46 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Attempting a stable device rescue
Oct 20 10:17:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74311) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 10:17:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Instance directory exists: not creating {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 10:17:46 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Creating image(s)
Oct 20 10:17:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "/opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "/opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:46 user nova-compute[74311]: DEBUG nova.objects.instance [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'trusted_certs' on Instance uuid cfc97865-6f94-4924-afc5-188d50543672 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:17:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "e809d771ebaad94f1216ea87d0e582564aa3def2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "e809d771ebaad94f1216ea87d0e582564aa3def2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:46 user nova-compute[74311]: DEBUG nova.compute.manager [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:17:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:17:46 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Instance spawned successfully.
Oct 20 10:17:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:17:46 user nova-compute[74311]: DEBUG nova.compute.manager [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:17:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2.part --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-3e57ccff-0daa-4713-9625-241e213eb561 req-5595f80a-2258-420c-8a31-9dad712533e3 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3e57ccff-0daa-4713-9625-241e213eb561 req-5595f80a-2258-420c-8a31-9dad712533e3 service nova] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3e57ccff-0daa-4713-9625-241e213eb561 req-5595f80a-2258-420c-8a31-9dad712533e3 service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3e57ccff-0daa-4713-9625-241e213eb561 req-5595f80a-2258-420c-8a31-9dad712533e3 service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-3e57ccff-0daa-4713-9625-241e213eb561 req-5595f80a-2258-420c-8a31-9dad712533e3 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] No waiting events found dispatching network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:17:47 user nova-compute[74311]: WARNING nova.compute.manager [req-3e57ccff-0daa-4713-9625-241e213eb561 req-5595f80a-2258-420c-8a31-9dad712533e3 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received unexpected event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee for instance with vm_state building and task_state spawning.
Oct 20 10:17:47 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Instance spawned successfully.
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2.part --force-share --output=json" returned: 0 in 0.218s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.virt.images [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] a49f7237-d132-4489-a0eb-0a72266a0fe4 was qcow2, converting to raw {{(pid=74311) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:17:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2.part /opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2.converted {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:47 user nova-compute[74311]: INFO nova.compute.manager [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Took 10.97 seconds to spawn the instance on the hypervisor.
Oct 20 10:17:47 user nova-compute[74311]: DEBUG nova.compute.manager [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:17:48 user nova-compute[74311]: INFO nova.compute.manager [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Took 10.14 seconds to spawn the instance on the hypervisor.
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.compute.manager [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:17:48 user nova-compute[74311]: INFO nova.compute.manager [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Took 31.37 seconds to build instance.
Oct 20 10:17:48 user nova-compute[74311]: INFO nova.compute.manager [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Took 12.22 seconds to build instance.
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-260e54e2-85ef-4bce-ab48-6ee17505d08a tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.393s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-13731b97-ec2e-47a0-a16b-5f86d7066ec8 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.543s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2.part /opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2.converted" returned: 0 in 0.495s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2.converted --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2.converted --force-share --output=json" returned: 0 in 0.237s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "e809d771ebaad94f1216ea87d0e582564aa3def2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.586s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "e809d771ebaad94f1216ea87d0e582564aa3def2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "e809d771ebaad94f1216ea87d0e582564aa3def2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.compute.manager [req-9a50e5d9-6b23-40e2-a9ad-856fe30f6f8a req-3710c360-c79c-49ab-a196-32835e9d35c8 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received event network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9a50e5d9-6b23-40e2-a9ad-856fe30f6f8a req-3710c360-c79c-49ab-a196-32835e9d35c8 service nova] Acquiring lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9a50e5d9-6b23-40e2-a9ad-856fe30f6f8a req-3710c360-c79c-49ab-a196-32835e9d35c8 service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9a50e5d9-6b23-40e2-a9ad-856fe30f6f8a req-3710c360-c79c-49ab-a196-32835e9d35c8 service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.compute.manager [req-9a50e5d9-6b23-40e2-a9ad-856fe30f6f8a req-3710c360-c79c-49ab-a196-32835e9d35c8 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] No waiting events found dispatching network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:17:48 user nova-compute[74311]: WARNING nova.compute.manager [req-9a50e5d9-6b23-40e2-a9ad-856fe30f6f8a req-3710c360-c79c-49ab-a196-32835e9d35c8 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received unexpected event network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca for instance with vm_state building and task_state spawning.
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.compute.manager [req-9a50e5d9-6b23-40e2-a9ad-856fe30f6f8a req-3710c360-c79c-49ab-a196-32835e9d35c8 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received event network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9a50e5d9-6b23-40e2-a9ad-856fe30f6f8a req-3710c360-c79c-49ab-a196-32835e9d35c8 service nova] Acquiring lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9a50e5d9-6b23-40e2-a9ad-856fe30f6f8a req-3710c360-c79c-49ab-a196-32835e9d35c8 service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9a50e5d9-6b23-40e2-a9ad-856fe30f6f8a req-3710c360-c79c-49ab-a196-32835e9d35c8 service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.compute.manager [req-9a50e5d9-6b23-40e2-a9ad-856fe30f6f8a req-3710c360-c79c-49ab-a196-32835e9d35c8 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] No waiting events found dispatching network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:17:48 user nova-compute[74311]: WARNING nova.compute.manager [req-9a50e5d9-6b23-40e2-a9ad-856fe30f6f8a req-3710c360-c79c-49ab-a196-32835e9d35c8 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received unexpected event network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca for instance with vm_state building and task_state spawning.
Oct 20 10:17:48 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Instance spawned successfully.
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2 --force-share --output=json" returned: 0 in 0.198s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2,backing_fmt=raw /opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/disk.rescue {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:48 user nova-compute[74311]: INFO nova.compute.manager [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Took 9.29 seconds to spawn the instance on the hypervisor.
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2,backing_fmt=raw /opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/disk.rescue" returned: 0 in 0.064s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "e809d771ebaad94f1216ea87d0e582564aa3def2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:48 user nova-compute[74311]: DEBUG nova.objects.instance [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'migration_context' on Instance uuid cfc97865-6f94-4924-afc5-188d50543672 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.objects.base [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Object Instance<cfc97865-6f94-4924-afc5-188d50543672> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Start _get_guest_xml network_info=[{"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "vif_mac": "fa:16:3e:2d:59:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a49f7237-d132-4489-a0eb-0a72266a0fe4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'afaa0011-45c9-48c7-a1c0-18dabf75b602', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTUvAacR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'cfc97865-6f94-4924-afc5-188d50543672', 'attached_at': '', 'detached_at': '', 'volume_id': '90e3e67e-92d0-4f73-992a-d967eafa7bfa', 'serial': '90e3e67e-92d0-4f73-992a-d967eafa7bfa'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'resources' on Instance uuid cfc97865-6f94-4924-afc5-188d50543672 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.objects.base [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Object Instance<cfc97865-6f94-4924-afc5-188d50543672> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'numa_topology' on Instance uuid cfc97865-6f94-4924-afc5-188d50543672 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.objects.base [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Object Instance<cfc97865-6f94-4924-afc5-188d50543672> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:17:49 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:17:49 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'vcpu_model' on Instance uuid cfc97865-6f94-4924-afc5-188d50543672 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:17:49 user nova-compute[74311]: INFO nova.compute.manager [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Took 10.41 seconds to build instance.
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.objects.base [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Object Instance<cfc97865-6f94-4924-afc5-188d50543672> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTUvAacR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:17:49 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:17:49 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:17:49 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f0dad251-d5f4-4119-914c-c907968e1f41 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.582s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[991d7f65-b25e-4f87-8f84-d52408dd672e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = gTUvAacR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 10:17:49 user nova-compute[74311]: node.name = iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:17:49 user nova-compute[74311]: node.tpgt = -1
Oct 20 10:17:49 user nova-compute[74311]: node.startup = automatic
Oct 20 10:17:49 user nova-compute[74311]: node.leading_login = No
Oct 20 10:17:49 user nova-compute[74311]: iface.iscsi_ifacename = default
Oct 20 10:17:49 user nova-compute[74311]: iface.net_ifacename = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.ipaddress = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.prefix_len = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.hwaddress = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.transport_name = tcp
Oct 20 10:17:49 user nova-compute[74311]: iface.initiatorname = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.state = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.vlan_id = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.vlan_priority = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.vlan_state = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.iface_num = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.mtu = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.port = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.bootproto = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.subnet_mask = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.gateway = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.dhcp_alt_client_id = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.dhcp_dns = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.dhcp_learn_iqn = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.dhcp_vendor_id_state = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.dhcp_vendor_id = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.dhcp_slp_da = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.fragmentation = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.gratuitous_arp = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.incoming_forwarding = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.tos_state = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.tos = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.ttl = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.delayed_ack = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.tcp_nagle = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.tcp_wsf_state = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.tcp_wsf = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.tcp_timer_scale = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.tcp_timestamp = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.redirect = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.def_task_mgmt_timeout = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.header_digest = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.data_digest = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.immediate_data = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.initial_r2t = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.data_seq_inorder = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.data_pdu_inorder = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.erl = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.max_receive_data_len = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.first_burst_len = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.max_outstanding_r2t = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.max_burst_len = 0
Oct 20 10:17:49 user nova-compute[74311]: iface.chap_auth = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.bidi_chap = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.strict_login_compliance = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.discovery_auth = <empty>
Oct 20 10:17:49 user nova-compute[74311]: iface.discovery_logout = <empty>
Oct 20 10:17:49 user nova-compute[74311]: node.discovery_address = <empty>
Oct 20 10:17:49 user nova-compute[74311]: node.discovery_port = 0
Oct 20 10:17:49 user nova-compute[74311]: node.discovery_type = static
Oct 20 10:17:49 user nova-compute[74311]: node.session.initial_cmdsn = 0
Oct 20 10:17:49 user nova-compute[74311]: node.session.initial_login_retry_max = 8
Oct 20 10:17:49 user nova-compute[74311]: node.session.xmit_thread_priority = -20
Oct 20 10:17:49 user nova-compute[74311]: node.session.cmds_max = 128
Oct 20 10:17:49 user nova-compute[74311]: node.session.queue_depth = 32
Oct 20 10:17:49 user nova-compute[74311]: node.session.nr_sessions = 1
Oct 20 10:17:49 user nova-compute[74311]: node.session.auth.authmethod = CHAP
Oct 20 10:17:49 user nova-compute[74311]: node.session.auth.username = gTUvAacR
Oct 20 10:17:49 user nova-compute[74311]: node.session.auth.password = ***
Oct 20 10:17:49 user nova-compute[74311]: node.session.auth.username_in = <empty>
Oct 20 10:17:49 user nova-compute[74311]: node.session.auth.password_in = <empty>
Oct 20 10:17:49 user nova-compute[74311]: node.session.auth.chap_algs = MD5
Oct 20 10:17:49 user nova-compute[74311]: node.session.timeo.replacement_timeout = 120
Oct 20 10:17:49 user nova-compute[74311]: node.session.err_timeo.abort_timeout = 15
Oct 20 10:17:49 user nova-compute[74311]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 10:17:49 user nova-compute[74311]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 10:17:49 user nova-compute[74311]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 10:17:49 user nova-compute[74311]: node.session.iscsi.FastAbort = Yes
Oct 20 10:17:49 user nova-compute[74311]: node.session.iscsi.InitialR2T = No
Oct 20 10:17:49 user nova-compute[74311]: node.session.iscsi.ImmediateData = Yes
Oct 20 10:17:49 user nova-compute[74311]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 10:17:49 user nova-compute[74311]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 10:17:49 user nova-compute[74311]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 10:17:49 user nova-compute[74311]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 10:17:49 user nova-compute[74311]: node.session.iscsi.MaxConnections = 1
Oct 20 10:17:49 user nova-compute[74311]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 10:17:49 user nova-compute[74311]: node.session.iscsi.ERL = 0
Oct 20 10:17:49 user nova-compute[74311]: node.session.scan = manual
Oct 20 10:17:49 user nova-compute[74311]: node.session.reopen_max = 0
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].address = 172.16.0.220
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].port = 3260
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].startup = manual
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].tcp.window_size = 524288
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].tcp.type_of_service = 0
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].timeo.logout_timeout = 15
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].timeo.login_timeout = 15
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].timeo.auth_timeout = 45
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].iscsi.DataDigest = None
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].iscsi.IFMarker = No
Oct 20 10:17:49 user nova-compute[74311]: node.conn[0].iscsi.OFMarker = No
Oct 20 10:17:49 user nova-compute[74311]: # END RECORD
Oct 20 10:17:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc47912-6ae1-4fa2-91db-8eea8119c34f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.compute.manager [req-229c99c5-3360-4346-a48c-c351d96c3a22 req-e53955d0-5586-4add-94f9-2f0d4f786dde service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received event network-changed-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.compute.manager [req-229c99c5-3360-4346-a48c-c351d96c3a22 req-e53955d0-5586-4add-94f9-2f0d4f786dde service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Refreshing instance network info cache due to event network-changed-5b30634a-aea2-4b86-b000-a108c2fb306b. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-229c99c5-3360-4346-a48c-c351d96c3a22 req-e53955d0-5586-4add-94f9-2f0d4f786dde service nova] Acquiring lock "refresh_cache-54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-229c99c5-3360-4346-a48c-c351d96c3a22 req-e53955d0-5586-4add-94f9-2f0d4f786dde service nova] Acquired lock "refresh_cache-54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.network.neutron [req-229c99c5-3360-4346-a48c-c351d96c3a22 req-e53955d0-5586-4add-94f9-2f0d4f786dde service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Refreshing network info cache for port 5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a60509-fae8-443c-86e6-8573ae50b2ae]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gTUvAacR {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gTUvAacR" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[178ab3d6-17d1-4770-ad4a-8b2cad9f5339]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gTUvAacR'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3aaf1f-6188-4ff5-9730-1991ffe079c0]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb335b0-b4be-4431-9349-16c682ece2c1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:17:49 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:17:49 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:17:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:17:49 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:17:49 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:17:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.189s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] HCTL ('37', '0', '0', 0) found on session 11 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f89fe43-846b-47a6-88be-b8381f0967ab]: (4, ('0 0 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching for a device in session 11 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTUvAacR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.222s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] <== connect_volume: return (225ms) {'type': 'block', 'scsi_wwn': '23838386161353834', 'path': '/dev/sdf'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838386161353834', 'path': '/dev/sdf'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1074257695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1074257695',id=13,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:15:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090bd6a8a14d4a308e67be7a12e47ae6',ramdisk_id='',reservation_id='r-3t7g0pln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:15:59Z,user_data=None,user_id='0c6b76de1f054ca0973f2f9ba2eafaed',uuid=cfc97865-6f94-4924-afc5-188d50543672,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "vif_mac": "fa:16:3e:2d:59:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converting VIF {"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "vif_mac": "fa:16:3e:2d:59:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:59:4e,bridge_name='br-int',has_traffic_filtering=True,id=2e1b0047-2f93-4f83-a6e7-514659a2faae,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1b0047-2f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'pci_devices' on Instance uuid cfc97865-6f94-4924-afc5-188d50543672 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.objects.base [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Object Instance<cfc97865-6f94-4924-afc5-188d50543672> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:17:49 user nova-compute[74311]:   <uuid>cfc97865-6f94-4924-afc5-188d50543672</uuid>
Oct 20 10:17:49 user nova-compute[74311]:   <name>instance-0000000d</name>
Oct 20 10:17:49 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:17:49 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:17:49 user nova-compute[74311]:   <metadata>
Oct 20 10:17:49 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:17:49 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:17:49 user nova-compute[74311]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1074257695</nova:name>
Oct 20 10:17:49 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:17:49</nova:creationTime>
Oct 20 10:17:49 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:17:49 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:17:49 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:17:49 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:17:49 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:17:49 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:17:49 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:17:49 user nova-compute[74311]:       <nova:owner>
Oct 20 10:17:49 user nova-compute[74311]:         <nova:user uuid="0c6b76de1f054ca0973f2f9ba2eafaed">tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member</nova:user>
Oct 20 10:17:49 user nova-compute[74311]:         <nova:project uuid="090bd6a8a14d4a308e67be7a12e47ae6">tempest-ServerBootFromVolumeStableRescueTest-2019341345</nova:project>
Oct 20 10:17:49 user nova-compute[74311]:       </nova:owner>
Oct 20 10:17:49 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:17:49 user nova-compute[74311]:       <nova:ports>
Oct 20 10:17:49 user nova-compute[74311]:         <nova:port uuid="2e1b0047-2f93-4f83-a6e7-514659a2faae">
Oct 20 10:17:49 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 10:17:49 user nova-compute[74311]:         </nova:port>
Oct 20 10:17:49 user nova-compute[74311]:       </nova:ports>
Oct 20 10:17:49 user nova-compute[74311]:     </nova:instance>
Oct 20 10:17:49 user nova-compute[74311]:   </metadata>
Oct 20 10:17:49 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:17:49 user nova-compute[74311]:     <system>
Oct 20 10:17:49 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:17:49 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:17:49 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:17:49 user nova-compute[74311]:       <entry name="serial">cfc97865-6f94-4924-afc5-188d50543672</entry>
Oct 20 10:17:49 user nova-compute[74311]:       <entry name="uuid">cfc97865-6f94-4924-afc5-188d50543672</entry>
Oct 20 10:17:49 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:17:49 user nova-compute[74311]:     </system>
Oct 20 10:17:49 user nova-compute[74311]:   </sysinfo>
Oct 20 10:17:49 user nova-compute[74311]:   <os>
Oct 20 10:17:49 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:17:49 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:17:49 user nova-compute[74311]:   </os>
Oct 20 10:17:49 user nova-compute[74311]:   <features>
Oct 20 10:17:49 user nova-compute[74311]:     <acpi/>
Oct 20 10:17:49 user nova-compute[74311]:     <apic/>
Oct 20 10:17:49 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:17:49 user nova-compute[74311]:   </features>
Oct 20 10:17:49 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:17:49 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:17:49 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:17:49 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:17:49 user nova-compute[74311]:   </clock>
Oct 20 10:17:49 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:17:49 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:17:49 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:17:49 user nova-compute[74311]:   </cpu>
Oct 20 10:17:49 user nova-compute[74311]:   <devices>
Oct 20 10:17:49 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:17:49 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:17:49 user nova-compute[74311]:       <source dev="/dev/sdf"/>
Oct 20 10:17:49 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:17:49 user nova-compute[74311]:       <serial>90e3e67e-92d0-4f73-992a-d967eafa7bfa</serial>
Oct 20 10:17:49 user nova-compute[74311]:     </disk>
Oct 20 10:17:49 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:17:49 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:17:49 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/disk.rescue"/>
Oct 20 10:17:49 user nova-compute[74311]:       <target dev="vdb" bus="virtio"/>
Oct 20 10:17:49 user nova-compute[74311]:       <boot order="1"/>
Oct 20 10:17:49 user nova-compute[74311]:     </disk>
Oct 20 10:17:49 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:17:49 user nova-compute[74311]:       <mac address="fa:16:3e:2d:59:4e"/>
Oct 20 10:17:49 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:17:49 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:17:49 user nova-compute[74311]:       <target dev="tap2e1b0047-2f"/>
Oct 20 10:17:49 user nova-compute[74311]:     </interface>
Oct 20 10:17:49 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:17:49 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/console.log" append="off"/>
Oct 20 10:17:49 user nova-compute[74311]:     </serial>
Oct 20 10:17:49 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:17:49 user nova-compute[74311]:     <video>
Oct 20 10:17:49 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:17:49 user nova-compute[74311]:     </video>
Oct 20 10:17:49 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:17:49 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:17:49 user nova-compute[74311]:     </rng>
Oct 20 10:17:49 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:17:49 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:17:49 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:17:49 user nova-compute[74311]:     </memballoon>
Oct 20 10:17:49 user nova-compute[74311]:   </devices>
Oct 20 10:17:49 user nova-compute[74311]: </domain>
Oct 20 10:17:49 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:17:49 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: cfc97865-6f94-4924-afc5-188d50543672] Instance destroyed successfully.
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.compute.manager [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:17:49 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Instance spawned successfully.
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] No VIF found with MAC fa:16:3e:2d:59:4e, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:17:49 user nova-compute[74311]: INFO nova.compute.manager [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Took 8.94 seconds to spawn the instance on the hypervisor.
Oct 20 10:17:49 user nova-compute[74311]: DEBUG nova.compute.manager [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:17:49 user nova-compute[74311]: INFO nova.compute.manager [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Took 10.22 seconds to build instance.
Oct 20 10:17:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-532ab9fa-f29c-46ee-a151-efc387d14151 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "60618091-1d8e-477c-8ea8-63973626a7e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.337s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG nova.network.neutron [req-229c99c5-3360-4346-a48c-c351d96c3a22 req-e53955d0-5586-4add-94f9-2f0d4f786dde service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Updated VIF entry in instance network info cache for port 5b30634a-aea2-4b86-b000-a108c2fb306b. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG nova.network.neutron [req-229c99c5-3360-4346-a48c-c351d96c3a22 req-e53955d0-5586-4add-94f9-2f0d4f786dde service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Updating instance_info_cache with network_info: [{"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-229c99c5-3360-4346-a48c-c351d96c3a22 req-e53955d0-5586-4add-94f9-2f0d4f786dde service nova] Releasing lock "refresh_cache-54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG nova.objects.instance [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lazy-loading 'flavor' on Instance uuid 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:50 user nova-compute[74311]: INFO nova.compute.manager [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Attaching volume 9740904b-17dd-4a9b-be36-df6c67881138 to /dev/vdb
Oct 20 10:17:50 user nova-compute[74311]: DEBUG os_brick.utils [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a4436f-ad1d-4cc6-8abd-edb033c5d361]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08880b9-e6ce-4a0f-8f31-3b2ba68d8cd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bba85d-2eab-4a49-9d52-40502cace33e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[50562cea-0fb5-4dd1-a26b-c92bb284a563]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:17:50 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:17:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49e5f20-d9f8-4255-8731-e2f8347c2f7e]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG os_brick.utils [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:17:50 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Updating existing volume attachment record: ef0feb12-decb-4c82-bb1a-50027b06fabf {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:17:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-9e634640-31cd-47d6-8a5a-c2b46aa5f437 req-d77a8c19-65b7-425f-9d01-383ba48af877 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9e634640-31cd-47d6-8a5a-c2b46aa5f437 req-d77a8c19-65b7-425f-9d01-383ba48af877 service nova] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9e634640-31cd-47d6-8a5a-c2b46aa5f437 req-d77a8c19-65b7-425f-9d01-383ba48af877 service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9e634640-31cd-47d6-8a5a-c2b46aa5f437 req-d77a8c19-65b7-425f-9d01-383ba48af877 service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-9e634640-31cd-47d6-8a5a-c2b46aa5f437 req-d77a8c19-65b7-425f-9d01-383ba48af877 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] No waiting events found dispatching network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:17:51 user nova-compute[74311]: WARNING nova.compute.manager [req-9e634640-31cd-47d6-8a5a-c2b46aa5f437 req-d77a8c19-65b7-425f-9d01-383ba48af877 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received unexpected event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae for instance with vm_state active and task_state rescuing.
Oct 20 10:17:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:53 user nova-compute[74311]: DEBUG nova.compute.manager [req-bb9677a0-524c-4ca4-b54c-7b5774940f00 req-b5542108-3f41-46c0-902a-e4cfc2997306 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:17:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bb9677a0-524c-4ca4-b54c-7b5774940f00 req-b5542108-3f41-46c0-902a-e4cfc2997306 service nova] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:17:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bb9677a0-524c-4ca4-b54c-7b5774940f00 req-b5542108-3f41-46c0-902a-e4cfc2997306 service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:17:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bb9677a0-524c-4ca4-b54c-7b5774940f00 req-b5542108-3f41-46c0-902a-e4cfc2997306 service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:17:53 user nova-compute[74311]: DEBUG nova.compute.manager [req-bb9677a0-524c-4ca4-b54c-7b5774940f00 req-b5542108-3f41-46c0-902a-e4cfc2997306 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] No waiting events found dispatching network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:17:53 user nova-compute[74311]: WARNING nova.compute.manager [req-bb9677a0-524c-4ca4-b54c-7b5774940f00 req-b5542108-3f41-46c0-902a-e4cfc2997306 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received unexpected event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae for instance with vm_state active and task_state rescuing.
Oct 20 10:17:54 user nova-compute[74311]: DEBUG nova.compute.manager [None req-af608c78-fd74-4b7f-b0e7-db2cdcf453ea tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:17:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:17:55 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:17:55 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Didn't find any instances for network info cache update. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 10:17:57 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:17:57 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:17:57 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:17:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:17:58 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:17:58 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:17:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "c8e0cb34-d304-4405-862f-a4118e729083" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "c8e0cb34-d304-4405-862f-a4118e729083" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "c8e0cb34-d304-4405-862f-a4118e729083-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "c8e0cb34-d304-4405-862f-a4118e729083-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "c8e0cb34-d304-4405-862f-a4118e729083-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:00 user nova-compute[74311]: INFO nova.compute.manager [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Terminating instance
Oct 20 10:18:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-c012aabc-0d62-4ba4-b791-fd73c523b61b req-dc696d83-a32f-427c-82f1-be4faee1cec5 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Received event network-vif-unplugged-f83fd133-2cf9-4f2e-a6fe-944d7adc094a {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c012aabc-0d62-4ba4-b791-fd73c523b61b req-dc696d83-a32f-427c-82f1-be4faee1cec5 service nova] Acquiring lock "c8e0cb34-d304-4405-862f-a4118e729083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c012aabc-0d62-4ba4-b791-fd73c523b61b req-dc696d83-a32f-427c-82f1-be4faee1cec5 service nova] Lock "c8e0cb34-d304-4405-862f-a4118e729083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c012aabc-0d62-4ba4-b791-fd73c523b61b req-dc696d83-a32f-427c-82f1-be4faee1cec5 service nova] Lock "c8e0cb34-d304-4405-862f-a4118e729083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-c012aabc-0d62-4ba4-b791-fd73c523b61b req-dc696d83-a32f-427c-82f1-be4faee1cec5 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] No waiting events found dispatching network-vif-unplugged-f83fd133-2cf9-4f2e-a6fe-944d7adc094a {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:18:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-c012aabc-0d62-4ba4-b791-fd73c523b61b req-dc696d83-a32f-427c-82f1-be4faee1cec5 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Received event network-vif-unplugged-f83fd133-2cf9-4f2e-a6fe-944d7adc094a for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:18:01 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Instance destroyed successfully.
Oct 20 10:18:01 user nova-compute[74311]: DEBUG nova.objects.instance [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lazy-loading 'resources' on Instance uuid c8e0cb34-d304-4405-862f-a4118e729083 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:15:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2095550517',display_name='tempest-VolumesAdminNegativeTest-server-2095550517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2095550517',id=14,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:16:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6afc4c55cdc4c01ab172638b262a976',ramdisk_id='',reservation_id='r-pexsdnug',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-230171363',owner_user_name='tempest-VolumesAdminNegativeTest-230171363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:16:00Z,user_data=None,user_id='f53d41e3e16e47198a9a0381fd683244',uuid=c8e0cb34-d304-4405-862f-a4118e729083,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "address": "fa:16:3e:94:04:66", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83fd133-2c", "ovs_interfaceid": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Converting VIF {"id": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "address": "fa:16:3e:94:04:66", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf83fd133-2c", "ovs_interfaceid": "f83fd133-2cf9-4f2e-a6fe-944d7adc094a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:04:66,bridge_name='br-int',has_traffic_filtering=True,id=f83fd133-2cf9-4f2e-a6fe-944d7adc094a,network=Network(b8fa77f6-0c71-4754-a562-9f147defb87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83fd133-2c') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG os_vif [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:04:66,bridge_name='br-int',has_traffic_filtering=True,id=f83fd133-2cf9-4f2e-a6fe-944d7adc094a,network=Network(b8fa77f6-0c71-4754-a562-9f147defb87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83fd133-2c') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf83fd133-2c, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae305868-c857-4389-a0ab-de0d73fda243) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:01 user nova-compute[74311]: INFO os_vif [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:04:66,bridge_name='br-int',has_traffic_filtering=True,id=f83fd133-2cf9-4f2e-a6fe-944d7adc094a,network=Network(b8fa77f6-0c71-4754-a562-9f147defb87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf83fd133-2c')
Oct 20 10:18:01 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Deleting instance files /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083_del
Oct 20 10:18:01 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Deletion of /opt/stack/data/nova/instances/c8e0cb34-d304-4405-862f-a4118e729083_del complete
Oct 20 10:18:01 user nova-compute[74311]: INFO nova.compute.manager [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 20 10:18:01 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: c8e0cb34-d304-4405-862f-a4118e729083] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:18:01 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:18:02 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Took 0.56 seconds to deallocate network for instance.
Oct 20 10:18:02 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG nova.compute.manager [req-2547ffd0-8bc5-48be-83fe-a1efc1dfaa41 req-bb88482b-d67e-49f4-a939-0825c55d027e service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Received event network-vif-deleted-f83fd133-2cf9-4f2e-a6fe-944d7adc094a {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.717s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:02 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Deleted allocations for instance c8e0cb34-d304-4405-862f-a4118e729083
Oct 20 10:18:03 user nova-compute[74311]: DEBUG nova.compute.manager [req-be9df82e-131b-4140-936d-09e4d2c54b30 req-aa907618-2b44-4803-b9e5-fd596d2b8ab2 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Received event network-vif-plugged-f83fd133-2cf9-4f2e-a6fe-944d7adc094a {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:18:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-be9df82e-131b-4140-936d-09e4d2c54b30 req-aa907618-2b44-4803-b9e5-fd596d2b8ab2 service nova] Acquiring lock "c8e0cb34-d304-4405-862f-a4118e729083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-be9df82e-131b-4140-936d-09e4d2c54b30 req-aa907618-2b44-4803-b9e5-fd596d2b8ab2 service nova] Lock "c8e0cb34-d304-4405-862f-a4118e729083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-be9df82e-131b-4140-936d-09e4d2c54b30 req-aa907618-2b44-4803-b9e5-fd596d2b8ab2 service nova] Lock "c8e0cb34-d304-4405-862f-a4118e729083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:03 user nova-compute[74311]: DEBUG nova.compute.manager [req-be9df82e-131b-4140-936d-09e4d2c54b30 req-aa907618-2b44-4803-b9e5-fd596d2b8ab2 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] No waiting events found dispatching network-vif-plugged-f83fd133-2cf9-4f2e-a6fe-944d7adc094a {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:18:03 user nova-compute[74311]: WARNING nova.compute.manager [req-be9df82e-131b-4140-936d-09e4d2c54b30 req-aa907618-2b44-4803-b9e5-fd596d2b8ab2 service nova] [instance: c8e0cb34-d304-4405-862f-a4118e729083] Received unexpected event network-vif-plugged-f83fd133-2cf9-4f2e-a6fe-944d7adc094a for instance with vm_state deleted and task_state None.
Oct 20 10:18:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54c21d8f-4a2c-4e1a-b40d-1e44feeeef34 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "c8e0cb34-d304-4405-862f-a4118e729083" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.155s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:03 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:18:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:05 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:18:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:05 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:18:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:07 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:18:07 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7015MB free_disk=25.349994659423828GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Applying migration context for instance 2fed360b-584a-4e1a-8e27-9189de7f5007 as it has an incoming, in-progress migration dd8a86a6-bba1-457d-8599-8dbfac07dcec. Migration status is finished {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 10:18:07 user nova-compute[74311]: INFO nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating resource usage from migration dd8a86a6-bba1-457d-8599-8dbfac07dcec
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 47a30844-242f-4a7f-ad9f-232a6e76b4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ed823684-5b31-4b43-a601-bb5e303e0863 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Migration dd8a86a6-bba1-457d-8599-8dbfac07dcec is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2fed360b-584a-4e1a-8e27-9189de7f5007 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 710afd4b-9962-4ba4-b4ca-92c5d86a37d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance dcecd43c-0d21-4413-8fa5-02856f450b6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing inventories for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Updating ProviderTree inventory for provider 77cac819-3c22-4fec-a59d-0525ac40a90b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Updating inventory in ProviderTree for provider 77cac819-3c22-4fec-a59d-0525ac40a90b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing aggregate associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, aggregates: None {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 10:18:07 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing trait associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3 {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 10:18:08 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:18:08 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:18:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:18:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.845s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:08 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:18:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 10:18:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] There are 0 instances to clean {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 10:18:08 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:18:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74311) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 10:18:09 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:18:09 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:18:09 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhEZzuRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:18:11 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:18:11 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:18:11 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[640490a2-34b9-4003-a9cc-cd4d050d4f19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:18:11 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[996cb5f6-08e4-4df4-8442-7c14370d4fa5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138] added
Oct 20 10:18:11 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a20b4d1-76ea-4ca5-9ff7-d3b6e56d955d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f31c8f-30b3-4b3a-a6e5-d30cd6f86a5d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qhEZzuRd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qhEZzuRd" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96f02a2-020b-4a79-9ea6-1801691834b5]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qhEZzuRd'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a73ddb5-e2e7-4b96-ba77-cef9f916a69f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26ea1c1-45ce-40f2-8f1a-6814beba8b82]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:11 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:18:11 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:11 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:11 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:18:11 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:11 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[da17b8a9-5b5a-4730-9bb9-7aa2a85d8bee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260]
Oct 20 10:18:11 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260] successful.
Oct 20 10:18:11 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce354fe-7024-4c1c-a471-8f2b971d380e]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf052136-8874-4004-a65e-9012470c4da4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:11 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:18:11 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:11 user nova-compute[74311]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:18:11 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:11 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:18:11 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:11 user nova-compute[74311]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:18:11 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[570c1136-a934-4c9d-91d6-3c5c2439b8ed]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:18:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhEZzuRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:18:12 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:18:12 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23535313734376330', 'path': '/dev/sdd'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:18:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535313734376330', 'path': '/dev/sdd'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:18:12 user nova-compute[74311]: DEBUG nova.objects.instance [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lazy-loading 'flavor' on Instance uuid 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:18:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:18:12 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:18:12 user nova-compute[74311]:   <source dev="/dev/sdd"/>
Oct 20 10:18:12 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:18:12 user nova-compute[74311]:   <serial>9740904b-17dd-4a9b-be36-df6c67881138</serial>
Oct 20 10:18:12 user nova-compute[74311]: </disk>
Oct 20 10:18:12 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:18:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:18:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:18:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] No VIF found with MAC fa:16:3e:67:96:1e, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:18:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fcc5041f-72f5-44df-b6c5-7e81a014c71b tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.744s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:13 user nova-compute[74311]: DEBUG nova.network.neutron [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Port a042b1af-3064-4133-97dc-eaf5e3bf4859 binding to destination host user is already ACTIVE {{(pid=74311) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 10:18:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:18:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquired lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:18:13 user nova-compute[74311]: DEBUG nova.network.neutron [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:18:14 user nova-compute[74311]: DEBUG nova.network.neutron [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating instance_info_cache with network_info: [{"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:18:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Releasing lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:18:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Creating tmpfile /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/tmp_5mm_oco to verify with other compute node that the instance is on the same shared storage. {{(pid=74311) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 20 10:18:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:14 user nova-compute[74311]: INFO nova.compute.manager [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Rebuilding instance
Oct 20 10:18:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:14 user nova-compute[74311]: DEBUG nova.compute.manager [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:18:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:14 user nova-compute[74311]: DEBUG nova.compute.manager [req-e896cfcb-fee3-4a51-aa25-250dc68ce87b req-9019238c-d5e3-4834-861b-7904599d889f service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-vif-unplugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:18:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e896cfcb-fee3-4a51-aa25-250dc68ce87b req-9019238c-d5e3-4834-861b-7904599d889f service nova] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e896cfcb-fee3-4a51-aa25-250dc68ce87b req-9019238c-d5e3-4834-861b-7904599d889f service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e896cfcb-fee3-4a51-aa25-250dc68ce87b req-9019238c-d5e3-4834-861b-7904599d889f service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:14 user nova-compute[74311]: DEBUG nova.compute.manager [req-e896cfcb-fee3-4a51-aa25-250dc68ce87b req-9019238c-d5e3-4834-861b-7904599d889f service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] No waiting events found dispatching network-vif-unplugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:18:14 user nova-compute[74311]: WARNING nova.compute.manager [req-e896cfcb-fee3-4a51-aa25-250dc68ce87b req-9019238c-d5e3-4834-861b-7904599d889f service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received unexpected event network-vif-unplugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 for instance with vm_state resized and task_state resize_reverting.
Oct 20 10:18:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG nova.compute.manager [req-d39e9e0a-963d-4594-bc8f-ac01a8bf7298 req-eebe7a89-3d56-4972-b023-ff0cbb2c5a8f service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received event network-vif-unplugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d39e9e0a-963d-4594-bc8f-ac01a8bf7298 req-eebe7a89-3d56-4972-b023-ff0cbb2c5a8f service nova] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d39e9e0a-963d-4594-bc8f-ac01a8bf7298 req-eebe7a89-3d56-4972-b023-ff0cbb2c5a8f service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d39e9e0a-963d-4594-bc8f-ac01a8bf7298 req-eebe7a89-3d56-4972-b023-ff0cbb2c5a8f service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG nova.compute.manager [req-d39e9e0a-963d-4594-bc8f-ac01a8bf7298 req-eebe7a89-3d56-4972-b023-ff0cbb2c5a8f service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] No waiting events found dispatching network-vif-unplugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:18:15 user nova-compute[74311]: WARNING nova.compute.manager [req-d39e9e0a-963d-4594-bc8f-ac01a8bf7298 req-eebe7a89-3d56-4972-b023-ff0cbb2c5a8f service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received unexpected event network-vif-unplugged-5b30634a-aea2-4b86-b000-a108c2fb306b for instance with vm_state active and task_state rebuilding.
Oct 20 10:18:15 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Instance destroyed successfully.
Oct 20 10:18:15 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lazy-loading 'resources' on Instance uuid 2fed360b-584a-4e1a-8e27-9189de7f5007 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1040491951',display_name='tempest-ServerActionsTestOtherB-server-1040491951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1040491951',id=3,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYMmO8U1tJG2uyGm7rRRFIfa2RGpjFLZUdepKCTj1HHDZcXkXVS7OOg3Lk+mu44EcWQu9Fu9KdlNYR4A7PzrCGtqSSIRfDMJT14TIDOTSonr8dNWJPGqynHBYamRxl9rg==',key_name='tempest-keypair-849637715',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:16:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d174f4a262b044e58e8f211b06a41d40',ramdisk_id='',reservation_id='r-z4cepc28',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1319179529',owner_user_name='tempest-ServerActionsTestOtherB-1319179529-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:16:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b357b019ce2a4153af47b9e4c5586148',uuid=2fed360b-584a-4e1a-8e27-9189de7f5007,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converting VIF {"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_vif [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa042b1af-30, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cfaeb50-008d-435a-8f80-1b438ab6ac1e) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:15 user nova-compute[74311]: INFO os_vif [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30')
Oct 20 10:18:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mRenVUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:18:15 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c880d99a-942b-4f2c-9983-bffa940be369]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:18:15 user nova-compute[74311]: No targets found.
Oct 20 10:18:15 user nova-compute[74311]: iSNS:
Oct 20 10:18:15 user nova-compute[74311]: No targets found.
Oct 20 10:18:15 user nova-compute[74311]: STATIC:
Oct 20 10:18:15 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:18:15 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:18:15 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:18:15 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f
Oct 20 10:18:15 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:18:15 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:18:15 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5
Oct 20 10:18:15 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:18:15 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:18:15 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138
Oct 20 10:18:15 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:18:15 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:18:15 user nova-compute[74311]: FIRMWARE:
Oct 20 10:18:15 user nova-compute[74311]: No targets found.
Oct 20 10:18:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:18:15 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:18:15 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c65acc-79e9-4141-827e-67b411a5b862]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f62600-8a11-41bc-9fce-91018b41e131]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:15 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:18:15 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:15 user nova-compute[74311]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:18:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:15 user nova-compute[74311]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:18:15 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:15 user nova-compute[74311]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:18:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164fc1900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5'): ({'sdc'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Removing single pathed devices sdc {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[218c0d7f-b5ae-4ade-ac98-48da9b2bf283]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d05f6e-4a43-4d96-9cac-f6548085342b]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Flushing IO for device /dev/sdc {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[98604266-5d96-417b-a146-60f70568df36]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[663c7278-6cd9-4055-847c-7a9b8a4c4560]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2bd666-d244-4dc8-827a-4415ce6f1bd8]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d1c5f4-2a7d-45d1-8cd2-655aeca36533]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260]
Oct 20 10:18:15 user nova-compute[74311]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260] successful.
Oct 20 10:18:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[68aa869c-1010-46d8-bce7-d434c778df59]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] <== disconnect_volume: return (346ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:18:15 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Instance destroyed successfully.
Oct 20 10:18:15 user nova-compute[74311]: INFO nova.compute.manager [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Detaching volume 9740904b-17dd-4a9b-be36-df6c67881138
Oct 20 10:18:15 user nova-compute[74311]: INFO nova.virt.block_device [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Attempting to driver detach volume 9740904b-17dd-4a9b-be36-df6c67881138 from mountpoint /dev/vdb
Oct 20 10:18:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Attempting to detach device vdb from instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:18:15 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:18:15 user nova-compute[74311]:   <source dev="/dev/sdd"/>
Oct 20 10:18:15 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:18:15 user nova-compute[74311]:   <serial>9740904b-17dd-4a9b-be36-df6c67881138</serial>
Oct 20 10:18:15 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:18:15 user nova-compute[74311]: </disk>
Oct 20 10:18:15 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:18:15 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Successfully detached device vdb from instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 from the persistent domain config.
Oct 20 10:18:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhEZzuRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:18:15 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:18:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c6d188-291b-4488-9541-282bd1b11686]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:18:16 user nova-compute[74311]: No targets found.
Oct 20 10:18:16 user nova-compute[74311]: iSNS:
Oct 20 10:18:16 user nova-compute[74311]: No targets found.
Oct 20 10:18:16 user nova-compute[74311]: STATIC:
Oct 20 10:18:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:18:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:18:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:18:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f
Oct 20 10:18:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:18:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:18:16 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138
Oct 20 10:18:16 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:18:16 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:18:16 user nova-compute[74311]: FIRMWARE:
Oct 20 10:18:16 user nova-compute[74311]: No targets found.
Oct 20 10:18:16 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:18:16 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:18:16 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[673de736-f54c-4225-ba50-ef92e6e5369b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e9dea1-981c-413b-8bc4-bb6b02ecdd77]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:16 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:16 user nova-compute[74311]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:18:16 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:16 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:16 user nova-compute[74311]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:18:16 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164e42dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138'): ({'sdd'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Removing single pathed devices sdd {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15871f5-5c5d-4966-97e8-82b1c7b674ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2ddcf6-1d8b-4384-9e44-3eb242be24fa]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Flushing IO for device /dev/sdd {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[decd0822-5af5-4494-bc85-11fd99a120e2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af6117b-8acb-4a91-bb90-2a8d2cb42c33]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[896af210-7819-4717-bd43-1cdfd6d26bae]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ef50a2-3f2a-45f4-b9c5-0c34114777c3]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260]
Oct 20 10:18:16 user nova-compute[74311]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260] successful.
Oct 20 10:18:16 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[859328f8-8762-4c31-8aa7-054275ba5450]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] <== disconnect_volume: return (297ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lazy-loading 'migration_context' on Instance uuid 2fed360b-584a-4e1a-8e27-9189de7f5007 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:18:16 user nova-compute[74311]: DEBUG nova.objects.base [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Object Instance<2fed360b-584a-4e1a-8e27-9189de7f5007> lazy-loaded attributes: resources,migration_context {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG nova.compute.manager [req-5047a61c-5a40-4461-917a-7b1d12b3b5bb req-1dbb414b-28d7-411b-98c5-a63f638dbe8e service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5047a61c-5a40-4461-917a-7b1d12b3b5bb req-1dbb414b-28d7-411b-98c5-a63f638dbe8e service nova] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5047a61c-5a40-4461-917a-7b1d12b3b5bb req-1dbb414b-28d7-411b-98c5-a63f638dbe8e service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5047a61c-5a40-4461-917a-7b1d12b3b5bb req-1dbb414b-28d7-411b-98c5-a63f638dbe8e service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG nova.compute.manager [req-5047a61c-5a40-4461-917a-7b1d12b3b5bb req-1dbb414b-28d7-411b-98c5-a63f638dbe8e service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] No waiting events found dispatching network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:18:17 user nova-compute[74311]: WARNING nova.compute.manager [req-5047a61c-5a40-4461-917a-7b1d12b3b5bb req-1dbb414b-28d7-411b-98c5-a63f638dbe8e service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received unexpected event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 for instance with vm_state resized and task_state resize_reverting.
Oct 20 10:18:17 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Instance destroyed successfully.
Oct 20 10:18:17 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-914056221',display_name='tempest-ServerActionsTestOtherA-server-276569739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-914056221',id=15,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPveX+yAZpnzBzilkcm82E6+RHpmB0Xb/tXYm16sLT8H7wqp8K2NVg/iZiaW1MVGWyDcchuyOYeUsUsFBwuN8qHZxREI7vXeZa+FEOEsV4eO0AeOp/iLUFR9gTFEBuIiQ==',key_name='tempest-keypair-646262168',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:16:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-testi5fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:18:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=54c0cdc3-ebcd-46bf-9a6e-be7b6e450897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=5b30634a-aea2-4b86-b000-a108c2fb306b,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b30634a-ae') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_vif [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=5b30634a-aea2-4b86-b000-a108c2fb306b,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b30634a-ae') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b30634a-ae, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG nova.compute.manager [req-5dd40ff1-19e3-48a4-9373-3fe559e559fd req-b5c23152-c349-400d-a6bd-427644950909 service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received event network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5dd40ff1-19e3-48a4-9373-3fe559e559fd req-b5c23152-c349-400d-a6bd-427644950909 service nova] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5dd40ff1-19e3-48a4-9373-3fe559e559fd req-b5c23152-c349-400d-a6bd-427644950909 service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5dd40ff1-19e3-48a4-9373-3fe559e559fd req-b5c23152-c349-400d-a6bd-427644950909 service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG nova.compute.manager [req-5dd40ff1-19e3-48a4-9373-3fe559e559fd req-b5c23152-c349-400d-a6bd-427644950909 service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] No waiting events found dispatching network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:18:17 user nova-compute[74311]: WARNING nova.compute.manager [req-5dd40ff1-19e3-48a4-9373-3fe559e559fd req-b5c23152-c349-400d-a6bd-427644950909 service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received unexpected event network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b for instance with vm_state active and task_state rebuilding.
Oct 20 10:18:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b95d8d0-3a12-4ddd-a44a-d1ed646fb4cc) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:17 user nova-compute[74311]: INFO os_vif [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=5b30634a-aea2-4b86-b000-a108c2fb306b,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b30634a-ae')
Oct 20 10:18:17 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhEZzuRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:18:17 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e15d9c-68d7-416e-b6fa-f048d4a755c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:18:17 user nova-compute[74311]: No targets found.
Oct 20 10:18:17 user nova-compute[74311]: iSNS:
Oct 20 10:18:17 user nova-compute[74311]: No targets found.
Oct 20 10:18:17 user nova-compute[74311]: STATIC:
Oct 20 10:18:17 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:18:17 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:18:17 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:18:17 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f
Oct 20 10:18:17 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:18:17 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:18:17 user nova-compute[74311]: FIRMWARE:
Oct 20 10:18:17 user nova-compute[74311]: No targets found.
Oct 20 10:18:17 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:18:17 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:18:17 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f07eff8-4b16-45c6-af37-a947935186d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb960db2-921e-4c4d-86f7-e6ddfd68b407]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:17 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:17 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:17 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:17 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164faeef0>, {}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Disconnecting from: [] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.098s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] <== disconnect_volume: return (99ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:18:17 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Deleting instance files /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897_del
Oct 20 10:18:17 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Deletion of /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897_del complete
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.819s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:17 user nova-compute[74311]: INFO nova.virt.block_device [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Booting with volume 9740904b-17dd-4a9b-be36-df6c67881138 at /dev/vdb
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.utils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:17 user nova-compute[74311]: INFO nova.compute.manager [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Swapping old allocation on dict_keys(['77cac819-3c22-4fec-a59d-0525ac40a90b']) held by migration dd8a86a6-bba1-457d-8599-8dbfac07dcec for instance
Oct 20 10:18:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf77d729-e212-40ab-922e-877f5a672ecb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3645762-5278-4cc5-a925-5701643189c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6965e782-58d2-4a88-bf12-af6472db1b48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[508376bc-f9ca-42cc-b3cf-1c0e0b0d5460]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Overwriting current allocation {'allocations': {'77cac819-3c22-4fec-a59d-0525ac40a90b': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 25}}, 'project_id': 'd174f4a262b044e58e8f211b06a41d40', 'user_id': 'b357b019ce2a4153af47b9e4c5586148', 'consumer_generation': 1} on consumer 2fed360b-584a-4e1a-8e27-9189de7f5007 {{(pid=74311) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:18:17 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:18:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a94f0e6-3675-4041-a779-7016f005496f]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG os_brick.utils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Updating existing volume attachment record: 558de00c-d784-42e2-b46e-bc3164a938b8 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:18:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquired lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG nova.network.neutron [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG nova.network.neutron [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating instance_info_cache with network_info: [{"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Releasing lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG os_brick.utils [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[447e1498-e87b-45a6-aa61-8beedb0f88bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee79f93a-ec0f-406e-a9c5-97aa737f4b8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e98d9a-8667-4392-b874-722d7e761783]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4566954b-0d94-4d76-9aaa-fe7392cebf5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:18:18 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:18:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ca66ed-421e-46ce-b271-087f2eeaa1ca]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:18:18 user nova-compute[74311]: DEBUG os_brick.utils [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:18:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:18:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:31 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:18:31 user nova-compute[74311]: INFO nova.compute.claims [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Claim successful on node user
Oct 20 10:18:31 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:18:31 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:18:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:18:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:18:31 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:18:31 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:18:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:18:31 user nova-compute[74311]: DEBUG nova.policy [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eacf2bfd21e24516b6613c5e62f9c815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9724497a866463aa572a186693520b8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:18:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Creating image(s)
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "/opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "/opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:18:32 user nova-compute[74311]: WARNING nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] While synchronizing instance power states, found 13 instances in the database and 10 instances on the hypervisor.
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 47a30844-242f-4a7f-ad9f-232a6e76b4ec {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 22d78096-bc6c-4d6b-93b6-845d596ed24b {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 2fed360b-584a-4e1a-8e27-9189de7f5007 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid b0b457b8-159b-4533-ac97-dab7ffe0945e {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid ed823684-5b31-4b43-a601-bb5e303e0863 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid cfc97865-6f94-4924-afc5-188d50543672 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 710afd4b-9962-4ba4-b4ca-92c5d86a37d3 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid dcecd43c-0d21-4413-8fa5-02856f450b6a {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid c0f944dd-b256-4b47-9e2e-7ba50188f636 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 60618091-1d8e-477c-8ea8-63973626a7e2 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "22d78096-bc6c-4d6b-93b6-845d596ed24b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: INFO nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "b0b457b8-159b-4533-ac97-dab7ffe0945e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "ed823684-5b31-4b43-a601-bb5e303e0863" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "ed823684-5b31-4b43-a601-bb5e303e0863" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "cfc97865-6f94-4924-afc5-188d50543672" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: INFO nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "60618091-1d8e-477c-8ea8-63973626a7e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "60618091-1d8e-477c-8ea8-63973626a7e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.202s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "cfc97865-6f94-4924-afc5-188d50543672" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "ed823684-5b31-4b43-a601-bb5e303e0863" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.146s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "60618091-1d8e-477c-8ea8-63973626a7e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.156s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.175s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk 1073741824" returned: 0 in 0.061s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Successfully created port: 058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Cannot resize image /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Ensure instance console log exists: /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Successfully updated port: 058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquired lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-967e89d3-50be-4b11-9ad4-254fa62b0386 req-8aaec436-0df4-46ab-bcae-6a5214b14a6d service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-changed-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-967e89d3-50be-4b11-9ad4-254fa62b0386 req-8aaec436-0df4-46ab-bcae-6a5214b14a6d service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Refreshing instance network info cache due to event network-changed-058da87e-19f4-49ec-9ddd-c9e793db0844. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-967e89d3-50be-4b11-9ad4-254fa62b0386 req-8aaec436-0df4-46ab-bcae-6a5214b14a6d service nova] Acquiring lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Updating instance_info_cache with network_info: [{"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Releasing lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Instance network_info: |[{"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-967e89d3-50be-4b11-9ad4-254fa62b0386 req-8aaec436-0df4-46ab-bcae-6a5214b14a6d service nova] Acquired lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.network.neutron [req-967e89d3-50be-4b11-9ad4-254fa62b0386 req-8aaec436-0df4-46ab-bcae-6a5214b14a6d service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Refreshing network info cache for port 058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Start _get_guest_xml network_info=[{"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:18:33 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:18:33 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:18:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-475240772',display_name='tempest-ServerStableDeviceRescueTest-server-475240772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-475240772',id=21,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSaHAPJXPwHtr2z75hfGwvgYy3fJDl5BHYwTboRDjafFsh+foIsirIZZlOfDFQCIr1XyckI18S7vdaeeKQn22XSAYFAeShpR9yHRJWrgjTk9bykSFraTWi88/itm+f41A==',key_name='tempest-keypair-735267954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9724497a866463aa572a186693520b8',ramdisk_id='',reservation_id='r-7efu0f60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1321548002',owner_user_name='tempest-ServerStableDeviceRescueTest-1321548002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eacf2bfd21e24516b6613c5e62f9c815',uuid=2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Converting VIF {"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:eb:6a,bridge_name='br-int',has_traffic_filtering=True,id=058da87e-19f4-49ec-9ddd-c9e793db0844,network=Network(faf442c8-81aa-425e-a35c-f3cbe7afa1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap058da87e-19') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG nova.objects.instance [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:18:34 user nova-compute[74311]:   <uuid>2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9</uuid>
Oct 20 10:18:34 user nova-compute[74311]:   <name>instance-00000015</name>
Oct 20 10:18:34 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:18:34 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:18:34 user nova-compute[74311]:   <metadata>
Oct 20 10:18:34 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:18:34 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:18:34 user nova-compute[74311]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-475240772</nova:name>
Oct 20 10:18:34 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:18:33</nova:creationTime>
Oct 20 10:18:34 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:18:34 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:18:34 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:18:34 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:18:34 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:18:34 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:18:34 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:18:34 user nova-compute[74311]:       <nova:owner>
Oct 20 10:18:34 user nova-compute[74311]:         <nova:user uuid="eacf2bfd21e24516b6613c5e62f9c815">tempest-ServerStableDeviceRescueTest-1321548002-project-member</nova:user>
Oct 20 10:18:34 user nova-compute[74311]:         <nova:project uuid="f9724497a866463aa572a186693520b8">tempest-ServerStableDeviceRescueTest-1321548002</nova:project>
Oct 20 10:18:34 user nova-compute[74311]:       </nova:owner>
Oct 20 10:18:34 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:18:34 user nova-compute[74311]:       <nova:ports>
Oct 20 10:18:34 user nova-compute[74311]:         <nova:port uuid="058da87e-19f4-49ec-9ddd-c9e793db0844">
Oct 20 10:18:34 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 10:18:34 user nova-compute[74311]:         </nova:port>
Oct 20 10:18:34 user nova-compute[74311]:       </nova:ports>
Oct 20 10:18:34 user nova-compute[74311]:     </nova:instance>
Oct 20 10:18:34 user nova-compute[74311]:   </metadata>
Oct 20 10:18:34 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:18:34 user nova-compute[74311]:     <system>
Oct 20 10:18:34 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:18:34 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:18:34 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:18:34 user nova-compute[74311]:       <entry name="serial">2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9</entry>
Oct 20 10:18:34 user nova-compute[74311]:       <entry name="uuid">2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9</entry>
Oct 20 10:18:34 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:18:34 user nova-compute[74311]:     </system>
Oct 20 10:18:34 user nova-compute[74311]:   </sysinfo>
Oct 20 10:18:34 user nova-compute[74311]:   <os>
Oct 20 10:18:34 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:18:34 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:18:34 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:18:34 user nova-compute[74311]:   </os>
Oct 20 10:18:34 user nova-compute[74311]:   <features>
Oct 20 10:18:34 user nova-compute[74311]:     <acpi/>
Oct 20 10:18:34 user nova-compute[74311]:     <apic/>
Oct 20 10:18:34 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:18:34 user nova-compute[74311]:   </features>
Oct 20 10:18:34 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:18:34 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:18:34 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:18:34 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:18:34 user nova-compute[74311]:   </clock>
Oct 20 10:18:34 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:18:34 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:18:34 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:18:34 user nova-compute[74311]:   </cpu>
Oct 20 10:18:34 user nova-compute[74311]:   <devices>
Oct 20 10:18:34 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:18:34 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:18:34 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk"/>
Oct 20 10:18:34 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:18:34 user nova-compute[74311]:     </disk>
Oct 20 10:18:34 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:18:34 user nova-compute[74311]:       <mac address="fa:16:3e:ea:eb:6a"/>
Oct 20 10:18:34 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:18:34 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:18:34 user nova-compute[74311]:       <target dev="tap058da87e-19"/>
Oct 20 10:18:34 user nova-compute[74311]:     </interface>
Oct 20 10:18:34 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:18:34 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/console.log" append="off"/>
Oct 20 10:18:34 user nova-compute[74311]:     </serial>
Oct 20 10:18:34 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:18:34 user nova-compute[74311]:     <video>
Oct 20 10:18:34 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:18:34 user nova-compute[74311]:     </video>
Oct 20 10:18:34 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:18:34 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:18:34 user nova-compute[74311]:     </rng>
Oct 20 10:18:34 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:18:34 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:18:34 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:18:34 user nova-compute[74311]:     </memballoon>
Oct 20 10:18:34 user nova-compute[74311]:   </devices>
Oct 20 10:18:34 user nova-compute[74311]: </domain>
Oct 20 10:18:34 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-475240772',display_name='tempest-ServerStableDeviceRescueTest-server-475240772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-475240772',id=21,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSaHAPJXPwHtr2z75hfGwvgYy3fJDl5BHYwTboRDjafFsh+foIsirIZZlOfDFQCIr1XyckI18S7vdaeeKQn22XSAYFAeShpR9yHRJWrgjTk9bykSFraTWi88/itm+f41A==',key_name='tempest-keypair-735267954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9724497a866463aa572a186693520b8',ramdisk_id='',reservation_id='r-7efu0f60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1321548002',owner_user_name='tempest-ServerStableDeviceRescueTest-1321548002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eacf2bfd21e24516b6613c5e62f9c815',uuid=2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Converting VIF {"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:eb:6a,bridge_name='br-int',has_traffic_filtering=True,id=058da87e-19f4-49ec-9ddd-c9e793db0844,network=Network(faf442c8-81aa-425e-a35c-f3cbe7afa1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap058da87e-19') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG os_vif [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:eb:6a,bridge_name='br-int',has_traffic_filtering=True,id=058da87e-19f4-49ec-9ddd-c9e793db0844,network=Network(faf442c8-81aa-425e-a35c-f3cbe7afa1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap058da87e-19') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9808e86c-4996-5e4b-88fa-71272a7828b9', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap058da87e-19, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap058da87e-19, col_values=(('qos', UUID('63daa443-51e5-4977-aaf1-1674f196ec44')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap058da87e-19, col_values=(('external_ids', {'iface-id': '058da87e-19f4-49ec-9ddd-c9e793db0844', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:eb:6a', 'vm-uuid': '2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:34 user nova-compute[74311]: INFO os_vif [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:eb:6a,bridge_name='br-int',has_traffic_filtering=True,id=058da87e-19f4-49ec-9ddd-c9e793db0844,network=Network(faf442c8-81aa-425e-a35c-f3cbe7afa1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap058da87e-19')
Oct 20 10:18:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] No VIF found with MAC fa:16:3e:ea:eb:6a, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG nova.network.neutron [req-967e89d3-50be-4b11-9ad4-254fa62b0386 req-8aaec436-0df4-46ab-bcae-6a5214b14a6d service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Updated VIF entry in instance network info cache for port 058da87e-19f4-49ec-9ddd-c9e793db0844. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG nova.network.neutron [req-967e89d3-50be-4b11-9ad4-254fa62b0386 req-8aaec436-0df4-46ab-bcae-6a5214b14a6d service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Updating instance_info_cache with network_info: [{"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:18:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-967e89d3-50be-4b11-9ad4-254fa62b0386 req-8aaec436-0df4-46ab-bcae-6a5214b14a6d service nova] Releasing lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:18:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-b1577688-3f01-473e-8731-ba6242f586ee req-f36802d6-5529-4ab3-ab10-e5b48e560d46 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:18:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b1577688-3f01-473e-8731-ba6242f586ee req-f36802d6-5529-4ab3-ab10-e5b48e560d46 service nova] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b1577688-3f01-473e-8731-ba6242f586ee req-f36802d6-5529-4ab3-ab10-e5b48e560d46 service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b1577688-3f01-473e-8731-ba6242f586ee req-f36802d6-5529-4ab3-ab10-e5b48e560d46 service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-b1577688-3f01-473e-8731-ba6242f586ee req-f36802d6-5529-4ab3-ab10-e5b48e560d46 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] No waiting events found dispatching network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:18:35 user nova-compute[74311]: WARNING nova.compute.manager [req-b1577688-3f01-473e-8731-ba6242f586ee req-f36802d6-5529-4ab3-ab10-e5b48e560d46 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received unexpected event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 for instance with vm_state building and task_state spawning.
Oct 20 10:18:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:18:36 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Creating image(s)
Oct 20 10:18:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "/opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "/opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "/opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.185s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk 1073741824" returned: 0 in 0.051s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.192s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Starting finish_revert_migration {{(pid=74311) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Start _get_guest_xml network_info=[{"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '40873012-ca16-4d84-a754-67d482ba0b21', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mRenVUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2fed360b-584a-4e1a-8e27-9189de7f5007', 'attached_at': '2023-10-20T10:18:37.000000', 'detached_at': '', 'volume_id': '5a032ca5-d6bb-4766-93df-a1109b708ff5', 'serial': '5a032ca5-d6bb-4766-93df-a1109b708ff5'}, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:18:37 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:18:37 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2fed360b-584a-4e1a-8e27-9189de7f5007 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mRenVUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:18:37 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:18:37 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:18:37 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Cannot resize image /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Ensure instance console log exists: /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Start _get_guest_xml network_info=[{"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '558de00c-d784-42e2-b46e-bc3164a938b8', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhEZzuRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54c0cdc3-ebcd-46bf-9a6e-be7b6e450897', 'attached_at': '', 'detached_at': '', 'volume_id': '9740904b-17dd-4a9b-be36-df6c67881138', 'serial': '9740904b-17dd-4a9b-be36-df6c67881138'}, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[474e8f9a-a2a1-4c2e-a728-79a6e265e631]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:18:37 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:37 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 10:18:37 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.objects.instance [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lazy-loading 'vcpu_model' on Instance uuid 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[772f1ac6-bc7b-4708-9a9f-2f1977adba1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5] added
Oct 20 10:18:37 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhEZzuRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:18:37 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fcbba6-6ebf-436b-a852-5b3b6e678622]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5edcbf5-7878-465d-bbe0-ba38829f20c2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mRenVUQx {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mRenVUQx" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[66913cef-1078-42b1-b4ae-6b5822dd967d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mRenVUQx'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8ff519-a9a1-42c3-b595-3b2b4a8fd16f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04a4b30-df7f-4f04-a60a-4956efbdf344]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:37 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:37 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:37 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:37 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5796b90-27e6-4ec0-8ae8-7ad94b617672]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260]
Oct 20 10:18:37 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260] successful.
Oct 20 10:18:37 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG nova.compute.manager [req-b902a232-bed1-4477-baa4-95c0b077bb04 req-c6ca89a4-d46e-4b59-9c6a-811ed90d170d service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b902a232-bed1-4477-baa4-95c0b077bb04 req-c6ca89a4-d46e-4b59-9c6a-811ed90d170d service nova] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b902a232-bed1-4477-baa4-95c0b077bb04 req-c6ca89a4-d46e-4b59-9c6a-811ed90d170d service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b902a232-bed1-4477-baa4-95c0b077bb04 req-c6ca89a4-d46e-4b59-9c6a-811ed90d170d service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG nova.compute.manager [req-b902a232-bed1-4477-baa4-95c0b077bb04 req-c6ca89a4-d46e-4b59-9c6a-811ed90d170d service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] No waiting events found dispatching network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:18:38 user nova-compute[74311]: WARNING nova.compute.manager [req-b902a232-bed1-4477-baa4-95c0b077bb04 req-c6ca89a4-d46e-4b59-9c6a-811ed90d170d service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received unexpected event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 for instance with vm_state building and task_state spawning.
Oct 20 10:18:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b44dda-b7ec-49c2-9eae-66cf8b71e7a3]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3e1402-45f7-445d-a97e-7f8b97aa634c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:38 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:38 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:18:38 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:38 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:38 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:18:38 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:18:38 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Instance spawned successfully.
Oct 20 10:18:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a6bb90-fbb0-4fa4-ad2c-c99268b85818]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:18:38 user nova-compute[74311]: INFO nova.compute.manager [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Took 6.20 seconds to spawn the instance on the hypervisor.
Oct 20 10:18:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:18:38 user nova-compute[74311]: INFO nova.compute.manager [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Took 7.18 seconds to build instance.
Oct 20 10:18:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba3b03fc-b4f4-47ae-b837-f285efb8fdb0 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.333s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.135s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:38 user nova-compute[74311]: INFO nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 20 10:18:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mRenVUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23735386434363531', 'path': '/dev/sdc'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735386434363531', 'path': '/dev/sdc'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.260s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:18:39 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:18:39 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6e4f47-9bce-44f8-ba71-6e6ec6fe2182]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:18:39 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1040491951',display_name='tempest-ServerActionsTestOtherB-server-1040491951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1040491951',id=3,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYMmO8U1tJG2uyGm7rRRFIfa2RGpjFLZUdepKCTj1HHDZcXkXVS7OOg3Lk+mu44EcWQu9Fu9KdlNYR4A7PzrCGtqSSIRfDMJT14TIDOTSonr8dNWJPGqynHBYamRxl9rg==',key_name='tempest-keypair-849637715',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:16:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d174f4a262b044e58e8f211b06a41d40',ramdisk_id='',reservation_id='r-z4cepc28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1319179529',owner_user_name='tempest-ServerActionsTestOtherB-1319179529-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b357b019ce2a4153af47b9e4c5586148',uuid=2fed360b-584a-4e1a-8e27-9189de7f5007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converting VIF {"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:18:39 user nova-compute[74311]:   <uuid>2fed360b-584a-4e1a-8e27-9189de7f5007</uuid>
Oct 20 10:18:39 user nova-compute[74311]:   <name>instance-00000003</name>
Oct 20 10:18:39 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:18:39 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:18:39 user nova-compute[74311]:   <metadata>
Oct 20 10:18:39 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:18:39 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:18:39 user nova-compute[74311]:       <nova:name>tempest-ServerActionsTestOtherB-server-1040491951</nova:name>
Oct 20 10:18:39 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:18:37</nova:creationTime>
Oct 20 10:18:39 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:18:39 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:18:39 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:18:39 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:18:39 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:18:39 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:18:39 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:18:39 user nova-compute[74311]:       <nova:owner>
Oct 20 10:18:39 user nova-compute[74311]:         <nova:user uuid="b357b019ce2a4153af47b9e4c5586148">tempest-ServerActionsTestOtherB-1319179529-project-member</nova:user>
Oct 20 10:18:39 user nova-compute[74311]:         <nova:project uuid="d174f4a262b044e58e8f211b06a41d40">tempest-ServerActionsTestOtherB-1319179529</nova:project>
Oct 20 10:18:39 user nova-compute[74311]:       </nova:owner>
Oct 20 10:18:39 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:18:39 user nova-compute[74311]:       <nova:ports>
Oct 20 10:18:39 user nova-compute[74311]:         <nova:port uuid="a042b1af-3064-4133-97dc-eaf5e3bf4859">
Oct 20 10:18:39 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 10:18:39 user nova-compute[74311]:         </nova:port>
Oct 20 10:18:39 user nova-compute[74311]:       </nova:ports>
Oct 20 10:18:39 user nova-compute[74311]:     </nova:instance>
Oct 20 10:18:39 user nova-compute[74311]:   </metadata>
Oct 20 10:18:39 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:18:39 user nova-compute[74311]:     <system>
Oct 20 10:18:39 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:18:39 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:18:39 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:18:39 user nova-compute[74311]:       <entry name="serial">2fed360b-584a-4e1a-8e27-9189de7f5007</entry>
Oct 20 10:18:39 user nova-compute[74311]:       <entry name="uuid">2fed360b-584a-4e1a-8e27-9189de7f5007</entry>
Oct 20 10:18:39 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:18:39 user nova-compute[74311]:     </system>
Oct 20 10:18:39 user nova-compute[74311]:   </sysinfo>
Oct 20 10:18:39 user nova-compute[74311]:   <os>
Oct 20 10:18:39 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:18:39 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:18:39 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:18:39 user nova-compute[74311]:   </os>
Oct 20 10:18:39 user nova-compute[74311]:   <features>
Oct 20 10:18:39 user nova-compute[74311]:     <acpi/>
Oct 20 10:18:39 user nova-compute[74311]:     <apic/>
Oct 20 10:18:39 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:18:39 user nova-compute[74311]:   </features>
Oct 20 10:18:39 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:18:39 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:18:39 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:18:39 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:18:39 user nova-compute[74311]:   </clock>
Oct 20 10:18:39 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:18:39 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:18:39 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:18:39 user nova-compute[74311]:   </cpu>
Oct 20 10:18:39 user nova-compute[74311]:   <devices>
Oct 20 10:18:39 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:18:39 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:18:39 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk"/>
Oct 20 10:18:39 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:18:39 user nova-compute[74311]:     </disk>
Oct 20 10:18:39 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:18:39 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:18:39 user nova-compute[74311]:       <source dev="/dev/sdc"/>
Oct 20 10:18:39 user nova-compute[74311]:       <target dev="vdb" bus="virtio"/>
Oct 20 10:18:39 user nova-compute[74311]:       <serial>5a032ca5-d6bb-4766-93df-a1109b708ff5</serial>
Oct 20 10:18:39 user nova-compute[74311]:     </disk>
Oct 20 10:18:39 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:18:39 user nova-compute[74311]:       <mac address="fa:16:3e:08:6f:b2"/>
Oct 20 10:18:39 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:18:39 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:18:39 user nova-compute[74311]:       <target dev="tapa042b1af-30"/>
Oct 20 10:18:39 user nova-compute[74311]:     </interface>
Oct 20 10:18:39 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:18:39 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/console.log" append="off"/>
Oct 20 10:18:39 user nova-compute[74311]:     </serial>
Oct 20 10:18:39 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:18:39 user nova-compute[74311]:     <video>
Oct 20 10:18:39 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:18:39 user nova-compute[74311]:     </video>
Oct 20 10:18:39 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:18:39 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:18:39 user nova-compute[74311]:     </rng>
Oct 20 10:18:39 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:18:39 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:18:39 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:18:39 user nova-compute[74311]:     </memballoon>
Oct 20 10:18:39 user nova-compute[74311]:   </devices>
Oct 20 10:18:39 user nova-compute[74311]: </domain>
Oct 20 10:18:39 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1040491951',display_name='tempest-ServerActionsTestOtherB-server-1040491951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1040491951',id=3,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYMmO8U1tJG2uyGm7rRRFIfa2RGpjFLZUdepKCTj1HHDZcXkXVS7OOg3Lk+mu44EcWQu9Fu9KdlNYR4A7PzrCGtqSSIRfDMJT14TIDOTSonr8dNWJPGqynHBYamRxl9rg==',key_name='tempest-keypair-849637715',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:16:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d174f4a262b044e58e8f211b06a41d40',ramdisk_id='',reservation_id='r-z4cepc28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1319179529',owner_user_name='tempest-ServerActionsTestOtherB-1319179529-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:18:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b357b019ce2a4153af47b9e4c5586148',uuid=2fed360b-584a-4e1a-8e27-9189de7f5007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converting VIF {"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_vif [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '952d5d0e-0445-5182-8a21-eafe36663d7b', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31543c7-fc25-4709-a22a-331a4bf90f19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138] added
Oct 20 10:18:39 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa042b1af-30, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa042b1af-30, col_values=(('qos', UUID('6aa1f97c-30b5-409c-a2e8-ae8ddb27a15e')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa042b1af-30, col_values=(('external_ids', {'iface-id': 'a042b1af-3064-4133-97dc-eaf5e3bf4859', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:6f:b2', 'vm-uuid': '2fed360b-584a-4e1a-8e27-9189de7f5007'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f982f72-b3bb-42ad-97d9-f5d6ae978d54]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:39 user nova-compute[74311]: INFO os_vif [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30')
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e44b20-ad91-429b-b956-e13c86cc64d6]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qhEZzuRd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qhEZzuRd" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc049e8-b0e1-4cb2-a7a6-a91a36d80dd1]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qhEZzuRd'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4eb4d4c-dcec-4e78-947f-24f7776c06c8]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c13f63b-0249-4486-bab1-6c43fe6c2924]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:39 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:39 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:18:39 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:39 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:39 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:18:39 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5852b607-ab1e-4690-adca-96d6dcc9de9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260]
Oct 20 10:18:39 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260] successful.
Oct 20 10:18:39 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24c082e-7cd3-498c-8e4c-b83305b850db]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d77aa9e-385f-4995-be20-c88b2d1daf5f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:39 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:39 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:18:39 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:18:39 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:18:39 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:18:39 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:18:39 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:18:39 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0354c98-c6ff-44dc-88de-952b8fceb8ef]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:18:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhEZzuRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] <== connect_volume: return (2630ms) {'type': 'block', 'scsi_wwn': '23535313734376330', 'path': '/dev/sdd'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535313734376330', 'path': '/dev/sdd'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-914056221',display_name='tempest-ServerActionsTestOtherA-server-276569739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-914056221',id=15,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPveX+yAZpnzBzilkcm82E6+RHpmB0Xb/tXYm16sLT8H7wqp8K2NVg/iZiaW1MVGWyDcchuyOYeUsUsFBwuN8qHZxREI7vXeZa+FEOEsV4eO0AeOp/iLUFR9gTFEBuIiQ==',key_name='tempest-keypair-646262168',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:16:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-testi5fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:18:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=54c0cdc3-ebcd-46bf-9a6e-be7b6e450897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=5b30634a-aea2-4b86-b000-a108c2fb306b,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b30634a-ae') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:18:40 user nova-compute[74311]:   <uuid>54c0cdc3-ebcd-46bf-9a6e-be7b6e450897</uuid>
Oct 20 10:18:40 user nova-compute[74311]:   <name>instance-0000000f</name>
Oct 20 10:18:40 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:18:40 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:18:40 user nova-compute[74311]:   <metadata>
Oct 20 10:18:40 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:18:40 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:18:40 user nova-compute[74311]:       <nova:name>tempest-ServerActionsTestOtherA-server-276569739</nova:name>
Oct 20 10:18:40 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:18:37</nova:creationTime>
Oct 20 10:18:40 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:18:40 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:18:40 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:18:40 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:18:40 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:18:40 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:18:40 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:18:40 user nova-compute[74311]:       <nova:owner>
Oct 20 10:18:40 user nova-compute[74311]:         <nova:user uuid="5eb8db6bee87451f95e4bfdc61854bc5">tempest-ServerActionsTestOtherA-2000022938-project-member</nova:user>
Oct 20 10:18:40 user nova-compute[74311]:         <nova:project uuid="2f61456f02bc4688b8cd9d66a2b1868d">tempest-ServerActionsTestOtherA-2000022938</nova:project>
Oct 20 10:18:40 user nova-compute[74311]:       </nova:owner>
Oct 20 10:18:40 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:18:40 user nova-compute[74311]:       <nova:ports>
Oct 20 10:18:40 user nova-compute[74311]:         <nova:port uuid="5b30634a-aea2-4b86-b000-a108c2fb306b">
Oct 20 10:18:40 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 10:18:40 user nova-compute[74311]:         </nova:port>
Oct 20 10:18:40 user nova-compute[74311]:       </nova:ports>
Oct 20 10:18:40 user nova-compute[74311]:     </nova:instance>
Oct 20 10:18:40 user nova-compute[74311]:   </metadata>
Oct 20 10:18:40 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:18:40 user nova-compute[74311]:     <system>
Oct 20 10:18:40 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:18:40 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:18:40 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:18:40 user nova-compute[74311]:       <entry name="serial">54c0cdc3-ebcd-46bf-9a6e-be7b6e450897</entry>
Oct 20 10:18:40 user nova-compute[74311]:       <entry name="uuid">54c0cdc3-ebcd-46bf-9a6e-be7b6e450897</entry>
Oct 20 10:18:40 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:18:40 user nova-compute[74311]:     </system>
Oct 20 10:18:40 user nova-compute[74311]:   </sysinfo>
Oct 20 10:18:40 user nova-compute[74311]:   <os>
Oct 20 10:18:40 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:18:40 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:18:40 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:18:40 user nova-compute[74311]:   </os>
Oct 20 10:18:40 user nova-compute[74311]:   <features>
Oct 20 10:18:40 user nova-compute[74311]:     <acpi/>
Oct 20 10:18:40 user nova-compute[74311]:     <apic/>
Oct 20 10:18:40 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:18:40 user nova-compute[74311]:   </features>
Oct 20 10:18:40 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:18:40 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:18:40 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:18:40 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:18:40 user nova-compute[74311]:   </clock>
Oct 20 10:18:40 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:18:40 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:18:40 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:18:40 user nova-compute[74311]:   </cpu>
Oct 20 10:18:40 user nova-compute[74311]:   <devices>
Oct 20 10:18:40 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:18:40 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:18:40 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk"/>
Oct 20 10:18:40 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:18:40 user nova-compute[74311]:     </disk>
Oct 20 10:18:40 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:18:40 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:18:40 user nova-compute[74311]:       <source dev="/dev/sdd"/>
Oct 20 10:18:40 user nova-compute[74311]:       <target dev="vdb" bus="virtio"/>
Oct 20 10:18:40 user nova-compute[74311]:       <serial>9740904b-17dd-4a9b-be36-df6c67881138</serial>
Oct 20 10:18:40 user nova-compute[74311]:     </disk>
Oct 20 10:18:40 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:18:40 user nova-compute[74311]:       <mac address="fa:16:3e:67:96:1e"/>
Oct 20 10:18:40 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:18:40 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:18:40 user nova-compute[74311]:       <target dev="tap5b30634a-ae"/>
Oct 20 10:18:40 user nova-compute[74311]:     </interface>
Oct 20 10:18:40 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:18:40 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/console.log" append="off"/>
Oct 20 10:18:40 user nova-compute[74311]:     </serial>
Oct 20 10:18:40 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:18:40 user nova-compute[74311]:     <video>
Oct 20 10:18:40 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:18:40 user nova-compute[74311]:     </video>
Oct 20 10:18:40 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:18:40 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:18:40 user nova-compute[74311]:     </rng>
Oct 20 10:18:40 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:18:40 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:18:40 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:18:40 user nova-compute[74311]:     </memballoon>
Oct 20 10:18:40 user nova-compute[74311]:   </devices>
Oct 20 10:18:40 user nova-compute[74311]: </domain>
Oct 20 10:18:40 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-914056221',display_name='tempest-ServerActionsTestOtherA-server-276569739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-914056221',id=15,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPveX+yAZpnzBzilkcm82E6+RHpmB0Xb/tXYm16sLT8H7wqp8K2NVg/iZiaW1MVGWyDcchuyOYeUsUsFBwuN8qHZxREI7vXeZa+FEOEsV4eO0AeOp/iLUFR9gTFEBuIiQ==',key_name='tempest-keypair-646262168',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:16:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-testi5fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:18:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=54c0cdc3-ebcd-46bf-9a6e-be7b6e450897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=5b30634a-aea2-4b86-b000-a108c2fb306b,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b30634a-ae') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG os_vif [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=5b30634a-aea2-4b86-b000-a108c2fb306b,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b30634a-ae') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6818e4c6-ff6a-5fcf-a751-764f294dad12', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b30634a-ae, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b30634a-ae, col_values=(('qos', UUID('46a62b25-b668-4ac4-9cfd-f37269c69483')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b30634a-ae, col_values=(('external_ids', {'iface-id': '5b30634a-aea2-4b86-b000-a108c2fb306b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:96:1e', 'vm-uuid': '54c0cdc3-ebcd-46bf-9a6e-be7b6e450897'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:40 user nova-compute[74311]: INFO os_vif [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=5b30634a-aea2-4b86-b000-a108c2fb306b,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b30634a-ae')
Oct 20 10:18:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:18:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] No VIF found with MAC fa:16:3e:67:96:1e, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:18:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-452ba6a2-b9b8-4774-bea1-afc2909db25c req-c556826d-ee6d-4f2e-9867-1a59a9af2373 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:18:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-452ba6a2-b9b8-4774-bea1-afc2909db25c req-c556826d-ee6d-4f2e-9867-1a59a9af2373 service nova] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-452ba6a2-b9b8-4774-bea1-afc2909db25c req-c556826d-ee6d-4f2e-9867-1a59a9af2373 service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-452ba6a2-b9b8-4774-bea1-afc2909db25c req-c556826d-ee6d-4f2e-9867-1a59a9af2373 service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-452ba6a2-b9b8-4774-bea1-afc2909db25c req-c556826d-ee6d-4f2e-9867-1a59a9af2373 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] No waiting events found dispatching network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:18:41 user nova-compute[74311]: WARNING nova.compute.manager [req-452ba6a2-b9b8-4774-bea1-afc2909db25c req-c556826d-ee6d-4f2e-9867-1a59a9af2373 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received unexpected event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 for instance with vm_state resized and task_state resize_reverting.
Oct 20 10:18:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-51963e57-2550-4fdb-9a64-28736aa3e69e req-b591beb0-9c88-4f8e-a9e7-c96b583585da service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received event network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:18:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-51963e57-2550-4fdb-9a64-28736aa3e69e req-b591beb0-9c88-4f8e-a9e7-c96b583585da service nova] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-51963e57-2550-4fdb-9a64-28736aa3e69e req-b591beb0-9c88-4f8e-a9e7-c96b583585da service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-51963e57-2550-4fdb-9a64-28736aa3e69e req-b591beb0-9c88-4f8e-a9e7-c96b583585da service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-51963e57-2550-4fdb-9a64-28736aa3e69e req-b591beb0-9c88-4f8e-a9e7-c96b583585da service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] No waiting events found dispatching network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:18:42 user nova-compute[74311]: WARNING nova.compute.manager [req-51963e57-2550-4fdb-9a64-28736aa3e69e req-b591beb0-9c88-4f8e-a9e7-c96b583585da service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received unexpected event network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b for instance with vm_state active and task_state rebuild_spawning.
Oct 20 10:18:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-b26b15d7-cea8-4afd-997e-7b32bfded3b5 req-ec5a973d-98f5-4dd8-bec6-2aec609b0353 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:18:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b26b15d7-cea8-4afd-997e-7b32bfded3b5 req-ec5a973d-98f5-4dd8-bec6-2aec609b0353 service nova] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b26b15d7-cea8-4afd-997e-7b32bfded3b5 req-ec5a973d-98f5-4dd8-bec6-2aec609b0353 service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b26b15d7-cea8-4afd-997e-7b32bfded3b5 req-ec5a973d-98f5-4dd8-bec6-2aec609b0353 service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-b26b15d7-cea8-4afd-997e-7b32bfded3b5 req-ec5a973d-98f5-4dd8-bec6-2aec609b0353 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] No waiting events found dispatching network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:18:43 user nova-compute[74311]: WARNING nova.compute.manager [req-b26b15d7-cea8-4afd-997e-7b32bfded3b5 req-ec5a973d-98f5-4dd8-bec6-2aec609b0353 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received unexpected event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 for instance with vm_state resized and task_state resize_reverting.
Oct 20 10:18:44 user nova-compute[74311]: DEBUG nova.compute.manager [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:18:44 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Instance running successfully.
Oct 20 10:18:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] finish_revert_migration finished successfully. {{(pid=74311) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 20 10:18:44 user nova-compute[74311]: INFO nova.compute.manager [None req-e2e9fac5-1682-47fa-88aa-90e0ab430d4a tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating instance to original state: 'active'
Oct 20 10:18:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-689e687f-d367-44c6-8a50-93b8d0e95da0 req-b15de9d7-256e-412a-845f-97f7b5d09346 service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received event network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:18:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-689e687f-d367-44c6-8a50-93b8d0e95da0 req-b15de9d7-256e-412a-845f-97f7b5d09346 service nova] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-689e687f-d367-44c6-8a50-93b8d0e95da0 req-b15de9d7-256e-412a-845f-97f7b5d09346 service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-689e687f-d367-44c6-8a50-93b8d0e95da0 req-b15de9d7-256e-412a-845f-97f7b5d09346 service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-689e687f-d367-44c6-8a50-93b8d0e95da0 req-b15de9d7-256e-412a-845f-97f7b5d09346 service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] No waiting events found dispatching network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:18:44 user nova-compute[74311]: WARNING nova.compute.manager [req-689e687f-d367-44c6-8a50-93b8d0e95da0 req-b15de9d7-256e-412a-845f-97f7b5d09346 service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received unexpected event network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b for instance with vm_state active and task_state rebuild_spawning.
Oct 20 10:18:45 user nova-compute[74311]: DEBUG nova.compute.manager [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:18:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:18:45 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Instance spawned successfully.
Oct 20 10:18:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:18:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:18:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:18:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:18:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:18:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:18:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:18:45 user nova-compute[74311]: DEBUG nova.compute.manager [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:18:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:45 user nova-compute[74311]: DEBUG nova.objects.instance [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74311) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 20 10:18:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-031da81d-1aab-424a-805e-6361004724f9 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.081s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquiring lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG nova.objects.instance [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lazy-loading 'flavor' on Instance uuid 710afd4b-9962-4ba4-b4ca-92c5d86a37d3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquiring lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:18:48 user nova-compute[74311]: INFO nova.compute.manager [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Attaching volume 14b26dd8-586e-4589-bdb5-c9419601e8a5 to /dev/vdb
Oct 20 10:18:48 user nova-compute[74311]: DEBUG os_brick.utils [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee49f287-f874-42f0-a9e2-0edd90e486b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a599d1-551a-4916-bd4e-a07b81ecec52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf020af-d529-47c7-befb-d9eba6eeac1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff587cd1-7ff5-403c-ae80-c6a5868e68e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:18:48 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:18:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02b8aad-211b-4ea9-bd3f-6f72e47e3267]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG os_brick.utils [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:18:48 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Updating existing volume attachment record: 876d46ea-3258-4f59-a942-503efa05ca00 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:18:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:56 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:18:56 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:18:56 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:18:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-47a30844-242f-4a7f-ad9f-232a6e76b4ec" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:18:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-47a30844-242f-4a7f-ad9f-232a6e76b4ec" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:18:56 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:18:56 user nova-compute[74311]: DEBUG nova.objects.instance [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lazy-loading 'info_cache' on Instance uuid 47a30844-242f-4a7f-ad9f-232a6e76b4ec {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:18:56 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Updating instance_info_cache with network_info: [{"id": "3547e076-2273-41d1-829e-062952da0e37", "address": "fa:16:3e:e8:4a:24", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547e076-22", "ovs_interfaceid": "3547e076-2273-41d1-829e-062952da0e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:18:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-47a30844-242f-4a7f-ad9f-232a6e76b4ec" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:18:56 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:18:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:18:58 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:18:58 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:18:59 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:19:00 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:19:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "ed823684-5b31-4b43-a601-bb5e303e0863" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "ed823684-5b31-4b43-a601-bb5e303e0863" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:00 user nova-compute[74311]: INFO nova.compute.manager [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Terminating instance
Oct 20 10:19:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-aa585715-104d-4ab9-8be2-7ac924867710 req-b9f9df33-dd32-4ecb-864f-77de4990abe2 service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Received event network-vif-unplugged-24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-aa585715-104d-4ab9-8be2-7ac924867710 req-b9f9df33-dd32-4ecb-864f-77de4990abe2 service nova] Acquiring lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-aa585715-104d-4ab9-8be2-7ac924867710 req-b9f9df33-dd32-4ecb-864f-77de4990abe2 service nova] Lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-aa585715-104d-4ab9-8be2-7ac924867710 req-b9f9df33-dd32-4ecb-864f-77de4990abe2 service nova] Lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-aa585715-104d-4ab9-8be2-7ac924867710 req-b9f9df33-dd32-4ecb-864f-77de4990abe2 service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] No waiting events found dispatching network-vif-unplugged-24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-aa585715-104d-4ab9-8be2-7ac924867710 req-b9f9df33-dd32-4ecb-864f-77de4990abe2 service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Received event network-vif-unplugged-24cefeda-ceaf-460b-b902-a5895a6bb394 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:19:01 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Instance destroyed successfully.
Oct 20 10:19:01 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lazy-loading 'resources' on Instance uuid ed823684-5b31-4b43-a601-bb5e303e0863 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1489093091',display_name='tempest-VolumesAdminNegativeTest-server-1489093091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1489093091',id=7,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExeqd9Ke//Vk7oETXDip59BSJafFEINeMl4IlWBHmg9MXb83KGCEQB8vYFGYPXs5LpBPWlexLGDZorm0rO1xICUUWSUB/OTzZTGdZFeDPjH/EOC+NTIriR8Z6sGYG1btw==',key_name='tempest-keypair-1852808818',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6afc4c55cdc4c01ab172638b262a976',ramdisk_id='',reservation_id='r-5c0csvyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-230171363',owner_user_name='tempest-VolumesAdminNegativeTest-230171363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f53d41e3e16e47198a9a0381fd683244',uuid=ed823684-5b31-4b43-a601-bb5e303e0863,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24cefeda-ceaf-460b-b902-a5895a6bb394", "address": "fa:16:3e:08:f0:9b", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cefeda-ce", "ovs_interfaceid": "24cefeda-ceaf-460b-b902-a5895a6bb394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Converting VIF {"id": "24cefeda-ceaf-460b-b902-a5895a6bb394", "address": "fa:16:3e:08:f0:9b", "network": {"id": "b8fa77f6-0c71-4754-a562-9f147defb87b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1500993290-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6afc4c55cdc4c01ab172638b262a976", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cefeda-ce", "ovs_interfaceid": "24cefeda-ceaf-460b-b902-a5895a6bb394", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:f0:9b,bridge_name='br-int',has_traffic_filtering=True,id=24cefeda-ceaf-460b-b902-a5895a6bb394,network=Network(b8fa77f6-0c71-4754-a562-9f147defb87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cefeda-ce') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG os_vif [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:f0:9b,bridge_name='br-int',has_traffic_filtering=True,id=24cefeda-ceaf-460b-b902-a5895a6bb394,network=Network(b8fa77f6-0c71-4754-a562-9f147defb87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cefeda-ce') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24cefeda-ce, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbbfe0ea-dc04-4083-ae5a-b0d35f7a5041) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:19:01 user nova-compute[74311]: INFO os_vif [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:f0:9b,bridge_name='br-int',has_traffic_filtering=True,id=24cefeda-ceaf-460b-b902-a5895a6bb394,network=Network(b8fa77f6-0c71-4754-a562-9f147defb87b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cefeda-ce')
Oct 20 10:19:01 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Deleting instance files /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863_del
Oct 20 10:19:01 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Deletion of /opt/stack/data/nova/instances/ed823684-5b31-4b43-a601-bb5e303e0863_del complete
Oct 20 10:19:01 user nova-compute[74311]: INFO nova.compute.manager [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 20 10:19:01 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:19:01 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:02 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Took 0.91 seconds to deallocate network for instance.
Oct 20 10:19:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.557s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:03 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Deleted allocations for instance ed823684-5b31-4b43-a601-bb5e303e0863
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG nova.compute.manager [req-77b3a1ef-3ca2-4041-9703-1336de02719e req-fe673349-3175-41ce-852f-9de0654e3ea4 service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Received event network-vif-plugged-24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-77b3a1ef-3ca2-4041-9703-1336de02719e req-fe673349-3175-41ce-852f-9de0654e3ea4 service nova] Acquiring lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-77b3a1ef-3ca2-4041-9703-1336de02719e req-fe673349-3175-41ce-852f-9de0654e3ea4 service nova] Lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-77b3a1ef-3ca2-4041-9703-1336de02719e req-fe673349-3175-41ce-852f-9de0654e3ea4 service nova] Lock "ed823684-5b31-4b43-a601-bb5e303e0863-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG nova.compute.manager [req-77b3a1ef-3ca2-4041-9703-1336de02719e req-fe673349-3175-41ce-852f-9de0654e3ea4 service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] No waiting events found dispatching network-vif-plugged-24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:03 user nova-compute[74311]: WARNING nova.compute.manager [req-77b3a1ef-3ca2-4041-9703-1336de02719e req-fe673349-3175-41ce-852f-9de0654e3ea4 service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Received unexpected event network-vif-plugged-24cefeda-ceaf-460b-b902-a5895a6bb394 for instance with vm_state deleted and task_state None.
Oct 20 10:19:03 user nova-compute[74311]: DEBUG nova.compute.manager [req-77b3a1ef-3ca2-4041-9703-1336de02719e req-fe673349-3175-41ce-852f-9de0654e3ea4 service nova] [instance: ed823684-5b31-4b43-a601-bb5e303e0863] Received event network-vif-deleted-24cefeda-ceaf-460b-b902-a5895a6bb394 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7bc10488-c13d-4169-b705-45c107253269 tempest-VolumesAdminNegativeTest-230171363 tempest-VolumesAdminNegativeTest-230171363-project-member] Lock "ed823684-5b31-4b43-a601-bb5e303e0863" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.606s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:19:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:19:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:05 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:19:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:05 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:19:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:07 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:19:07 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=6820MB free_disk=25.281822204589844GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 47a30844-242f-4a7f-ad9f-232a6e76b4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2fed360b-584a-4e1a-8e27-9189de7f5007 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 710afd4b-9962-4ba4-b4ca-92c5d86a37d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance dcecd43c-0d21-4413-8fa5-02856f450b6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClpkSbOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:19:07 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:19:07 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:19:07 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99675c1-0b97-46ea-acdd-a372385caadb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:19:07 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4684d19e-73aa-4237-b240-882e95c8f49a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5] added
Oct 20 10:19:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[801905a8-021f-4b41-9a96-7552e1b7f0ba]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[85370e9f-f80d-4626-a9ab-1886ebadd7a2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ClpkSbOH {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ClpkSbOH" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4c604f-b508-41d4-bd78-be4e526f4932]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ClpkSbOH'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8767dee7-2d39-46ff-a4dd-610ba187b91e]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0106cb2-bef7-4211-865f-686fb510fc2b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:19:07 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:19:07 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:19:07 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:19:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:19:07 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:19:07 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:19:07 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:19:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c960a919-c898-452f-9148-f003e4f83757]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5, portal: 172.16.0.220,3260]
Oct 20 10:19:07 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5, portal: 172.16.0.220,3260] successful.
Oct 20 10:19:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c91ff82-4964-4c3e-9b00-b4665e31b9a3]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c87350-286f-4819-bc76-328f5a1baa17]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:19:07 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:19:07 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:19:07 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:19:07 user nova-compute[74311]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 (non-flash)
Oct 20 10:19:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:19:07 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:19:07 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:19:07 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:19:07 user nova-compute[74311]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 (non-flash)
Oct 20 10:19:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff8fdaa-9387-4370-b2f7-a160a2d6aef2]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:19:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClpkSbOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:19:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:19:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26662326266646565', 'path': '/dev/sde'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:19:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662326266646565', 'path': '/dev/sde'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG nova.objects.instance [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lazy-loading 'flavor' on Instance uuid 710afd4b-9962-4ba4-b4ca-92c5d86a37d3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:19:09 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:19:09 user nova-compute[74311]:   <source dev="/dev/sde"/>
Oct 20 10:19:09 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:19:09 user nova-compute[74311]:   <serial>14b26dd8-586e-4589-bdb5-c9419601e8a5</serial>
Oct 20 10:19:09 user nova-compute[74311]: </disk>
Oct 20 10:19:09 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-cc37776f-2927-4ae6-bbce-37cf77cbb4d2 req-356a17e8-6558-4a33-8e4c-7af8bbd15919 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-changed-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-cc37776f-2927-4ae6-bbce-37cf77cbb4d2 req-356a17e8-6558-4a33-8e4c-7af8bbd15919 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Refreshing instance network info cache due to event network-changed-75daa4b7-a58b-4b60-afe8-97f535c09013. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cc37776f-2927-4ae6-bbce-37cf77cbb4d2 req-356a17e8-6558-4a33-8e4c-7af8bbd15919 service nova] Acquiring lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cc37776f-2927-4ae6-bbce-37cf77cbb4d2 req-356a17e8-6558-4a33-8e4c-7af8bbd15919 service nova] Acquired lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG nova.network.neutron [req-cc37776f-2927-4ae6-bbce-37cf77cbb4d2 req-356a17e8-6558-4a33-8e4c-7af8bbd15919 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Refreshing network info cache for port 75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] No VIF found with MAC fa:16:3e:f7:18:4e, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fbffbcb1-c384-49cb-a53b-058d82979322 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.236s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG nova.network.neutron [req-cc37776f-2927-4ae6-bbce-37cf77cbb4d2 req-356a17e8-6558-4a33-8e4c-7af8bbd15919 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updated VIF entry in instance network info cache for port 75daa4b7-a58b-4b60-afe8-97f535c09013. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG nova.network.neutron [req-cc37776f-2927-4ae6-bbce-37cf77cbb4d2 req-356a17e8-6558-4a33-8e4c-7af8bbd15919 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updating instance_info_cache with network_info: [{"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cc37776f-2927-4ae6-bbce-37cf77cbb4d2 req-356a17e8-6558-4a33-8e4c-7af8bbd15919 service nova] Releasing lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:09 user nova-compute[74311]: INFO nova.compute.manager [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Shelve offloading
Oct 20 10:19:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquiring lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquiring lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:10 user nova-compute[74311]: INFO nova.compute.manager [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Terminating instance
Oct 20 10:19:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-286dfdfb-8bb6-411c-8caf-06d89f4cec74 req-cd70f66d-6328-430a-bbdd-ec425691607e service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-vif-unplugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-286dfdfb-8bb6-411c-8caf-06d89f4cec74 req-cd70f66d-6328-430a-bbdd-ec425691607e service nova] Acquiring lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-286dfdfb-8bb6-411c-8caf-06d89f4cec74 req-cd70f66d-6328-430a-bbdd-ec425691607e service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-286dfdfb-8bb6-411c-8caf-06d89f4cec74 req-cd70f66d-6328-430a-bbdd-ec425691607e service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-286dfdfb-8bb6-411c-8caf-06d89f4cec74 req-cd70f66d-6328-430a-bbdd-ec425691607e service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] No waiting events found dispatching network-vif-unplugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:10 user nova-compute[74311]: WARNING nova.compute.manager [req-286dfdfb-8bb6-411c-8caf-06d89f4cec74 req-cd70f66d-6328-430a-bbdd-ec425691607e service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received unexpected event network-vif-unplugged-75daa4b7-a58b-4b60-afe8-97f535c09013 for instance with vm_state active and task_state shelving.
Oct 20 10:19:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:19:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:11 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Instance destroyed successfully.
Oct 20 10:19:11 user nova-compute[74311]: DEBUG nova.compute.manager [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquired lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG nova.network.neutron [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:19:11 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Instance destroyed successfully.
Oct 20 10:19:11 user nova-compute[74311]: DEBUG nova.objects.instance [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lazy-loading 'resources' on Instance uuid 710afd4b-9962-4ba4-b4ca-92c5d86a37d3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:16:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1445055521',display_name='tempest-DeleteServersTestJSON-server-1445055521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1445055521',id=16,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:16:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20f2ab9ee4d04ea18abdf86db56293ed',ramdisk_id='',reservation_id='r-wnmnyx8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-72673855',owner_user_name='tempest-DeleteServersTestJSON-72673855-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:16:59Z,user_data=None,user_id='3f7ebf77d5d2460482d0d7c26ac709e0',uuid=710afd4b-9962-4ba4-b4ca-92c5d86a37d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "address": "fa:16:3e:f7:18:4e", "network": {"id": "2e0f174c-0d25-4e75-b715-2236fbcd5643", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1888182482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20f2ab9ee4d04ea18abdf86db56293ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc858ad-91", "ovs_interfaceid": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Converting VIF {"id": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "address": "fa:16:3e:f7:18:4e", "network": {"id": "2e0f174c-0d25-4e75-b715-2236fbcd5643", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1888182482-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20f2ab9ee4d04ea18abdf86db56293ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dc858ad-91", "ovs_interfaceid": "0dc858ad-91da-4d3e-b2bc-91dca6b1687d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:18:4e,bridge_name='br-int',has_traffic_filtering=True,id=0dc858ad-91da-4d3e-b2bc-91dca6b1687d,network=Network(2e0f174c-0d25-4e75-b715-2236fbcd5643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dc858ad-91') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_vif [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:18:4e,bridge_name='br-int',has_traffic_filtering=True,id=0dc858ad-91da-4d3e-b2bc-91dca6b1687d,network=Network(2e0f174c-0d25-4e75-b715-2236fbcd5643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dc858ad-91') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dc858ad-91, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9caf1b32-d3de-4f96-a3e1-bd3e9b8d2ce2) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:11 user nova-compute[74311]: INFO os_vif [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:18:4e,bridge_name='br-int',has_traffic_filtering=True,id=0dc858ad-91da-4d3e-b2bc-91dca6b1687d,network=Network(2e0f174c-0d25-4e75-b715-2236fbcd5643),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dc858ad-91')
Oct 20 10:19:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClpkSbOH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:19:11 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae160a56-5cbf-4cb8-8d24-797f2f44a5a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:19:11 user nova-compute[74311]: No targets found.
Oct 20 10:19:11 user nova-compute[74311]: iSNS:
Oct 20 10:19:11 user nova-compute[74311]: No targets found.
Oct 20 10:19:11 user nova-compute[74311]: STATIC:
Oct 20 10:19:11 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:19:11 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:19:11 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:19:11 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f
Oct 20 10:19:11 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:19:11 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:19:11 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5
Oct 20 10:19:11 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:19:11 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:19:11 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138
Oct 20 10:19:11 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:19:11 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:19:11 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5
Oct 20 10:19:11 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:19:11 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:19:11 user nova-compute[74311]: FIRMWARE:
Oct 20 10:19:11 user nova-compute[74311]: No targets found.
Oct 20 10:19:11 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:19:11 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:19:11 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a011d01-cbe8-4cc9-b521-fc01019f48db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a0b0cb-6452-4276-978a-3f19ac9574c9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:19:11 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:19:11 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:19:11 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:19:11 user nova-compute[74311]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 (non-flash)
Oct 20 10:19:11 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:19:11 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:19:11 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:19:11 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:19:11 user nova-compute[74311]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 (non-flash)
Oct 20 10:19:11 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1a827db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5'): ({'sde'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Removing single pathed devices sde {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a4f5a4-67b9-4203-892b-c005b89477ad]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce2ea50-f69c-430c-af23-04e7c412594f]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Flushing IO for device /dev/sde {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[091eb95b-e7ce-4f59-9732-7fa83f454b27]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd895382-2cc1-4b2d-9541-123a55524e8b]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] SCSI volumes sde have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a442967f-f46c-42a3-9cc3-2e778d6075e4]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[245c9a96-2901-47d3-8722-dc99f41809e6]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5, portal: 172.16.0.220,3260]
Oct 20 10:19:11 user nova-compute[74311]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5, portal: 172.16.0.220,3260] successful.
Oct 20 10:19:11 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b26dd8-586e-4589-bdb5-c9419601e8a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[385bfe21-1da6-4dbc-b604-254841b4de77]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.560s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] <== disconnect_volume: return (562ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:19:11 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Deleting instance files /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3_del
Oct 20 10:19:11 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Deletion of /opt/stack/data/nova/instances/710afd4b-9962-4ba4-b4ca-92c5d86a37d3_del complete
Oct 20 10:19:11 user nova-compute[74311]: DEBUG nova.network.neutron [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updating instance_info_cache with network_info: [{"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:19:11 user nova-compute[74311]: INFO nova.compute.manager [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Took 1.66 seconds to destroy the instance on the hypervisor.
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Releasing lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] Acquiring lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] No waiting events found dispatching network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:12 user nova-compute[74311]: WARNING nova.compute.manager [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received unexpected event network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 for instance with vm_state active and task_state shelving.
Oct 20 10:19:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Received event network-vif-unplugged-0dc858ad-91da-4d3e-b2bc-91dca6b1687d {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] Acquiring lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] No waiting events found dispatching network-vif-unplugged-0dc858ad-91da-4d3e-b2bc-91dca6b1687d {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Received event network-vif-unplugged-0dc858ad-91da-4d3e-b2bc-91dca6b1687d for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Received event network-vif-plugged-0dc858ad-91da-4d3e-b2bc-91dca6b1687d {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] Acquiring lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] No waiting events found dispatching network-vif-plugged-0dc858ad-91da-4d3e-b2bc-91dca6b1687d {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:12 user nova-compute[74311]: WARNING nova.compute.manager [req-07479616-10ae-4460-9b76-0c0222e02487 req-0307702d-bad3-46a9-a079-1c56d6180034 service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Received unexpected event network-vif-plugged-0dc858ad-91da-4d3e-b2bc-91dca6b1687d for instance with vm_state active and task_state deleting.
Oct 20 10:19:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:12 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:19:12 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Took 1.18 seconds to deallocate network for instance.
Oct 20 10:19:13 user nova-compute[74311]: DEBUG nova.compute.manager [req-56c357b8-d9ca-4922-ace5-385295db5ebb req-baf31ff5-c87a-49fb-a22a-e4ef100cf3cd service nova] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Received event network-vif-deleted-0dc858ad-91da-4d3e-b2bc-91dca6b1687d {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:13 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Instance destroyed successfully.
Oct 20 10:19:13 user nova-compute[74311]: DEBUG nova.objects.instance [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lazy-loading 'resources' on Instance uuid dcecd43c-0d21-4413-8fa5-02856f450b6a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1629854730',display_name='tempest-TestShelveInstance-server-1629854730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1629854730',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2UxbbXgt1Yjqj2Jy+4hK+bHV+8XArE1GdXdX6r3BeFQkm5c7q7uB2eCMejr9+vfpzUQXSvTiWFoqEOQyEZWoIyoI17DF/JmFIRD9vSrs/u5ApnK+LyZ3AJ/6PG25kn0w==',key_name='tempest-TestShelveInstance-252767667',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dd35c1e7d774f1db10dce2f42915a80',ramdisk_id='',reservation_id='r-norxghh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1328079289',owner_user_name='tempest-TestShelveInstance-1328079289-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:17:48Z,user_data=None,user_id='7d74f45f32004531a84f76f16254d459',uuid=dcecd43c-0d21-4413-8fa5-02856f450b6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Converting VIF {"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=75daa4b7-a58b-4b60-afe8-97f535c09013,network=Network(b5d1e6f9-d369-41f2-a536-07de25499fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75daa4b7-a5') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_vif [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=75daa4b7-a58b-4b60-afe8-97f535c09013,network=Network(b5d1e6f9-d369-41f2-a536-07de25499fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75daa4b7-a5') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75daa4b7-a5, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77e82702-3b01-466c-879e-3398b8a2aef9) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:19:13 user nova-compute[74311]: INFO os_vif [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=75daa4b7-a58b-4b60-afe8-97f535c09013,network=Network(b5d1e6f9-d369-41f2-a536-07de25499fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75daa4b7-a5')
Oct 20 10:19:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGCHmwir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:19:13 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[814e3c48-3cc5-4e20-8291-592294637c78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:19:13 user nova-compute[74311]: No targets found.
Oct 20 10:19:13 user nova-compute[74311]: iSNS:
Oct 20 10:19:13 user nova-compute[74311]: No targets found.
Oct 20 10:19:13 user nova-compute[74311]: STATIC:
Oct 20 10:19:13 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:19:13 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:19:13 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:19:13 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f
Oct 20 10:19:13 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:19:13 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:19:13 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5
Oct 20 10:19:13 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:19:13 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:19:13 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138
Oct 20 10:19:13 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:19:13 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:19:13 user nova-compute[74311]: FIRMWARE:
Oct 20 10:19:13 user nova-compute[74311]: No targets found.
Oct 20 10:19:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:19:13 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:19:13 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b0be56-a4a8-464d-9fcf-4c18c7153438]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd2ab6e-1554-4849-8053-50de47752407]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:19:13 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:19:13 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:19:13 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:19:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:19:13 user nova-compute[74311]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:19:13 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:19:13 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:19:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164de69e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aa2442-8f05-49c1-a57e-5d83db16a689]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d4a4b1-17ee-4b11-b078-106ebffbeeb9]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56c71a3-6c7f-4799-a7d3-6315e88aaa9c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1806033c-cd5f-477b-8f1c-6f2599d433db]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6430ae63-818c-488e-84d8-6ad5524feb7b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fb483d-9eef-48d8-ae9a-97d3bb6cef6a]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260]
Oct 20 10:19:13 user nova-compute[74311]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260] successful.
Oct 20 10:19:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6c44bc-daeb-4d58-a387-a29ac7d020ba]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] <== disconnect_volume: return (315ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:19:13 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Deleting instance files /opt/stack/data/nova/instances/dcecd43c-0d21-4413-8fa5-02856f450b6a_del
Oct 20 10:19:13 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Deletion of /opt/stack/data/nova/instances/dcecd43c-0d21-4413-8fa5-02856f450b6a_del complete
Oct 20 10:19:13 user nova-compute[74311]: INFO nova.compute.manager [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] [instance: 710afd4b-9962-4ba4-b4ca-92c5d86a37d3] Took 0.84 seconds to detach 1 volumes for instance.
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:14 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:19:14 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:19:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:14 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Deleted allocations for instance 710afd4b-9962-4ba4-b4ca-92c5d86a37d3
Oct 20 10:19:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51e1e787-c47c-464d-bd43-9c1810502193 tempest-DeleteServersTestJSON-72673855 tempest-DeleteServersTestJSON-72673855-project-member] Lock "710afd4b-9962-4ba4-b4ca-92c5d86a37d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.261s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:14 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Deleted allocations for instance dcecd43c-0d21-4413-8fa5-02856f450b6a
Oct 20 10:19:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:14 user nova-compute[74311]: DEBUG nova.objects.instance [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lazy-loading 'numa_topology' on Instance uuid dcecd43c-0d21-4413-8fa5-02856f450b6a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:14 user nova-compute[74311]: DEBUG nova.objects.base [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Object Instance<dcecd43c-0d21-4413-8fa5-02856f450b6a> lazy-loaded attributes: resources,numa_topology {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:19:15 user nova-compute[74311]: DEBUG nova.compute.manager [req-b20e6102-e716-4ed9-9ba0-e3cc9decb70c req-212b2a35-2ace-4c11-ad28-daaba9e3c0a4 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-changed-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:15 user nova-compute[74311]: DEBUG nova.compute.manager [req-b20e6102-e716-4ed9-9ba0-e3cc9decb70c req-212b2a35-2ace-4c11-ad28-daaba9e3c0a4 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Refreshing instance network info cache due to event network-changed-75daa4b7-a58b-4b60-afe8-97f535c09013. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:19:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b20e6102-e716-4ed9-9ba0-e3cc9decb70c req-212b2a35-2ace-4c11-ad28-daaba9e3c0a4 service nova] Acquiring lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:19:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b20e6102-e716-4ed9-9ba0-e3cc9decb70c req-212b2a35-2ace-4c11-ad28-daaba9e3c0a4 service nova] Acquired lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:19:15 user nova-compute[74311]: DEBUG nova.network.neutron [req-b20e6102-e716-4ed9-9ba0-e3cc9decb70c req-212b2a35-2ace-4c11-ad28-daaba9e3c0a4 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Refreshing network info cache for port 75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:19:15 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:19:15 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:19:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-1ce8837a-a093-4cef-b659-96467b9c3e9c tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.286s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:15 user nova-compute[74311]: DEBUG nova.network.neutron [req-b20e6102-e716-4ed9-9ba0-e3cc9decb70c req-212b2a35-2ace-4c11-ad28-daaba9e3c0a4 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updated VIF entry in instance network info cache for port 75daa4b7-a58b-4b60-afe8-97f535c09013. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:19:15 user nova-compute[74311]: DEBUG nova.network.neutron [req-b20e6102-e716-4ed9-9ba0-e3cc9decb70c req-212b2a35-2ace-4c11-ad28-daaba9e3c0a4 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updating instance_info_cache with network_info: [{"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": null, "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:19:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b20e6102-e716-4ed9-9ba0-e3cc9decb70c req-212b2a35-2ace-4c11-ad28-daaba9e3c0a4 service nova] Releasing lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:19:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:19:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-d0c1dfda-32cc-4add-a04e-2eba25fe74bf req-cf81060e-7c38-4893-9ae3-233438f10b19 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-changed-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-d0c1dfda-32cc-4add-a04e-2eba25fe74bf req-cf81060e-7c38-4893-9ae3-233438f10b19 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Refreshing instance network info cache due to event network-changed-98eb8ce2-6b43-43ac-99f6-e908d0688d20. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:19:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d0c1dfda-32cc-4add-a04e-2eba25fe74bf req-cf81060e-7c38-4893-9ae3-233438f10b19 service nova] Acquiring lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:19:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d0c1dfda-32cc-4add-a04e-2eba25fe74bf req-cf81060e-7c38-4893-9ae3-233438f10b19 service nova] Acquired lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:19:26 user nova-compute[74311]: DEBUG nova.network.neutron [req-d0c1dfda-32cc-4add-a04e-2eba25fe74bf req-cf81060e-7c38-4893-9ae3-233438f10b19 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Refreshing network info cache for port 98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:19:27 user nova-compute[74311]: DEBUG nova.network.neutron [req-d0c1dfda-32cc-4add-a04e-2eba25fe74bf req-cf81060e-7c38-4893-9ae3-233438f10b19 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Updated VIF entry in instance network info cache for port 98eb8ce2-6b43-43ac-99f6-e908d0688d20. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:19:27 user nova-compute[74311]: DEBUG nova.network.neutron [req-d0c1dfda-32cc-4add-a04e-2eba25fe74bf req-cf81060e-7c38-4893-9ae3-233438f10b19 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Updating instance_info_cache with network_info: [{"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:19:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d0c1dfda-32cc-4add-a04e-2eba25fe74bf req-cf81060e-7c38-4893-9ae3-233438f10b19 service nova] Releasing lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:19:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:29 user nova-compute[74311]: INFO nova.compute.manager [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Rescuing
Oct 20 10:19:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:19:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquired lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:19:29 user nova-compute[74311]: DEBUG nova.network.neutron [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG nova.network.neutron [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Updating instance_info_cache with network_info: [{"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Releasing lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-5652480b-8c7a-4094-8f85-19484ef49bb8 req-0df5cd5a-18bd-452e-ab3e-024851deb346 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received event network-vif-unplugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5652480b-8c7a-4094-8f85-19484ef49bb8 req-0df5cd5a-18bd-452e-ab3e-024851deb346 service nova] Acquiring lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5652480b-8c7a-4094-8f85-19484ef49bb8 req-0df5cd5a-18bd-452e-ab3e-024851deb346 service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5652480b-8c7a-4094-8f85-19484ef49bb8 req-0df5cd5a-18bd-452e-ab3e-024851deb346 service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-5652480b-8c7a-4094-8f85-19484ef49bb8 req-0df5cd5a-18bd-452e-ab3e-024851deb346 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] No waiting events found dispatching network-vif-unplugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:30 user nova-compute[74311]: WARNING nova.compute.manager [req-5652480b-8c7a-4094-8f85-19484ef49bb8 req-0df5cd5a-18bd-452e-ab3e-024851deb346 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received unexpected event network-vif-unplugged-395a6652-12b5-404b-81e4-2beb52c164ca for instance with vm_state active and task_state rescuing.
Oct 20 10:19:30 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Instance destroyed successfully.
Oct 20 10:19:30 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Attempting rescue
Oct 20 10:19:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74311) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Instance directory exists: not creating {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 10:19:30 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Creating image(s)
Oct 20 10:19:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "/opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "/opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "/opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG nova.objects.instance [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'trusted_certs' on Instance uuid 60618091-1d8e-477c-8ea8-63973626a7e2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.185s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue" returned: 0 in 0.050s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.objects.instance [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'migration_context' on Instance uuid 60618091-1d8e-477c-8ea8-63973626a7e2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.objects.base [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<60618091-1d8e-477c-8ea8-63973626a7e2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Start _get_guest_xml network_info=[{"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "vif_mac": "fa:16:3e:3f:dc:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.objects.instance [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'resources' on Instance uuid 60618091-1d8e-477c-8ea8-63973626a7e2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.objects.base [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<60618091-1d8e-477c-8ea8-63973626a7e2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.objects.instance [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'numa_topology' on Instance uuid 60618091-1d8e-477c-8ea8-63973626a7e2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.objects.base [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<60618091-1d8e-477c-8ea8-63973626a7e2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:19:31 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:19:31 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.objects.instance [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'vcpu_model' on Instance uuid 60618091-1d8e-477c-8ea8-63973626a7e2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.objects.base [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<60618091-1d8e-477c-8ea8-63973626a7e2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-920633096',display_name='tempest-ServerRescueNegativeTestJSON-server-920633096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-920633096',id=20,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07b7c2a684a3466eba4799473c725066',ramdisk_id='',reservation_id='r-2icjmpaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-320006607',owner_user_name='tempest-ServerRescueNegativeTestJSON-320006607-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:17:50Z,user_data=None,user_id='302a265253b14a19be48546953baaebf',uuid=60618091-1d8e-477c-8ea8-63973626a7e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "vif_mac": "fa:16:3e:3f:dc:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converting VIF {"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "vif_mac": "fa:16:3e:3f:dc:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:dc:8a,bridge_name='br-int',has_traffic_filtering=True,id=395a6652-12b5-404b-81e4-2beb52c164ca,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395a6652-12') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.objects.instance [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'pci_devices' on Instance uuid 60618091-1d8e-477c-8ea8-63973626a7e2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.objects.base [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<60618091-1d8e-477c-8ea8-63973626a7e2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:19:31 user nova-compute[74311]:   <uuid>60618091-1d8e-477c-8ea8-63973626a7e2</uuid>
Oct 20 10:19:31 user nova-compute[74311]:   <name>instance-00000014</name>
Oct 20 10:19:31 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:19:31 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:19:31 user nova-compute[74311]:   <metadata>
Oct 20 10:19:31 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:19:31 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:19:31 user nova-compute[74311]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-920633096</nova:name>
Oct 20 10:19:31 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:19:31</nova:creationTime>
Oct 20 10:19:31 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:19:31 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:19:31 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:19:31 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:19:31 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:19:31 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:19:31 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:19:31 user nova-compute[74311]:       <nova:owner>
Oct 20 10:19:31 user nova-compute[74311]:         <nova:user uuid="302a265253b14a19be48546953baaebf">tempest-ServerRescueNegativeTestJSON-320006607-project-member</nova:user>
Oct 20 10:19:31 user nova-compute[74311]:         <nova:project uuid="07b7c2a684a3466eba4799473c725066">tempest-ServerRescueNegativeTestJSON-320006607</nova:project>
Oct 20 10:19:31 user nova-compute[74311]:       </nova:owner>
Oct 20 10:19:31 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:19:31 user nova-compute[74311]:       <nova:ports>
Oct 20 10:19:31 user nova-compute[74311]:         <nova:port uuid="395a6652-12b5-404b-81e4-2beb52c164ca">
Oct 20 10:19:31 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 10:19:31 user nova-compute[74311]:         </nova:port>
Oct 20 10:19:31 user nova-compute[74311]:       </nova:ports>
Oct 20 10:19:31 user nova-compute[74311]:     </nova:instance>
Oct 20 10:19:31 user nova-compute[74311]:   </metadata>
Oct 20 10:19:31 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:19:31 user nova-compute[74311]:     <system>
Oct 20 10:19:31 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:19:31 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:19:31 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:19:31 user nova-compute[74311]:       <entry name="serial">60618091-1d8e-477c-8ea8-63973626a7e2</entry>
Oct 20 10:19:31 user nova-compute[74311]:       <entry name="uuid">60618091-1d8e-477c-8ea8-63973626a7e2</entry>
Oct 20 10:19:31 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:19:31 user nova-compute[74311]:     </system>
Oct 20 10:19:31 user nova-compute[74311]:   </sysinfo>
Oct 20 10:19:31 user nova-compute[74311]:   <os>
Oct 20 10:19:31 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:19:31 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:19:31 user nova-compute[74311]:   </os>
Oct 20 10:19:31 user nova-compute[74311]:   <features>
Oct 20 10:19:31 user nova-compute[74311]:     <acpi/>
Oct 20 10:19:31 user nova-compute[74311]:     <apic/>
Oct 20 10:19:31 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:19:31 user nova-compute[74311]:   </features>
Oct 20 10:19:31 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:19:31 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:19:31 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:19:31 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:19:31 user nova-compute[74311]:   </clock>
Oct 20 10:19:31 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:19:31 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:19:31 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:19:31 user nova-compute[74311]:   </cpu>
Oct 20 10:19:31 user nova-compute[74311]:   <devices>
Oct 20 10:19:31 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:19:31 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:19:31 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue"/>
Oct 20 10:19:31 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:19:31 user nova-compute[74311]:     </disk>
Oct 20 10:19:31 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:19:31 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:19:31 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk"/>
Oct 20 10:19:31 user nova-compute[74311]:       <target dev="vdb" bus="virtio"/>
Oct 20 10:19:31 user nova-compute[74311]:     </disk>
Oct 20 10:19:31 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:19:31 user nova-compute[74311]:       <mac address="fa:16:3e:3f:dc:8a"/>
Oct 20 10:19:31 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:19:31 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:19:31 user nova-compute[74311]:       <target dev="tap395a6652-12"/>
Oct 20 10:19:31 user nova-compute[74311]:     </interface>
Oct 20 10:19:31 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:19:31 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/console.log" append="off"/>
Oct 20 10:19:31 user nova-compute[74311]:     </serial>
Oct 20 10:19:31 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:19:31 user nova-compute[74311]:     <video>
Oct 20 10:19:31 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:19:31 user nova-compute[74311]:     </video>
Oct 20 10:19:31 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:19:31 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:19:31 user nova-compute[74311]:     </rng>
Oct 20 10:19:31 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:19:31 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:19:31 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:19:31 user nova-compute[74311]:     </memballoon>
Oct 20 10:19:31 user nova-compute[74311]:   </devices>
Oct 20 10:19:31 user nova-compute[74311]: </domain>
Oct 20 10:19:31 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:19:31 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Instance destroyed successfully.
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:19:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No VIF found with MAC fa:16:3e:3f:dc:8a, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-7d2ad496-317d-45f5-80b7-4bb0de2efb14 req-55395ef0-f3e8-408e-ab98-3698f38da0b2 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received event network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7d2ad496-317d-45f5-80b7-4bb0de2efb14 req-55395ef0-f3e8-408e-ab98-3698f38da0b2 service nova] Acquiring lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7d2ad496-317d-45f5-80b7-4bb0de2efb14 req-55395ef0-f3e8-408e-ab98-3698f38da0b2 service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7d2ad496-317d-45f5-80b7-4bb0de2efb14 req-55395ef0-f3e8-408e-ab98-3698f38da0b2 service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-7d2ad496-317d-45f5-80b7-4bb0de2efb14 req-55395ef0-f3e8-408e-ab98-3698f38da0b2 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] No waiting events found dispatching network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:32 user nova-compute[74311]: WARNING nova.compute.manager [req-7d2ad496-317d-45f5-80b7-4bb0de2efb14 req-55395ef0-f3e8-408e-ab98-3698f38da0b2 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received unexpected event network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca for instance with vm_state active and task_state rescuing.
Oct 20 10:19:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG nova.objects.instance [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'flavor' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:33 user nova-compute[74311]: INFO nova.compute.manager [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Attaching volume 45d09622-5546-491c-9b1d-25e121614b1b to /dev/vdb
Oct 20 10:19:33 user nova-compute[74311]: DEBUG os_brick.utils [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[45604d0a-2719-4544-8195-9d20004a5a63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f3408d-3270-4a84-aa8e-5c0f71f46f6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8100540a-4f90-4f66-8a69-c4037d45439b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3fb219-e276-461d-9afc-59bf452d9cf6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:19:33 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:19:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb7c0ec-19af-4d75-bd22-a7691290fb57]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG os_brick.utils [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:19:33 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Updating existing volume attachment record: 85c347c8-5928-4a43-8409-2c095962afc3 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:19:34 user nova-compute[74311]: INFO nova.compute.manager [None req-bf68a1b5-f2d4-4e2d-84b1-6b9cf4d0d091 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Unrescuing
Oct 20 10:19:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-bf68a1b5-f2d4-4e2d-84b1-6b9cf4d0d091 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:19:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-bf68a1b5-f2d4-4e2d-84b1-6b9cf4d0d091 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquired lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:19:34 user nova-compute[74311]: DEBUG nova.network.neutron [None req-bf68a1b5-f2d4-4e2d-84b1-6b9cf4d0d091 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:19:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-592add5f-93df-4e27-bb59-4028c4958364 req-a12bf2b9-3961-4285-bb41-fdbd0c7a2a2f service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received event network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-592add5f-93df-4e27-bb59-4028c4958364 req-a12bf2b9-3961-4285-bb41-fdbd0c7a2a2f service nova] Acquiring lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-592add5f-93df-4e27-bb59-4028c4958364 req-a12bf2b9-3961-4285-bb41-fdbd0c7a2a2f service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-592add5f-93df-4e27-bb59-4028c4958364 req-a12bf2b9-3961-4285-bb41-fdbd0c7a2a2f service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-592add5f-93df-4e27-bb59-4028c4958364 req-a12bf2b9-3961-4285-bb41-fdbd0c7a2a2f service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] No waiting events found dispatching network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:34 user nova-compute[74311]: WARNING nova.compute.manager [req-592add5f-93df-4e27-bb59-4028c4958364 req-a12bf2b9-3961-4285-bb41-fdbd0c7a2a2f service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received unexpected event network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca for instance with vm_state active and task_state rescuing.
Oct 20 10:19:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-592add5f-93df-4e27-bb59-4028c4958364 req-a12bf2b9-3961-4285-bb41-fdbd0c7a2a2f service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received event network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-592add5f-93df-4e27-bb59-4028c4958364 req-a12bf2b9-3961-4285-bb41-fdbd0c7a2a2f service nova] Acquiring lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-592add5f-93df-4e27-bb59-4028c4958364 req-a12bf2b9-3961-4285-bb41-fdbd0c7a2a2f service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-592add5f-93df-4e27-bb59-4028c4958364 req-a12bf2b9-3961-4285-bb41-fdbd0c7a2a2f service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-592add5f-93df-4e27-bb59-4028c4958364 req-a12bf2b9-3961-4285-bb41-fdbd0c7a2a2f service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] No waiting events found dispatching network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:34 user nova-compute[74311]: WARNING nova.compute.manager [req-592add5f-93df-4e27-bb59-4028c4958364 req-a12bf2b9-3961-4285-bb41-fdbd0c7a2a2f service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received unexpected event network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca for instance with vm_state active and task_state rescuing.
Oct 20 10:19:34 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f49dd7a0-86a0-400d-a832-ce35f2fc11e1 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:19:35 user nova-compute[74311]: DEBUG nova.network.neutron [None req-bf68a1b5-f2d4-4e2d-84b1-6b9cf4d0d091 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Updating instance_info_cache with network_info: [{"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:19:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-bf68a1b5-f2d4-4e2d-84b1-6b9cf4d0d091 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Releasing lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:19:35 user nova-compute[74311]: DEBUG nova.objects.instance [None req-bf68a1b5-f2d4-4e2d-84b1-6b9cf4d0d091 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'flavor' on Instance uuid cfc97865-6f94-4924-afc5-188d50543672 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-88139492-4f75-413e-a079-cd4f2228b0d6 req-1e16c636-6d44-40c5-8187-59922be5580e service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-vif-unplugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-88139492-4f75-413e-a079-cd4f2228b0d6 req-1e16c636-6d44-40c5-8187-59922be5580e service nova] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-88139492-4f75-413e-a079-cd4f2228b0d6 req-1e16c636-6d44-40c5-8187-59922be5580e service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-88139492-4f75-413e-a079-cd4f2228b0d6 req-1e16c636-6d44-40c5-8187-59922be5580e service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-88139492-4f75-413e-a079-cd4f2228b0d6 req-1e16c636-6d44-40c5-8187-59922be5580e service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] No waiting events found dispatching network-vif-unplugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:35 user nova-compute[74311]: WARNING nova.compute.manager [req-88139492-4f75-413e-a079-cd4f2228b0d6 req-1e16c636-6d44-40c5-8187-59922be5580e service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received unexpected event network-vif-unplugged-2e1b0047-2f93-4f83-a6e7-514659a2faae for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:19:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:36 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: cfc97865-6f94-4924-afc5-188d50543672] Instance destroyed successfully.
Oct 20 10:19:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-34cdfcff-2984-4f08-880f-03539e26a006 req-f42273bf-ebef-4fd2-9625-69125d2da1d9 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-34cdfcff-2984-4f08-880f-03539e26a006 req-f42273bf-ebef-4fd2-9625-69125d2da1d9 service nova] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-34cdfcff-2984-4f08-880f-03539e26a006 req-f42273bf-ebef-4fd2-9625-69125d2da1d9 service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-34cdfcff-2984-4f08-880f-03539e26a006 req-f42273bf-ebef-4fd2-9625-69125d2da1d9 service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-34cdfcff-2984-4f08-880f-03539e26a006 req-f42273bf-ebef-4fd2-9625-69125d2da1d9 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] No waiting events found dispatching network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:37 user nova-compute[74311]: WARNING nova.compute.manager [req-34cdfcff-2984-4f08-880f-03539e26a006 req-f42273bf-ebef-4fd2-9625-69125d2da1d9 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received unexpected event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:19:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-9f2dd598-03b4-4d47-a500-8c7e5730938d req-0ab84e8d-cbc0-424c-b56d-8404068e90fd service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9f2dd598-03b4-4d47-a500-8c7e5730938d req-0ab84e8d-cbc0-424c-b56d-8404068e90fd service nova] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9f2dd598-03b4-4d47-a500-8c7e5730938d req-0ab84e8d-cbc0-424c-b56d-8404068e90fd service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9f2dd598-03b4-4d47-a500-8c7e5730938d req-0ab84e8d-cbc0-424c-b56d-8404068e90fd service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-9f2dd598-03b4-4d47-a500-8c7e5730938d req-0ab84e8d-cbc0-424c-b56d-8404068e90fd service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] No waiting events found dispatching network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:39 user nova-compute[74311]: WARNING nova.compute.manager [req-9f2dd598-03b4-4d47-a500-8c7e5730938d req-0ab84e8d-cbc0-424c-b56d-8404068e90fd service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received unexpected event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:19:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-9f2dd598-03b4-4d47-a500-8c7e5730938d req-0ab84e8d-cbc0-424c-b56d-8404068e90fd service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9f2dd598-03b4-4d47-a500-8c7e5730938d req-0ab84e8d-cbc0-424c-b56d-8404068e90fd service nova] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9f2dd598-03b4-4d47-a500-8c7e5730938d req-0ab84e8d-cbc0-424c-b56d-8404068e90fd service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9f2dd598-03b4-4d47-a500-8c7e5730938d req-0ab84e8d-cbc0-424c-b56d-8404068e90fd service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-9f2dd598-03b4-4d47-a500-8c7e5730938d req-0ab84e8d-cbc0-424c-b56d-8404068e90fd service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] No waiting events found dispatching network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:39 user nova-compute[74311]: WARNING nova.compute.manager [req-9f2dd598-03b4-4d47-a500-8c7e5730938d req-0ab84e8d-cbc0-424c-b56d-8404068e90fd service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received unexpected event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:19:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-bf68a1b5-f2d4-4e2d-84b1-6b9cf4d0d091 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:19:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfIEDNey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:19:51 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:19:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:19:51 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:19:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:19:51 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb202e3-3260-4802-a47e-c75aefb6db31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:19:51 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a095bb-40dd-495e-bf2b-2bd903ba1a2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b] added
Oct 20 10:19:51 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f54dd0f-7030-4103-b892-e14e83b27881]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afbbb95-ea38-4e6b-8d45-fbdd6fc06cc7]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VfIEDNey {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VfIEDNey" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[109cce71-5b7d-415a-a796-4a59581fa9d8]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VfIEDNey'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb988c56-5e83-47a7-9050-345f8c6adc56]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1be2b9c-1d2a-422c-aa21-03f32a093eeb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:19:52 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:19:52 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:19:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:19:52 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:19:52 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:19:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a422d6-8777-4c05-aa0e-4b2e972be968]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260]
Oct 20 10:19:52 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260] successful.
Oct 20 10:19:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[761a64a7-4e19-4061-81e7-b0cad4629242]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cbacbd-2f3a-490a-bcc9-7fc910e479de]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:19:52 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:19:52 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:19:52 user nova-compute[74311]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:19:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:19:52 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:19:52 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:19:52 user nova-compute[74311]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:19:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2970f9-75f9-4098-bd80-4337f9aee909]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:19:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:53 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:19:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfIEDNey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:19:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:19:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23234623166636430', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:19:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234623166636430', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:19:53 user nova-compute[74311]: DEBUG nova.objects.instance [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'flavor' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:19:53 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:19:53 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:19:53 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:19:53 user nova-compute[74311]:   <serial>45d09622-5546-491c-9b1d-25e121614b1b</serial>
Oct 20 10:19:53 user nova-compute[74311]: </disk>
Oct 20 10:19:53 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:19:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:19:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:19:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] No VIF found with MAC fa:16:3e:6e:64:47, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:19:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-72c7d18f-b7be-4902-ae7b-b70b4709eb09 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.648s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ea6f2ed2-e1d2-4895-ba2c-16ce2d78c837 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ea6f2ed2-e1d2-4895-ba2c-16ce2d78c837 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:54 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ea6f2ed2-e1d2-4895-ba2c-16ce2d78c837 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:19:54 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ea6f2ed2-e1d2-4895-ba2c-16ce2d78c837 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74311) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 20 10:19:54 user nova-compute[74311]: DEBUG nova.objects.instance [None req-ea6f2ed2-e1d2-4895-ba2c-16ce2d78c837 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'flavor' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:19:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:55 user nova-compute[74311]: DEBUG nova.compute.manager [req-6f4cda56-d921-4049-b773-3ed254acd004 req-790f774d-9363-4524-ba53-272d8a46e1b8 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-vif-unplugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6f4cda56-d921-4049-b773-3ed254acd004 req-790f774d-9363-4524-ba53-272d8a46e1b8 service nova] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6f4cda56-d921-4049-b773-3ed254acd004 req-790f774d-9363-4524-ba53-272d8a46e1b8 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6f4cda56-d921-4049-b773-3ed254acd004 req-790f774d-9363-4524-ba53-272d8a46e1b8 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:55 user nova-compute[74311]: DEBUG nova.compute.manager [req-6f4cda56-d921-4049-b773-3ed254acd004 req-790f774d-9363-4524-ba53-272d8a46e1b8 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] No waiting events found dispatching network-vif-unplugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:55 user nova-compute[74311]: WARNING nova.compute.manager [req-6f4cda56-d921-4049-b773-3ed254acd004 req-790f774d-9363-4524-ba53-272d8a46e1b8 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received unexpected event network-vif-unplugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 for instance with vm_state active and task_state powering-off.
Oct 20 10:19:55 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Instance destroyed successfully.
Oct 20 10:19:55 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ea6f2ed2-e1d2-4895-ba2c-16ce2d78c837 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:19:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ea6f2ed2-e1d2-4895-ba2c-16ce2d78c837 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.983s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:57 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:19:57 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:19:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:19:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:19:57 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:19:57 user nova-compute[74311]: DEBUG nova.compute.manager [req-5a66bff1-e59e-4c3b-a0c6-1abd5c8417d9 req-144fac67-9820-4630-92e4-4c3818ab2bef service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:19:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5a66bff1-e59e-4c3b-a0c6-1abd5c8417d9 req-144fac67-9820-4630-92e4-4c3818ab2bef service nova] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:19:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5a66bff1-e59e-4c3b-a0c6-1abd5c8417d9 req-144fac67-9820-4630-92e4-4c3818ab2bef service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:19:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5a66bff1-e59e-4c3b-a0c6-1abd5c8417d9 req-144fac67-9820-4630-92e4-4c3818ab2bef service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:19:57 user nova-compute[74311]: DEBUG nova.compute.manager [req-5a66bff1-e59e-4c3b-a0c6-1abd5c8417d9 req-144fac67-9820-4630-92e4-4c3818ab2bef service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] No waiting events found dispatching network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:19:57 user nova-compute[74311]: WARNING nova.compute.manager [req-5a66bff1-e59e-4c3b-a0c6-1abd5c8417d9 req-144fac67-9820-4630-92e4-4c3818ab2bef service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received unexpected event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 for instance with vm_state stopped and task_state None.
Oct 20 10:19:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:57 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Updating instance_info_cache with network_info: [{"id": "3a618325-862e-4c54-a654-6d3284cb8bf3", "address": "fa:16:3e:e2:bf:e1", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a618325-86", "ovs_interfaceid": "3a618325-862e-4c54-a654-6d3284cb8bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:19:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:19:57 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:19:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:19:59 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:19:59 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:20:00 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:20:00 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:20:01 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:20:02 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:20:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:04 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:20:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:20:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:20:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:20:04 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:20:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:04 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:20:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:20:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:20:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:20:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:08 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:20:08 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:20:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7442MB free_disk=25.303585052490234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 47a30844-242f-4a7f-ad9f-232a6e76b4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2fed360b-584a-4e1a-8e27-9189de7f5007 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:20:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:20:09 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:20:09 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:20:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:20:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:20:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:11 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:20:11 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:20:11 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:20:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-95feceb8-dcba-4753-b2d5-4a9abcf1aaca req-6ce3d10a-cdc5-4321-a476-199bae75fc90 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-changed-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:20:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-95feceb8-dcba-4753-b2d5-4a9abcf1aaca req-6ce3d10a-cdc5-4321-a476-199bae75fc90 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Refreshing instance network info cache due to event network-changed-058da87e-19f4-49ec-9ddd-c9e793db0844. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:20:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-95feceb8-dcba-4753-b2d5-4a9abcf1aaca req-6ce3d10a-cdc5-4321-a476-199bae75fc90 service nova] Acquiring lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:20:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-95feceb8-dcba-4753-b2d5-4a9abcf1aaca req-6ce3d10a-cdc5-4321-a476-199bae75fc90 service nova] Acquired lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:20:22 user nova-compute[74311]: DEBUG nova.network.neutron [req-95feceb8-dcba-4753-b2d5-4a9abcf1aaca req-6ce3d10a-cdc5-4321-a476-199bae75fc90 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Refreshing network info cache for port 058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:20:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:22 user nova-compute[74311]: DEBUG nova.network.neutron [req-95feceb8-dcba-4753-b2d5-4a9abcf1aaca req-6ce3d10a-cdc5-4321-a476-199bae75fc90 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Updated VIF entry in instance network info cache for port 058da87e-19f4-49ec-9ddd-c9e793db0844. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:20:22 user nova-compute[74311]: DEBUG nova.network.neutron [req-95feceb8-dcba-4753-b2d5-4a9abcf1aaca req-6ce3d10a-cdc5-4321-a476-199bae75fc90 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Updating instance_info_cache with network_info: [{"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:20:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-95feceb8-dcba-4753-b2d5-4a9abcf1aaca req-6ce3d10a-cdc5-4321-a476-199bae75fc90 service nova] Releasing lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:20:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:23 user nova-compute[74311]: DEBUG nova.compute.manager [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:20:23 user nova-compute[74311]: INFO nova.compute.manager [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] instance snapshotting
Oct 20 10:20:23 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Beginning live snapshot process
Oct 20 10:20:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json -f qcow2 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json -f qcow2 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.196s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpicslx1my/2e0a8de8af854d31a24bb5da3ece3c67.delta 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpicslx1my/2e0a8de8af854d31a24bb5da3ece3c67.delta 1073741824" returned: 0 in 0.055s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:24 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 10:20:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:20:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:20:25 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 10:20:26 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:20:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpicslx1my/2e0a8de8af854d31a24bb5da3ece3c67.delta /opt/stack/data/nova/instances/snapshots/tmpicslx1my/2e0a8de8af854d31a24bb5da3ece3c67 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpicslx1my/2e0a8de8af854d31a24bb5da3ece3c67.delta /opt/stack/data/nova/instances/snapshots/tmpicslx1my/2e0a8de8af854d31a24bb5da3ece3c67" returned: 0 in 0.700s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:26 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Snapshot extracted, beginning image upload
Oct 20 10:20:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:29 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Snapshot image upload complete
Oct 20 10:20:29 user nova-compute[74311]: INFO nova.compute.manager [None req-77c9a2a4-0e17-4b39-a01c-bb1fba4c0ed4 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Took 5.54 seconds to snapshot the instance on the hypervisor.
Oct 20 10:20:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:20:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:20:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:20:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:20:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:20:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:20:50 user nova-compute[74311]: DEBUG nova.compute.manager [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:20:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:20:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:20:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:20:50 user nova-compute[74311]: INFO nova.compute.claims [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Claim successful on node user
Oct 20 10:20:50 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:20:50 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:20:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:20:50 user nova-compute[74311]: DEBUG nova.compute.manager [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:20:50 user nova-compute[74311]: DEBUG nova.compute.manager [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:20:50 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:20:50 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:20:50 user nova-compute[74311]: DEBUG nova.compute.manager [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:20:50 user nova-compute[74311]: INFO nova.virt.block_device [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Booting with volume 3ad8b3b1-d047-46c9-b41b-6e3372b1eedd at /dev/vda
Oct 20 10:20:50 user nova-compute[74311]: DEBUG nova.policy [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e415285f7ab2498f8102dc4994d1edae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cb23819b2a548eab36b4b8ca922313d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG os_brick.utils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f440b384-d33c-41d0-9dd5-20d5369de7d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e099c3c-1dcc-4c82-9a55-f9168a56ed67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[851407cf-7a33-4cdd-861d-e8322be87369]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[94faa26a-0db9-4847-8f04-604ea5983203]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:20:51 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:20:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cb7245-ebbf-488e-a14f-467c0ed51b8c]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG os_brick.utils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating existing volume attachment record: 077d3368-b975-4e93-8ae1-fc8bffd0a691 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:20:51 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Successfully created port: 43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:20:52 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Successfully created port: c2b7d551-6eab-4972-a0e7-b277b31f284c {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:20:52 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Successfully created port: f80e2f85-5f8c-456b-aa14-3eca6f495a92 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:20:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:53 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Successfully created port: f36f74b7-eb86-45d9-b1c3-edabd62f26c7 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:20:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:53 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Successfully created port: ff91ee0f-4db6-4246-8cfc-f42691975fe3 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:20:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Successfully updated port: 43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:20:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-2c42d690-b3d9-4e07-be49-c08c3b771d7c req-09be0f5b-a6ca-44e8-a471-fc96a817b3ef service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-changed-43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:20:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-2c42d690-b3d9-4e07-be49-c08c3b771d7c req-09be0f5b-a6ca-44e8-a471-fc96a817b3ef service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing instance network info cache due to event network-changed-43f2ca57-55c4-4353-8f52-e05381b6962a. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:20:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2c42d690-b3d9-4e07-be49-c08c3b771d7c req-09be0f5b-a6ca-44e8-a471-fc96a817b3ef service nova] Acquiring lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:20:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2c42d690-b3d9-4e07-be49-c08c3b771d7c req-09be0f5b-a6ca-44e8-a471-fc96a817b3ef service nova] Acquired lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:20:54 user nova-compute[74311]: DEBUG nova.network.neutron [req-2c42d690-b3d9-4e07-be49-c08c3b771d7c req-09be0f5b-a6ca-44e8-a471-fc96a817b3ef service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing network info cache for port 43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:20:54 user nova-compute[74311]: DEBUG nova.network.neutron [req-2c42d690-b3d9-4e07-be49-c08c3b771d7c req-09be0f5b-a6ca-44e8-a471-fc96a817b3ef service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:20:54 user nova-compute[74311]: DEBUG nova.network.neutron [req-2c42d690-b3d9-4e07-be49-c08c3b771d7c req-09be0f5b-a6ca-44e8-a471-fc96a817b3ef service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:20:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2c42d690-b3d9-4e07-be49-c08c3b771d7c req-09be0f5b-a6ca-44e8-a471-fc96a817b3ef service nova] Releasing lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:20:55 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Successfully updated port: 281e2888-41a8-45d3-a5aa-d74493218291 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:20:55 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Successfully updated port: baec8fe4-8243-407a-86fc-2aac48dbf893 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-changed-281e2888-41a8-45d3-a5aa-d74493218291 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing instance network info cache due to event network-changed-281e2888-41a8-45d3-a5aa-d74493218291. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] Acquiring lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] Acquired lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG nova.network.neutron [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing network info cache for port 281e2888-41a8-45d3-a5aa-d74493218291 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG nova.network.neutron [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG nova.network.neutron [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Successfully updated port: c2b7d551-6eab-4972-a0e7-b277b31f284c {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] Releasing lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-changed-baec8fe4-8243-407a-86fc-2aac48dbf893 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing instance network info cache due to event network-changed-baec8fe4-8243-407a-86fc-2aac48dbf893. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] Acquiring lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] Acquired lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG nova.network.neutron [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing network info cache for port baec8fe4-8243-407a-86fc-2aac48dbf893 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:20:56 user nova-compute[74311]: DEBUG nova.network.neutron [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:20:57 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:20:57 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:20:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:20:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:20:57 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:20:57 user nova-compute[74311]: DEBUG nova.network.neutron [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:20:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-93bc99b4-6828-44a6-bb57-4e1645ee5565 req-97df0f4d-bcb7-45d5-bf11-e3552c730821 service nova] Releasing lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:20:57 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating instance_info_cache with network_info: [{"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:20:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-2fed360b-584a-4e1a-8e27-9189de7f5007" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:20:57 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:20:57 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Successfully updated port: f80e2f85-5f8c-456b-aa14-3eca6f495a92 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Successfully updated port: f36f74b7-eb86-45d9-b1c3-edabd62f26c7 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-changed-c2b7d551-6eab-4972-a0e7-b277b31f284c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing instance network info cache due to event network-changed-c2b7d551-6eab-4972-a0e7-b277b31f284c. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] Acquiring lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] Acquired lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG nova.network.neutron [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing network info cache for port c2b7d551-6eab-4972-a0e7-b277b31f284c {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG nova.network.neutron [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG nova.network.neutron [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] Releasing lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-changed-f80e2f85-5f8c-456b-aa14-3eca6f495a92 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing instance network info cache due to event network-changed-f80e2f85-5f8c-456b-aa14-3eca6f495a92. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] Acquiring lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] Acquired lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG nova.network.neutron [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing network info cache for port f80e2f85-5f8c-456b-aa14-3eca6f495a92 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:20:58 user nova-compute[74311]: DEBUG nova.network.neutron [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Successfully updated port: ff91ee0f-4db6-4246-8cfc-f42691975fe3 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG nova.network.neutron [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] Releasing lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-changed-f36f74b7-eb86-45d9-b1c3-edabd62f26c7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing instance network info cache due to event network-changed-f36f74b7-eb86-45d9-b1c3-edabd62f26c7. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] Acquiring lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] Acquired lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG nova.network.neutron [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing network info cache for port f36f74b7-eb86-45d9-b1c3-edabd62f26c7 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG nova.network.neutron [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG nova.network.neutron [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f6d6ffc-3a59-491b-9f2e-19be53fb9b58 req-3f0c4ce3-ce54-4ed2-a55a-998a86264548 service nova] Releasing lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquired lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:20:59 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:21:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-a23e4983-6066-40cb-8840-662dbafa24e3 req-0df2b63b-d987-427d-b111-4241ca192662 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-changed-ff91ee0f-4db6-4246-8cfc-f42691975fe3 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-a23e4983-6066-40cb-8840-662dbafa24e3 req-0df2b63b-d987-427d-b111-4241ca192662 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing instance network info cache due to event network-changed-ff91ee0f-4db6-4246-8cfc-f42691975fe3. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:21:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a23e4983-6066-40cb-8840-662dbafa24e3 req-0df2b63b-d987-427d-b111-4241ca192662 service nova] Acquiring lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:01 user nova-compute[74311]: INFO nova.compute.manager [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Unshelving
Oct 20 10:21:01 user nova-compute[74311]: INFO nova.virt.block_device [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Booting with volume 472b7899-fb18-4cf3-aed5-dd75907cc03f at /dev/vda
Oct 20 10:21:01 user nova-compute[74311]: DEBUG os_brick.utils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fed2c7-8b92-4b0c-9525-25126c639e8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG nova.network.neutron [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating instance_info_cache with network_info: [{"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "address": "fa:16:3e:2e:ca:10", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b7d551-6e", "ovs_interfaceid": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "address": "fa:16:3e:83:21:b5", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80e2f85-5f", "ovs_interfaceid": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "address": "fa:16:3e:fa:10:3e", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36f74b7-eb", "ovs_interfaceid": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "address": "fa:16:3e:b4:ae:35", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff91ee0f-4d", "ovs_interfaceid": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d2ce78-2425-403d-a0b0-9596b311643a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Releasing lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG nova.compute.manager [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Instance network_info: |[{"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "address": "fa:16:3e:2e:ca:10", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b7d551-6e", "ovs_interfaceid": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "address": "fa:16:3e:83:21:b5", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80e2f85-5f", "ovs_interfaceid": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "address": "fa:16:3e:fa:10:3e", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36f74b7-eb", "ovs_interfaceid": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "address": "fa:16:3e:b4:ae:35", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff91ee0f-4d", "ovs_interfaceid": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a23e4983-6066-40cb-8840-662dbafa24e3 req-0df2b63b-d987-427d-b111-4241ca192662 service nova] Acquired lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG nova.network.neutron [req-a23e4983-6066-40cb-8840-662dbafa24e3 req-0df2b63b-d987-427d-b111-4241ca192662 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing network info cache for port ff91ee0f-4db6-4246-8cfc-f42691975fe3 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9340548b-2ce1-4cba-92da-dfa53d0db5be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d960a8-d87b-4cb0-97bf-936a328b1e6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:21:01 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:21:01 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[952597fb-7998-401b-8305-8e0f2458e9a9]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG os_brick.utils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:21:01 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updating existing volume attachment record: 8ed4ae93-621d-4819-9d3c-8c3833942926 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:21:02 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:21:02 user nova-compute[74311]: DEBUG nova.network.neutron [req-a23e4983-6066-40cb-8840-662dbafa24e3 req-0df2b63b-d987-427d-b111-4241ca192662 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updated VIF entry in instance network info cache for port ff91ee0f-4db6-4246-8cfc-f42691975fe3. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:21:02 user nova-compute[74311]: DEBUG nova.network.neutron [req-a23e4983-6066-40cb-8840-662dbafa24e3 req-0df2b63b-d987-427d-b111-4241ca192662 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating instance_info_cache with network_info: [{"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "address": "fa:16:3e:2e:ca:10", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b7d551-6e", "ovs_interfaceid": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "address": "fa:16:3e:83:21:b5", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80e2f85-5f", "ovs_interfaceid": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "address": "fa:16:3e:fa:10:3e", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36f74b7-eb", "ovs_interfaceid": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "address": "fa:16:3e:b4:ae:35", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff91ee0f-4d", "ovs_interfaceid": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:21:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a23e4983-6066-40cb-8840-662dbafa24e3 req-0df2b63b-d987-427d-b111-4241ca192662 service nova] Releasing lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:21:03 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:21:03 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:21:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:05 user nova-compute[74311]: INFO nova.compute.manager [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Terminating instance
Oct 20 10:21:05 user nova-compute[74311]: DEBUG nova.compute.manager [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG nova.compute.manager [req-d96a8f17-d9fa-4e68-b8ce-c6a160cfeee2 req-b45041ad-4b4f-480a-9498-901fb2bde14f service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-vif-unplugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d96a8f17-d9fa-4e68-b8ce-c6a160cfeee2 req-b45041ad-4b4f-480a-9498-901fb2bde14f service nova] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d96a8f17-d9fa-4e68-b8ce-c6a160cfeee2 req-b45041ad-4b4f-480a-9498-901fb2bde14f service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d96a8f17-d9fa-4e68-b8ce-c6a160cfeee2 req-b45041ad-4b4f-480a-9498-901fb2bde14f service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG nova.compute.manager [req-d96a8f17-d9fa-4e68-b8ce-c6a160cfeee2 req-b45041ad-4b4f-480a-9498-901fb2bde14f service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] No waiting events found dispatching network-vif-unplugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG nova.compute.manager [req-d96a8f17-d9fa-4e68-b8ce-c6a160cfeee2 req-b45041ad-4b4f-480a-9498-901fb2bde14f service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-vif-unplugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:21:05 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Instance destroyed successfully.
Oct 20 10:21:05 user nova-compute[74311]: DEBUG nova.objects.instance [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lazy-loading 'resources' on Instance uuid 2fed360b-584a-4e1a-8e27-9189de7f5007 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1040491951',display_name='tempest-ServerActionsTestOtherB-server-1040491951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1040491951',id=3,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYMmO8U1tJG2uyGm7rRRFIfa2RGpjFLZUdepKCTj1HHDZcXkXVS7OOg3Lk+mu44EcWQu9Fu9KdlNYR4A7PzrCGtqSSIRfDMJT14TIDOTSonr8dNWJPGqynHBYamRxl9rg==',key_name='tempest-keypair-849637715',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:18:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d174f4a262b044e58e8f211b06a41d40',ramdisk_id='',reservation_id='r-z4cepc28',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1319179529',owner_user_name='tempest-ServerActionsTestOtherB-1319179529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:18:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b357b019ce2a4153af47b9e4c5586148',uuid=2fed360b-584a-4e1a-8e27-9189de7f5007,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converting VIF {"id": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "address": "fa:16:3e:08:6f:b2", "network": {"id": "2b13ac72-1cc8-488a-9b31-839ceed8aafe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-767903600-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d174f4a262b044e58e8f211b06a41d40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa042b1af-30", "ovs_interfaceid": "a042b1af-3064-4133-97dc-eaf5e3bf4859", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG os_vif [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa042b1af-30, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6aa1f97c-30b5-409c-a2e8-ae8ddb27a15e) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:05 user nova-compute[74311]: INFO os_vif [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:6f:b2,bridge_name='br-int',has_traffic_filtering=True,id=a042b1af-3064-4133-97dc-eaf5e3bf4859,network=Network(2b13ac72-1cc8-488a-9b31-839ceed8aafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa042b1af-30')
Oct 20 10:21:05 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mRenVUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:21:05 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:21:05 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f18696-42d3-476a-9464-6f8365ea89fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:21:05 user nova-compute[74311]: No targets found.
Oct 20 10:21:05 user nova-compute[74311]: iSNS:
Oct 20 10:21:05 user nova-compute[74311]: No targets found.
Oct 20 10:21:05 user nova-compute[74311]: STATIC:
Oct 20 10:21:05 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:21:05 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:21:05 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:21:05 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b
Oct 20 10:21:05 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:21:05 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:21:05 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5
Oct 20 10:21:05 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:21:05 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:21:05 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138
Oct 20 10:21:05 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:21:05 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:21:05 user nova-compute[74311]: FIRMWARE:
Oct 20 10:21:05 user nova-compute[74311]: No targets found.
Oct 20 10:21:05 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:21:05 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:21:05 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43faf5e-c261-4704-8183-7d4c4a439d19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00e8fed-40dd-40df-8ee0-b381c0cafd07]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:21:05 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:21:05 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:21:05 user nova-compute[74311]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:21:05 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:21:05 user nova-compute[74311]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 (non-flash)
Oct 20 10:21:05 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:21:05 user nova-compute[74311]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:21:05 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164f90670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5'): ({'sdc'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Removing single pathed devices sdc {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:21:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8324f7c1-cb75-405f-a883-cf99bb172100]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e51ae2-a49a-47c5-9b8a-a91330b3c8e9]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Flushing IO for device /dev/sdc {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed5c50a-d694-4749-9bac-6c4c08bb56c9]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[daff7d3c-27b8-4d5f-9760-7121df5281cd]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[097e0e91-76ed-42cd-a67f-e669f2d548a8]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5172e7c-bc15-4ba6-8ddd-d1d2d388a6e6]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260]
Oct 20 10:21:06 user nova-compute[74311]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5, portal: 172.16.0.220,3260] successful.
Oct 20 10:21:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a032ca5-d6bb-4766-93df-a1109b708ff5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fb7faf-af14-4a74-97f5-e199867c3684]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] <== disconnect_volume: return (429ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:21:06 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Deleting instance files /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007_del
Oct 20 10:21:06 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Deletion of /opt/stack/data/nova/instances/2fed360b-584a-4e1a-8e27-9189de7f5007_del complete
Oct 20 10:21:06 user nova-compute[74311]: INFO nova.compute.manager [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Took 1.40 seconds to destroy the instance on the hypervisor.
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:07 user nova-compute[74311]: INFO nova.compute.manager [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Detaching volume 9740904b-17dd-4a9b-be36-df6c67881138
Oct 20 10:21:07 user nova-compute[74311]: INFO nova.virt.block_device [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Attempting to driver detach volume 9740904b-17dd-4a9b-be36-df6c67881138 from mountpoint /dev/vdb
Oct 20 10:21:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Attempting to detach device vdb from instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:21:07 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:21:07 user nova-compute[74311]:   <source dev="/dev/sdd"/>
Oct 20 10:21:07 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:21:07 user nova-compute[74311]:   <serial>9740904b-17dd-4a9b-be36-df6c67881138</serial>
Oct 20 10:21:07 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 10:21:07 user nova-compute[74311]: </disk>
Oct 20 10:21:07 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.270s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:07 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Successfully detached device vdb from instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 from the persistent domain config.
Oct 20 10:21:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:21:07 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:21:07 user nova-compute[74311]:   <source dev="/dev/sdd"/>
Oct 20 10:21:07 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:21:07 user nova-compute[74311]:   <serial>9740904b-17dd-4a9b-be36-df6c67881138</serial>
Oct 20 10:21:07 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 10:21:07 user nova-compute[74311]: </disk>
Oct 20 10:21:07 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG nova.compute.manager [req-43f489f0-2d95-4821-a8e9-c41acf1d6ed9 req-2bc68b75-ac7a-4180-a554-96d44eb28b26 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-43f489f0-2d95-4821-a8e9-c41acf1d6ed9 req-2bc68b75-ac7a-4180-a554-96d44eb28b26 service nova] Acquiring lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-43f489f0-2d95-4821-a8e9-c41acf1d6ed9 req-2bc68b75-ac7a-4180-a554-96d44eb28b26 service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-43f489f0-2d95-4821-a8e9-c41acf1d6ed9 req-2bc68b75-ac7a-4180-a554-96d44eb28b26 service nova] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG nova.compute.manager [req-43f489f0-2d95-4821-a8e9-c41acf1d6ed9 req-2bc68b75-ac7a-4180-a554-96d44eb28b26 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] No waiting events found dispatching network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:07 user nova-compute[74311]: WARNING nova.compute.manager [req-43f489f0-2d95-4821-a8e9-c41acf1d6ed9 req-2bc68b75-ac7a-4180-a554-96d44eb28b26 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received unexpected event network-vif-plugged-a042b1af-3064-4133-97dc-eaf5e3bf4859 for instance with vm_state active and task_state deleting.
Oct 20 10:21:07 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:21:07 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Took 1.03 seconds to deallocate network for instance.
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:07 user nova-compute[74311]: INFO nova.compute.manager [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Terminating instance
Oct 20 10:21:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-fdf8d99b-6235-492a-b982-551f33bbfad6 req-ece82a19-ed48-4852-81be-33ba35b47743 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received event network-vif-unplugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fdf8d99b-6235-492a-b982-551f33bbfad6 req-ece82a19-ed48-4852-81be-33ba35b47743 service nova] Acquiring lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fdf8d99b-6235-492a-b982-551f33bbfad6 req-ece82a19-ed48-4852-81be-33ba35b47743 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fdf8d99b-6235-492a-b982-551f33bbfad6 req-ece82a19-ed48-4852-81be-33ba35b47743 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-fdf8d99b-6235-492a-b982-551f33bbfad6 req-ece82a19-ed48-4852-81be-33ba35b47743 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] No waiting events found dispatching network-vif-unplugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-fdf8d99b-6235-492a-b982-551f33bbfad6 req-ece82a19-ed48-4852-81be-33ba35b47743 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received event network-vif-unplugged-3547e076-2273-41d1-829e-062952da0e37 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:08 user nova-compute[74311]: INFO nova.compute.manager [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Took 1.02 seconds to detach 1 volumes for instance.
Oct 20 10:21:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:08 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Instance destroyed successfully.
Oct 20 10:21:08 user nova-compute[74311]: DEBUG nova.objects.instance [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lazy-loading 'resources' on Instance uuid 47a30844-242f-4a7f-ad9f-232a6e76b4ec {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-855673579',display_name='tempest-ServersNegativeTestJSON-server-855673579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-855673579',id=1,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbc9455e6a754bafb33349644f579988',ramdisk_id='',reservation_id='r-xvinicnh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1307260612',owner_user_name='tempest-ServersNegativeTestJSON-1307260612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:12:16Z,user_data=None,user_id='6c40e8a363dd4eaf862c0b61de171130',uuid=47a30844-242f-4a7f-ad9f-232a6e76b4ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3547e076-2273-41d1-829e-062952da0e37", "address": "fa:16:3e:e8:4a:24", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547e076-22", "ovs_interfaceid": "3547e076-2273-41d1-829e-062952da0e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Converting VIF {"id": "3547e076-2273-41d1-829e-062952da0e37", "address": "fa:16:3e:e8:4a:24", "network": {"id": "5253925b-fda9-426d-8a82-bc8924961ac2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1426660612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbc9455e6a754bafb33349644f579988", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547e076-22", "ovs_interfaceid": "3547e076-2273-41d1-829e-062952da0e37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:4a:24,bridge_name='br-int',has_traffic_filtering=True,id=3547e076-2273-41d1-829e-062952da0e37,network=Network(5253925b-fda9-426d-8a82-bc8924961ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3547e076-22') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG os_vif [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:4a:24,bridge_name='br-int',has_traffic_filtering=True,id=3547e076-2273-41d1-829e-062952da0e37,network=Network(5253925b-fda9-426d-8a82-bc8924961ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3547e076-22') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3547e076-22, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0521497-9c20-4fcd-9689-1b82ccc8b965) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:08 user nova-compute[74311]: INFO os_vif [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:4a:24,bridge_name='br-int',has_traffic_filtering=True,id=3547e076-2273-41d1-829e-062952da0e37,network=Network(5253925b-fda9-426d-8a82-bc8924961ac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3547e076-22')
Oct 20 10:21:08 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Deleting instance files /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec_del
Oct 20 10:21:08 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Deletion of /opt/stack/data/nova/instances/47a30844-242f-4a7f-ad9f-232a6e76b4ec_del complete
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:08 user nova-compute[74311]: INFO nova.compute.manager [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:08 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Error from libvirt while getting description of instance-00000003: [Error Code 42] Domain not found: no domain with matching uuid '2fed360b-584a-4e1a-8e27-9189de7f5007' (instance-00000003): libvirt.libvirtError: Domain not found: no domain with matching uuid '2fed360b-584a-4e1a-8e27-9189de7f5007' (instance-00000003)
Oct 20 10:21:08 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Error from libvirt while getting description of instance-00000001: [Error Code 42] Domain not found: no domain with matching uuid '47a30844-242f-4a7f-ad9f-232a6e76b4ec' (instance-00000001): libvirt.libvirtError: Domain not found: no domain with matching uuid '47a30844-242f-4a7f-ad9f-232a6e76b4ec' (instance-00000001)
Oct 20 10:21:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:21:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.683s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:09 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Deleted allocations for instance 2fed360b-584a-4e1a-8e27-9189de7f5007
Oct 20 10:21:09 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:09 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Took 0.69 seconds to deallocate network for instance.
Oct 20 10:21:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-cc74f966-7f9c-485c-b3cf-88a4261424eb req-ce5092c5-98e6-4b5b-bcc2-f74443df77f4 service nova] [instance: 2fed360b-584a-4e1a-8e27-9189de7f5007] Received event network-vif-deleted-a042b1af-3064-4133-97dc-eaf5e3bf4859 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-cc74f966-7f9c-485c-b3cf-88a4261424eb req-ce5092c5-98e6-4b5b-bcc2-f74443df77f4 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received event network-vif-deleted-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-140c6229-c8c3-4aed-ac38-3ef7703f1bb6 tempest-ServerActionsTestOtherB-1319179529 tempest-ServerActionsTestOtherB-1319179529-project-member] Lock "2fed360b-584a-4e1a-8e27-9189de7f5007" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.462s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:10 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:21:10 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7806MB free_disk=25.225582122802734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received event network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Acquiring lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] No waiting events found dispatching network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:10 user nova-compute[74311]: WARNING nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received unexpected event network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 for instance with vm_state deleted and task_state None.
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received event network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Acquiring lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] No waiting events found dispatching network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:10 user nova-compute[74311]: WARNING nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received unexpected event network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 for instance with vm_state deleted and task_state None.
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received event network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Acquiring lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] No waiting events found dispatching network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:10 user nova-compute[74311]: WARNING nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received unexpected event network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 for instance with vm_state deleted and task_state None.
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received event network-vif-unplugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Acquiring lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] No waiting events found dispatching network-vif-unplugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:10 user nova-compute[74311]: WARNING nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received unexpected event network-vif-unplugged-3547e076-2273-41d1-829e-062952da0e37 for instance with vm_state deleted and task_state None.
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received event network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Acquiring lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] No waiting events found dispatching network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:10 user nova-compute[74311]: WARNING nova.compute.manager [req-39b034f1-2ce1-4520-9ca0-70986d03df3d req-c53d8142-7362-404c-81cc-eaf2f7368a56 service nova] [instance: 47a30844-242f-4a7f-ad9f-232a6e76b4ec] Received unexpected event network-vif-plugged-3547e076-2273-41d1-829e-062952da0e37 for instance with vm_state deleted and task_state None.
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.866s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.206s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:10 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Deleted allocations for instance 47a30844-242f-4a7f-ad9f-232a6e76b4ec
Oct 20 10:21:10 user nova-compute[74311]: INFO nova.virt.block_device [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Booting with volume 9dc740f6-a328-44da-88b7-07275d6889f9 at /dev/vdb
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-71a3a66c-afd1-492d-a124-a9a8165a10ce tempest-ServersNegativeTestJSON-1307260612 tempest-ServersNegativeTestJSON-1307260612-project-member] Lock "47a30844-242f-4a7f-ad9f-232a6e76b4ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.783s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 4011fd9a-7109-46b7-b77e-51c29e36a7d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG os_brick.utils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a6a4dd-40ca-44a1-acdf-7e2a95416a49]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance dcecd43c-0d21-4413-8fa5-02856f450b6a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[175370d2-c356-4886-a5aa-7390c2a5de4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea10d22a-0f9d-423c-9cdc-261b2ebe0121]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4775e004-cbd5-4896-815e-a407cc69190c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:21:10 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:21:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e33601-4120-44c1-b46b-16738dda0757]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG os_brick.utils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:21:10 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating existing volume attachment record: ae9f65fb-672d-46f6-9595-a2349865e931 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:21:11 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:21:11 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:21:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:21:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.747s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:14 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:21:14 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:21:14 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:21:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:21 user nova-compute[74311]: DEBUG nova.objects.instance [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lazy-loading 'pci_requests' on Instance uuid dcecd43c-0d21-4413-8fa5-02856f450b6a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:21 user nova-compute[74311]: DEBUG nova.objects.instance [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lazy-loading 'numa_topology' on Instance uuid dcecd43c-0d21-4413-8fa5-02856f450b6a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:21 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:21:21 user nova-compute[74311]: INFO nova.compute.claims [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Claim successful on node user
Oct 20 10:21:21 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:21:21 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:21:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.574s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:21 user nova-compute[74311]: INFO nova.network.neutron [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updating port 75daa4b7-a58b-4b60-afe8-97f535c09013 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 10:21:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:21:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquired lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:21:22 user nova-compute[74311]: DEBUG nova.network.neutron [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:21:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-f2454631-c8d6-49ce-b7b6-b147a5aef298 req-9e46b296-96c6-4e76-80b9-2617c5fc0c8b service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-changed-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-f2454631-c8d6-49ce-b7b6-b147a5aef298 req-9e46b296-96c6-4e76-80b9-2617c5fc0c8b service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Refreshing instance network info cache due to event network-changed-75daa4b7-a58b-4b60-afe8-97f535c09013. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:21:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f2454631-c8d6-49ce-b7b6-b147a5aef298 req-9e46b296-96c6-4e76-80b9-2617c5fc0c8b service nova] Acquiring lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.network.neutron [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updating instance_info_cache with network_info: [{"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Releasing lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:21:23 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Creating image(s)
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Ensure instance console log exists: /opt/stack/data/nova/instances/dcecd43c-0d21-4413-8fa5-02856f450b6a/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Start _get_guest_xml network_info=[{"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '8ed4ae93-621d-4819-9d3c-8c3833942926', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGCHmwir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dcecd43c-0d21-4413-8fa5-02856f450b6a', 'attached_at': '', 'detached_at': '', 'volume_id': '472b7899-fb18-4cf3-aed5-dd75907cc03f', 'serial': '472b7899-fb18-4cf3-aed5-dd75907cc03f'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f2454631-c8d6-49ce-b7b6-b147a5aef298 req-9e46b296-96c6-4e76-80b9-2617c5fc0c8b service nova] Acquired lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.network.neutron [req-f2454631-c8d6-49ce-b7b6-b147a5aef298 req-9e46b296-96c6-4e76-80b9-2617c5fc0c8b service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Refreshing network info cache for port 75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:21:23 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:21:23 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.objects.instance [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lazy-loading 'vcpu_model' on Instance uuid dcecd43c-0d21-4413-8fa5-02856f450b6a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.objects.base [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Object Instance<dcecd43c-0d21-4413-8fa5-02856f450b6a> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGCHmwir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:21:23 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:21:23 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:21:23 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:21:23 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:21:23 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de73f5b-4a3e-49b5-887c-8cdae4daaf4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:21:23 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dccef69-6654-4d25-ae10-20fd4161c4e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f] added
Oct 20 10:21:23 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b995aa0b-f4b5-4b26-8176-1a6455d3d99d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8c5966-b352-4648-992a-e700c1d8db43]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGCHmwir {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGCHmwir" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd999774-a1c1-4c77-aa3c-8353e67cd876]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pGCHmwir'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8533ee07-3d64-4f3b-80a5-950ae8973b98]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ebdb03-1505-4c23-bf3b-c2d9e19dd122]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:21:23 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:21:23 user nova-compute[74311]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:21:23 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:21:23 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:21:23 user nova-compute[74311]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:21:23 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.network.neutron [req-f2454631-c8d6-49ce-b7b6-b147a5aef298 req-9e46b296-96c6-4e76-80b9-2617c5fc0c8b service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updated VIF entry in instance network info cache for port 75daa4b7-a58b-4b60-afe8-97f535c09013. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG nova.network.neutron [req-f2454631-c8d6-49ce-b7b6-b147a5aef298 req-9e46b296-96c6-4e76-80b9-2617c5fc0c8b service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updating instance_info_cache with network_info: [{"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:21:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f2454631-c8d6-49ce-b7b6-b147a5aef298 req-9e46b296-96c6-4e76-80b9-2617c5fc0c8b service nova] Releasing lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --login" returned: 0 in 1.064s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ca4521-345b-4dcc-bfa8-f85a9216f13b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260]
Oct 20 10:21:24 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260] successful.
Oct 20 10:21:24 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c4d4f0-c2db-43e2-86e3-8f90e8ac5551]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba17eef-8b3d-47c4-8499-e9b4d0357098]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:21:24 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:21:24 user nova-compute[74311]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:21:24 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:21:24 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:21:24 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:21:24 user nova-compute[74311]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:21:24 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:21:24 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.306s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.051s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6bff2e-9522-4902-87d3-424ceb53f123]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:21:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGCHmwir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.375s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] <== connect_volume: return (2376ms) {'type': 'block', 'scsi_wwn': '26538376264316335', 'path': '/dev/sdc'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538376264316335', 'path': '/dev/sdc'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T10:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1629854730',display_name='tempest-TestShelveInstance-server-1629854730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1629854730',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-252767667',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9dd35c1e7d774f1db10dce2f42915a80',ramdisk_id='',reservation_id='r-norxghh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1328079289',owner_user_name='tempest-TestShelveInstance-1328079289-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:21:02Z,user_data=None,user_id='7d74f45f32004531a84f76f16254d459',uuid=dcecd43c-0d21-4413-8fa5-02856f450b6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Converting VIF {"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=75daa4b7-a58b-4b60-afe8-97f535c09013,network=Network(b5d1e6f9-d369-41f2-a536-07de25499fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75daa4b7-a5') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG nova.objects.instance [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lazy-loading 'pci_devices' on Instance uuid dcecd43c-0d21-4413-8fa5-02856f450b6a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG nova.objects.base [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Object Instance<dcecd43c-0d21-4413-8fa5-02856f450b6a> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:21:25 user nova-compute[74311]:   <uuid>dcecd43c-0d21-4413-8fa5-02856f450b6a</uuid>
Oct 20 10:21:25 user nova-compute[74311]:   <name>instance-00000011</name>
Oct 20 10:21:25 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:21:25 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:21:25 user nova-compute[74311]:   <metadata>
Oct 20 10:21:25 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:21:25 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:21:25 user nova-compute[74311]:       <nova:name>tempest-TestShelveInstance-server-1629854730</nova:name>
Oct 20 10:21:25 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:21:23</nova:creationTime>
Oct 20 10:21:25 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:21:25 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:21:25 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:21:25 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:21:25 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:21:25 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:21:25 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:21:25 user nova-compute[74311]:       <nova:owner>
Oct 20 10:21:25 user nova-compute[74311]:         <nova:user uuid="7d74f45f32004531a84f76f16254d459">tempest-TestShelveInstance-1328079289-project-member</nova:user>
Oct 20 10:21:25 user nova-compute[74311]:         <nova:project uuid="9dd35c1e7d774f1db10dce2f42915a80">tempest-TestShelveInstance-1328079289</nova:project>
Oct 20 10:21:25 user nova-compute[74311]:       </nova:owner>
Oct 20 10:21:25 user nova-compute[74311]:       <nova:ports>
Oct 20 10:21:25 user nova-compute[74311]:         <nova:port uuid="75daa4b7-a58b-4b60-afe8-97f535c09013">
Oct 20 10:21:25 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 10:21:25 user nova-compute[74311]:         </nova:port>
Oct 20 10:21:25 user nova-compute[74311]:       </nova:ports>
Oct 20 10:21:25 user nova-compute[74311]:     </nova:instance>
Oct 20 10:21:25 user nova-compute[74311]:   </metadata>
Oct 20 10:21:25 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:21:25 user nova-compute[74311]:     <system>
Oct 20 10:21:25 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:21:25 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:21:25 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:21:25 user nova-compute[74311]:       <entry name="serial">dcecd43c-0d21-4413-8fa5-02856f450b6a</entry>
Oct 20 10:21:25 user nova-compute[74311]:       <entry name="uuid">dcecd43c-0d21-4413-8fa5-02856f450b6a</entry>
Oct 20 10:21:25 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:21:25 user nova-compute[74311]:     </system>
Oct 20 10:21:25 user nova-compute[74311]:   </sysinfo>
Oct 20 10:21:25 user nova-compute[74311]:   <os>
Oct 20 10:21:25 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:21:25 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:21:25 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:21:25 user nova-compute[74311]:   </os>
Oct 20 10:21:25 user nova-compute[74311]:   <features>
Oct 20 10:21:25 user nova-compute[74311]:     <acpi/>
Oct 20 10:21:25 user nova-compute[74311]:     <apic/>
Oct 20 10:21:25 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:21:25 user nova-compute[74311]:   </features>
Oct 20 10:21:25 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:21:25 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:21:25 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:21:25 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:21:25 user nova-compute[74311]:   </clock>
Oct 20 10:21:25 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:21:25 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:21:25 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:21:25 user nova-compute[74311]:   </cpu>
Oct 20 10:21:25 user nova-compute[74311]:   <devices>
Oct 20 10:21:25 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:21:25 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:21:25 user nova-compute[74311]:       <source dev="/dev/sdc"/>
Oct 20 10:21:25 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:21:25 user nova-compute[74311]:       <serial>472b7899-fb18-4cf3-aed5-dd75907cc03f</serial>
Oct 20 10:21:25 user nova-compute[74311]:     </disk>
Oct 20 10:21:25 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:21:25 user nova-compute[74311]:       <mac address="fa:16:3e:d0:c5:3e"/>
Oct 20 10:21:25 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:21:25 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:21:25 user nova-compute[74311]:       <target dev="tap75daa4b7-a5"/>
Oct 20 10:21:25 user nova-compute[74311]:     </interface>
Oct 20 10:21:25 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:21:25 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/dcecd43c-0d21-4413-8fa5-02856f450b6a/console.log" append="off"/>
Oct 20 10:21:25 user nova-compute[74311]:     </serial>
Oct 20 10:21:25 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:21:25 user nova-compute[74311]:     <video>
Oct 20 10:21:25 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:21:25 user nova-compute[74311]:     </video>
Oct 20 10:21:25 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:21:25 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:21:25 user nova-compute[74311]:     </rng>
Oct 20 10:21:25 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:21:25 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:21:25 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:21:25 user nova-compute[74311]:     </memballoon>
Oct 20 10:21:25 user nova-compute[74311]:   </devices>
Oct 20 10:21:25 user nova-compute[74311]: </domain>
Oct 20 10:21:25 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T10:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1629854730',display_name='tempest-TestShelveInstance-server-1629854730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1629854730',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-252767667',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9dd35c1e7d774f1db10dce2f42915a80',ramdisk_id='',reservation_id='r-norxghh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1328079289',owner_user_name='tempest-TestShelveInstance-1328079289-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:21:02Z,user_data=None,user_id='7d74f45f32004531a84f76f16254d459',uuid=dcecd43c-0d21-4413-8fa5-02856f450b6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Converting VIF {"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=75daa4b7-a58b-4b60-afe8-97f535c09013,network=Network(b5d1e6f9-d369-41f2-a536-07de25499fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75daa4b7-a5') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG os_vif [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=75daa4b7-a58b-4b60-afe8-97f535c09013,network=Network(b5d1e6f9-d369-41f2-a536-07de25499fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75daa4b7-a5') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f328a08-9808-5e64-bd23-09db71849aa3', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75daa4b7-a5, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75daa4b7-a5, col_values=(('qos', UUID('68f04944-0f33-4c02-95c3-f1230b902687')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75daa4b7-a5, col_values=(('external_ids', {'iface-id': '75daa4b7-a58b-4b60-afe8-97f535c09013', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:c5:3e', 'vm-uuid': 'dcecd43c-0d21-4413-8fa5-02856f450b6a'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:25 user nova-compute[74311]: INFO os_vif [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=75daa4b7-a58b-4b60-afe8-97f535c09013,network=Network(b5d1e6f9-d369-41f2-a536-07de25499fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75daa4b7-a5')
Oct 20 10:21:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:21:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] No VIF found with MAC fa:16:3e:d0:c5:3e, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:21:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "922b36b5-0575-4717-a876-dda27469ebb2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "922b36b5-0575-4717-a876-dda27469ebb2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:21:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:21:26 user nova-compute[74311]: INFO nova.compute.claims [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Claim successful on node user
Oct 20 10:21:27 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG nova.compute.manager [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG nova.compute.manager [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG nova.network.neutron [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:21:27 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:21:27 user nova-compute[74311]: DEBUG nova.compute.manager [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG nova.policy [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c6b76de1f054ca0973f2f9ba2eafaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090bd6a8a14d4a308e67be7a12e47ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG nova.compute.manager [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:21:27 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Creating image(s)
Oct 20 10:21:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "/opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "/opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "/opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-6f7b8269-b46c-4b04-9859-de1b87e60094 req-d2667c2a-4e61-457a-9678-1fb9f43463f2 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6f7b8269-b46c-4b04-9859-de1b87e60094 req-d2667c2a-4e61-457a-9678-1fb9f43463f2 service nova] Acquiring lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6f7b8269-b46c-4b04-9859-de1b87e60094 req-d2667c2a-4e61-457a-9678-1fb9f43463f2 service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6f7b8269-b46c-4b04-9859-de1b87e60094 req-d2667c2a-4e61-457a-9678-1fb9f43463f2 service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-6f7b8269-b46c-4b04-9859-de1b87e60094 req-d2667c2a-4e61-457a-9678-1fb9f43463f2 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] No waiting events found dispatching network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:27 user nova-compute[74311]: WARNING nova.compute.manager [req-6f7b8269-b46c-4b04-9859-de1b87e60094 req-d2667c2a-4e61-457a-9678-1fb9f43463f2 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received unexpected event network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 10:21:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.268s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:28 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 is timed out.
Oct 20 10:21:28 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Successfully detached device vdb from instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 from the live domain config.
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk 1073741824" returned: 0 in 0.078s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhEZzuRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:21:28 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5d3860-ab99-4b40-8f1f-3d565fb6f4b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:21:28 user nova-compute[74311]: No targets found.
Oct 20 10:21:28 user nova-compute[74311]: iSNS:
Oct 20 10:21:28 user nova-compute[74311]: No targets found.
Oct 20 10:21:28 user nova-compute[74311]: STATIC:
Oct 20 10:21:28 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:21:28 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:21:28 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:21:28 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f
Oct 20 10:21:28 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:21:28 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:21:28 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b
Oct 20 10:21:28 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:21:28 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:21:28 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138
Oct 20 10:21:28 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:21:28 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:21:28 user nova-compute[74311]: FIRMWARE:
Oct 20 10:21:28 user nova-compute[74311]: No targets found.
Oct 20 10:21:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:21:28 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:21:28 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG nova.network.neutron [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Successfully created port: f3b77955-fd93-4421-941d-b99f0d54ebbc {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfe37dc-21f7-4bc2-8f05-842497da38e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47e5e1c-b466-4ccb-aee1-6f3ad465f2a3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:21:28 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:21:28 user nova-compute[74311]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:21:28 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:21:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:21:28 user nova-compute[74311]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 (non-flash)
Oct 20 10:21:28 user nova-compute[74311]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:21:28 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:21:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164fae5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138'): ({'sdd'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Removing single pathed devices sdd {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.209s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Checking if we can resize image /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38662da-f2bd-4633-a8ed-a5c8060a64c8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5a2b4b-b1bb-4897-ac80-8aa5631f053c]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Flushing IO for device /dev/sdd {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e01f96-875a-410f-9e30-200b94bafd2f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b233d9-2ea0-4a40-bac2-ac15b5553e57]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0debae9-3211-408f-ab95-80e84d94fe43]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Cannot resize image /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Ensure instance console log exists: /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d3066f-8dcf-4a0f-85b9-eb0ea2c3d49b]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260]
Oct 20 10:21:28 user nova-compute[74311]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138, portal: 172.16.0.220,3260] successful.
Oct 20 10:21:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9740904b-17dd-4a9b-be36-df6c67881138 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[14da57ce-b54a-4f77-a0e1-2f211b9a202d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.461s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] <== disconnect_volume: return (464ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG nova.network.neutron [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Successfully updated port: f3b77955-fd93-4421-941d-b99f0d54ebbc {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "refresh_cache-922b36b5-0575-4717-a876-dda27469ebb2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquired lock "refresh_cache-922b36b5-0575-4717-a876-dda27469ebb2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:21:28 user nova-compute[74311]: DEBUG nova.network.neutron [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-cff94f8f-8691-4f3b-b4fa-5c4d54f15aec req-6caa3dcd-aeea-4d92-87d7-68f7ed5ba5e2 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Received event network-changed-f3b77955-fd93-4421-941d-b99f0d54ebbc {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-cff94f8f-8691-4f3b-b4fa-5c4d54f15aec req-6caa3dcd-aeea-4d92-87d7-68f7ed5ba5e2 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Refreshing instance network info cache due to event network-changed-f3b77955-fd93-4421-941d-b99f0d54ebbc. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cff94f8f-8691-4f3b-b4fa-5c4d54f15aec req-6caa3dcd-aeea-4d92-87d7-68f7ed5ba5e2 service nova] Acquiring lock "refresh_cache-922b36b5-0575-4717-a876-dda27469ebb2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.network.neutron [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.network.neutron [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Updating instance_info_cache with network_info: [{"id": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "address": "fa:16:3e:51:48:ab", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b77955-fd", "ovs_interfaceid": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.objects.instance [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lazy-loading 'flavor' on Instance uuid 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Releasing lock "refresh_cache-922b36b5-0575-4717-a876-dda27469ebb2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.compute.manager [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Instance network_info: |[{"id": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "address": "fa:16:3e:51:48:ab", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b77955-fd", "ovs_interfaceid": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cff94f8f-8691-4f3b-b4fa-5c4d54f15aec req-6caa3dcd-aeea-4d92-87d7-68f7ed5ba5e2 service nova] Acquired lock "refresh_cache-922b36b5-0575-4717-a876-dda27469ebb2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.network.neutron [req-cff94f8f-8691-4f3b-b4fa-5c4d54f15aec req-6caa3dcd-aeea-4d92-87d7-68f7ed5ba5e2 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Refreshing network info cache for port f3b77955-fd93-4421-941d-b99f0d54ebbc {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Start _get_guest_xml network_info=[{"id": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "address": "fa:16:3e:51:48:ab", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b77955-fd", "ovs_interfaceid": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:21:29 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:21:29 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1406375063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1406375063',id=23,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090bd6a8a14d4a308e67be7a12e47ae6',ramdisk_id='',reservation_id='r-xo0ylhoy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:21:27Z,user_data=None,user_id='0c6b76de1f054ca0973f2f9ba2eafaed',uuid=922b36b5-0575-4717-a876-dda27469ebb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "address": "fa:16:3e:51:48:ab", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b77955-fd", "ovs_interfaceid": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converting VIF {"id": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "address": "fa:16:3e:51:48:ab", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b77955-fd", "ovs_interfaceid": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=f3b77955-fd93-4421-941d-b99f0d54ebbc,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b77955-fd') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.objects.instance [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'pci_devices' on Instance uuid 922b36b5-0575-4717-a876-dda27469ebb2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ccc003be-55a6-4226-910f-b7e155155ef3 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.425s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:21:29 user nova-compute[74311]:   <uuid>922b36b5-0575-4717-a876-dda27469ebb2</uuid>
Oct 20 10:21:29 user nova-compute[74311]:   <name>instance-00000017</name>
Oct 20 10:21:29 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:21:29 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:21:29 user nova-compute[74311]:   <metadata>
Oct 20 10:21:29 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:21:29 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:21:29 user nova-compute[74311]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1406375063</nova:name>
Oct 20 10:21:29 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:21:29</nova:creationTime>
Oct 20 10:21:29 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:21:29 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:21:29 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:21:29 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:21:29 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:21:29 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:21:29 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:21:29 user nova-compute[74311]:       <nova:owner>
Oct 20 10:21:29 user nova-compute[74311]:         <nova:user uuid="0c6b76de1f054ca0973f2f9ba2eafaed">tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member</nova:user>
Oct 20 10:21:29 user nova-compute[74311]:         <nova:project uuid="090bd6a8a14d4a308e67be7a12e47ae6">tempest-ServerBootFromVolumeStableRescueTest-2019341345</nova:project>
Oct 20 10:21:29 user nova-compute[74311]:       </nova:owner>
Oct 20 10:21:29 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:21:29 user nova-compute[74311]:       <nova:ports>
Oct 20 10:21:29 user nova-compute[74311]:         <nova:port uuid="f3b77955-fd93-4421-941d-b99f0d54ebbc">
Oct 20 10:21:29 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 10:21:29 user nova-compute[74311]:         </nova:port>
Oct 20 10:21:29 user nova-compute[74311]:       </nova:ports>
Oct 20 10:21:29 user nova-compute[74311]:     </nova:instance>
Oct 20 10:21:29 user nova-compute[74311]:   </metadata>
Oct 20 10:21:29 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:21:29 user nova-compute[74311]:     <system>
Oct 20 10:21:29 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:21:29 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:21:29 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:21:29 user nova-compute[74311]:       <entry name="serial">922b36b5-0575-4717-a876-dda27469ebb2</entry>
Oct 20 10:21:29 user nova-compute[74311]:       <entry name="uuid">922b36b5-0575-4717-a876-dda27469ebb2</entry>
Oct 20 10:21:29 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:21:29 user nova-compute[74311]:     </system>
Oct 20 10:21:29 user nova-compute[74311]:   </sysinfo>
Oct 20 10:21:29 user nova-compute[74311]:   <os>
Oct 20 10:21:29 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:21:29 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:21:29 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:21:29 user nova-compute[74311]:   </os>
Oct 20 10:21:29 user nova-compute[74311]:   <features>
Oct 20 10:21:29 user nova-compute[74311]:     <acpi/>
Oct 20 10:21:29 user nova-compute[74311]:     <apic/>
Oct 20 10:21:29 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:21:29 user nova-compute[74311]:   </features>
Oct 20 10:21:29 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:21:29 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:21:29 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:21:29 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:21:29 user nova-compute[74311]:   </clock>
Oct 20 10:21:29 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:21:29 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:21:29 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:21:29 user nova-compute[74311]:   </cpu>
Oct 20 10:21:29 user nova-compute[74311]:   <devices>
Oct 20 10:21:29 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:21:29 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:21:29 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk"/>
Oct 20 10:21:29 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:21:29 user nova-compute[74311]:     </disk>
Oct 20 10:21:29 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:21:29 user nova-compute[74311]:       <mac address="fa:16:3e:51:48:ab"/>
Oct 20 10:21:29 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:21:29 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:21:29 user nova-compute[74311]:       <target dev="tapf3b77955-fd"/>
Oct 20 10:21:29 user nova-compute[74311]:     </interface>
Oct 20 10:21:29 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:21:29 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/console.log" append="off"/>
Oct 20 10:21:29 user nova-compute[74311]:     </serial>
Oct 20 10:21:29 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:21:29 user nova-compute[74311]:     <video>
Oct 20 10:21:29 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:21:29 user nova-compute[74311]:     </video>
Oct 20 10:21:29 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:21:29 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:21:29 user nova-compute[74311]:     </rng>
Oct 20 10:21:29 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:21:29 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:21:29 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:21:29 user nova-compute[74311]:     </memballoon>
Oct 20 10:21:29 user nova-compute[74311]:   </devices>
Oct 20 10:21:29 user nova-compute[74311]: </domain>
Oct 20 10:21:29 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1406375063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1406375063',id=23,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090bd6a8a14d4a308e67be7a12e47ae6',ramdisk_id='',reservation_id='r-xo0ylhoy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:21:27Z,user_data=None,user_id='0c6b76de1f054ca0973f2f9ba2eafaed',uuid=922b36b5-0575-4717-a876-dda27469ebb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "address": "fa:16:3e:51:48:ab", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b77955-fd", "ovs_interfaceid": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converting VIF {"id": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "address": "fa:16:3e:51:48:ab", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b77955-fd", "ovs_interfaceid": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=f3b77955-fd93-4421-941d-b99f0d54ebbc,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b77955-fd') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG os_vif [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=f3b77955-fd93-4421-941d-b99f0d54ebbc,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b77955-fd') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bd56111-b3dd-56b1-b761-2b5bc5887de4', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3b77955-fd, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3b77955-fd, col_values=(('qos', UUID('c7a2c78c-749a-4b2d-8022-be4ee69b8f7e')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3b77955-fd, col_values=(('external_ids', {'iface-id': 'f3b77955-fd93-4421-941d-b99f0d54ebbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:48:ab', 'vm-uuid': '922b36b5-0575-4717-a876-dda27469ebb2'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:29 user nova-compute[74311]: INFO os_vif [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=f3b77955-fd93-4421-941d-b99f0d54ebbc,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b77955-fd')
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.compute.manager [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:21:29 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Instance spawned successfully.
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.compute.manager [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-20a7f8e0-4f01-4633-9d20-8b25e715aa61 req-737a02e6-66a2-4a73-a916-209df3002055 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-20a7f8e0-4f01-4633-9d20-8b25e715aa61 req-737a02e6-66a2-4a73-a916-209df3002055 service nova] Acquiring lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-20a7f8e0-4f01-4633-9d20-8b25e715aa61 req-737a02e6-66a2-4a73-a916-209df3002055 service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-20a7f8e0-4f01-4633-9d20-8b25e715aa61 req-737a02e6-66a2-4a73-a916-209df3002055 service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-20a7f8e0-4f01-4633-9d20-8b25e715aa61 req-737a02e6-66a2-4a73-a916-209df3002055 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] No waiting events found dispatching network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:29 user nova-compute[74311]: WARNING nova.compute.manager [req-20a7f8e0-4f01-4633-9d20-8b25e715aa61 req-737a02e6-66a2-4a73-a916-209df3002055 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received unexpected event network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] No VIF found with MAC fa:16:3e:51:48:ab, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:21:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3b4ab58e-81d7-4f2d-904e-bcd086c39a4a tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.423s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:30 user nova-compute[74311]: DEBUG nova.network.neutron [req-cff94f8f-8691-4f3b-b4fa-5c4d54f15aec req-6caa3dcd-aeea-4d92-87d7-68f7ed5ba5e2 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Updated VIF entry in instance network info cache for port f3b77955-fd93-4421-941d-b99f0d54ebbc. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:21:30 user nova-compute[74311]: DEBUG nova.network.neutron [req-cff94f8f-8691-4f3b-b4fa-5c4d54f15aec req-6caa3dcd-aeea-4d92-87d7-68f7ed5ba5e2 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Updating instance_info_cache with network_info: [{"id": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "address": "fa:16:3e:51:48:ab", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b77955-fd", "ovs_interfaceid": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:21:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cff94f8f-8691-4f3b-b4fa-5c4d54f15aec req-6caa3dcd-aeea-4d92-87d7-68f7ed5ba5e2 service nova] Releasing lock "refresh_cache-922b36b5-0575-4717-a876-dda27469ebb2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:21:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:31 user nova-compute[74311]: DEBUG nova.compute.manager [req-a0ee5ef7-40a8-4681-8fad-2c098fbfaef8 req-4f989ca2-54aa-413c-b686-c5f52fb69319 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Received event network-vif-plugged-f3b77955-fd93-4421-941d-b99f0d54ebbc {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a0ee5ef7-40a8-4681-8fad-2c098fbfaef8 req-4f989ca2-54aa-413c-b686-c5f52fb69319 service nova] Acquiring lock "922b36b5-0575-4717-a876-dda27469ebb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a0ee5ef7-40a8-4681-8fad-2c098fbfaef8 req-4f989ca2-54aa-413c-b686-c5f52fb69319 service nova] Lock "922b36b5-0575-4717-a876-dda27469ebb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a0ee5ef7-40a8-4681-8fad-2c098fbfaef8 req-4f989ca2-54aa-413c-b686-c5f52fb69319 service nova] Lock "922b36b5-0575-4717-a876-dda27469ebb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:31 user nova-compute[74311]: DEBUG nova.compute.manager [req-a0ee5ef7-40a8-4681-8fad-2c098fbfaef8 req-4f989ca2-54aa-413c-b686-c5f52fb69319 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] No waiting events found dispatching network-vif-plugged-f3b77955-fd93-4421-941d-b99f0d54ebbc {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:31 user nova-compute[74311]: WARNING nova.compute.manager [req-a0ee5ef7-40a8-4681-8fad-2c098fbfaef8 req-4f989ca2-54aa-413c-b686-c5f52fb69319 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Received unexpected event network-vif-plugged-f3b77955-fd93-4421-941d-b99f0d54ebbc for instance with vm_state building and task_state spawning.
Oct 20 10:21:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-e63a690d-2665-4004-8d00-e145b848631e req-5e00d099-fec6-45ec-9da5-6b3d51f9dc40 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Received event network-vif-plugged-f3b77955-fd93-4421-941d-b99f0d54ebbc {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e63a690d-2665-4004-8d00-e145b848631e req-5e00d099-fec6-45ec-9da5-6b3d51f9dc40 service nova] Acquiring lock "922b36b5-0575-4717-a876-dda27469ebb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e63a690d-2665-4004-8d00-e145b848631e req-5e00d099-fec6-45ec-9da5-6b3d51f9dc40 service nova] Lock "922b36b5-0575-4717-a876-dda27469ebb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e63a690d-2665-4004-8d00-e145b848631e req-5e00d099-fec6-45ec-9da5-6b3d51f9dc40 service nova] Lock "922b36b5-0575-4717-a876-dda27469ebb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-e63a690d-2665-4004-8d00-e145b848631e req-5e00d099-fec6-45ec-9da5-6b3d51f9dc40 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] No waiting events found dispatching network-vif-plugged-f3b77955-fd93-4421-941d-b99f0d54ebbc {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:33 user nova-compute[74311]: WARNING nova.compute.manager [req-e63a690d-2665-4004-8d00-e145b848631e req-5e00d099-fec6-45ec-9da5-6b3d51f9dc40 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Received unexpected event network-vif-plugged-f3b77955-fd93-4421-941d-b99f0d54ebbc for instance with vm_state building and task_state spawning.
Oct 20 10:21:33 user nova-compute[74311]: DEBUG nova.compute.manager [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:21:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:21:33 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Instance spawned successfully.
Oct 20 10:21:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:21:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:21:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:21:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:21:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:21:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:21:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:21:33 user nova-compute[74311]: INFO nova.compute.manager [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Took 6.18 seconds to spawn the instance on the hypervisor.
Oct 20 10:21:33 user nova-compute[74311]: DEBUG nova.compute.manager [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:21:33 user nova-compute[74311]: INFO nova.compute.manager [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Took 7.18 seconds to build instance.
Oct 20 10:21:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-09f3b4f7-c610-4b5b-b3ef-a6c463adf160 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "922b36b5-0575-4717-a876-dda27469ebb2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.313s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG nova.objects.instance [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'flavor' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquired lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG nova.objects.instance [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'info_cache' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG nova.objects.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Object Instance<6a964d89-1f48-405b-bf64-31b9eef9ece3> lazy-loaded attributes: flavor,info_cache {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Updating instance_info_cache with network_info: [{"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Releasing lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:21:46 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Instance destroyed successfully.
Oct 20 10:21:46 user nova-compute[74311]: DEBUG nova.objects.instance [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'resources' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG nova.objects.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Object Instance<6a964d89-1f48-405b-bf64-31b9eef9ece3> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1673768130',display_name='tempest-AttachVolumeTestJSON-server-1673768130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1673768130',id=18,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJYcmNlzLpysvhxPxGUSP0j7sh5O9o25thL4eCR81ZsGW+B6UHXUeUQVHkIIazQJidMRU0G/6rN9EQv2+Mt89HRMjWiUYCfGHIzOVJ/WhTEW9pqoD8o/FnFRAAvE/JYDw==',key_name='tempest-keypair-2078286093',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f725dba626242d6ada4ccceab72c55c',ramdisk_id='',reservation_id='r-dtf2wxoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1992975846',owner_user_name='tempest-AttachVolumeTestJSON-1992975846-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:19:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3599c6c5ec984a3599dbdd732ffd0977',uuid=6a964d89-1f48-405b-bf64-31b9eef9ece3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converting VIF {"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG os_vif [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98eb8ce2-6b, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a32808cb-ae38-4ef5-99bc-ae4ff36117d8) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:46 user nova-compute[74311]: INFO os_vif [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b')
Oct 20 10:21:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:21:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfIEDNey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:21:46 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:21:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b657ae99-349c-484b-ae74-fb7564f9edf7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:21:47 user nova-compute[74311]: No targets found.
Oct 20 10:21:47 user nova-compute[74311]: iSNS:
Oct 20 10:21:47 user nova-compute[74311]: No targets found.
Oct 20 10:21:47 user nova-compute[74311]: STATIC:
Oct 20 10:21:47 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:21:47 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:21:47 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:21:47 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f
Oct 20 10:21:47 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:21:47 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:21:47 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b
Oct 20 10:21:47 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:21:47 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:21:47 user nova-compute[74311]: FIRMWARE:
Oct 20 10:21:47 user nova-compute[74311]: No targets found.
Oct 20 10:21:47 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:21:47 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:21:47 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e382e90f-e6a4-41a2-92c1-3168f1c7a0ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[197dc190-cfe0-475c-b81f-d9888372f346]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:21:47 user nova-compute[74311]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:21:47 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:21:47 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:21:47 user nova-compute[74311]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:21:47 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:21:47 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1a831cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[13909af5-ecc8-4bba-94f7-71a56d2f598a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[282b661c-2397-44fb-b1d7-456f3e642ffa]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd18a645-9e90-4ccb-95eb-5aa201ef3a36]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[937bdf74-95f9-4226-bb2c-f58478e37095]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1f45eb-23c2-4009-91ec-d8aa86859dee]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93a0024-4df1-4558-80df-5e3a26f0ed36]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260]
Oct 20 10:21:47 user nova-compute[74311]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260] successful.
Oct 20 10:21:47 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9297cc-7c90-491d-92c4-4bdafbf36032]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] <== disconnect_volume: return (331ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Start _get_guest_xml network_info=[{"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '85c347c8-5928-4a43-8409-2c095962afc3', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfIEDNey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6a964d89-1f48-405b-bf64-31b9eef9ece3', 'attached_at': '', 'detached_at': '', 'volume_id': '45d09622-5546-491c-9b1d-25e121614b1b', 'serial': '45d09622-5546-491c-9b1d-25e121614b1b'}, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.objects.instance [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.objects.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Object Instance<6a964d89-1f48-405b-bf64-31b9eef9ece3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:21:47 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:21:47 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.objects.instance [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.objects.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Object Instance<6a964d89-1f48-405b-bf64-31b9eef9ece3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfIEDNey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:21:47 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:21:47 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:21:47 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b26478-264d-4e58-b7a8-50420f4a5590]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:21:47 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad3de5a-3364-4614-95bb-6f9635921b73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b] added
Oct 20 10:21:47 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd567bd-2727-49a0-9b94-069baec3a004]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[28db8daf-3111-41d6-b5ee-f375d3815f93]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VfIEDNey {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VfIEDNey" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e13a47-79ee-4e97-b47e-a3ddc2bf0a90]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VfIEDNey'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e5d04a-36fd-4072-95cb-7cf7e62354f1]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce77e544-a000-445c-bc83-c0d4abd6a2d1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:21:47 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:21:47 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:21:47 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:21:47 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e9824d-17be-46a0-8d70-5b850568f638]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260]
Oct 20 10:21:47 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260] successful.
Oct 20 10:21:47 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca63ae7-2586-4caa-b142-972547aec0bb]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8178a39-0b5b-482c-82a0-15361da5f53d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:21:47 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:21:47 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:21:47 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:21:47 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:21:47 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:21:47 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d1a446-930a-4eeb-a71b-3fc2bf85fe46]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:21:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:48 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:21:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfIEDNey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:21:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:21:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23234623166636430', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:21:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234623166636430', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:21:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1673768130',display_name='tempest-AttachVolumeTestJSON-server-1673768130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1673768130',id=18,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJYcmNlzLpysvhxPxGUSP0j7sh5O9o25thL4eCR81ZsGW+B6UHXUeUQVHkIIazQJidMRU0G/6rN9EQv2+Mt89HRMjWiUYCfGHIzOVJ/WhTEW9pqoD8o/FnFRAAvE/JYDw==',key_name='tempest-keypair-2078286093',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f725dba626242d6ada4ccceab72c55c',ramdisk_id='',reservation_id='r-dtf2wxoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1992975846',owner_user_name='tempest-AttachVolumeTestJSON-1992975846-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:19:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3599c6c5ec984a3599dbdd732ffd0977',uuid=6a964d89-1f48-405b-bf64-31b9eef9ece3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:21:48 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converting VIF {"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:21:48 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:21:48 user nova-compute[74311]: DEBUG nova.objects.instance [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:48 user nova-compute[74311]: DEBUG nova.objects.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Object Instance<6a964d89-1f48-405b-bf64-31b9eef9ece3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:21:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:21:48 user nova-compute[74311]:   <uuid>6a964d89-1f48-405b-bf64-31b9eef9ece3</uuid>
Oct 20 10:21:48 user nova-compute[74311]:   <name>instance-00000012</name>
Oct 20 10:21:48 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:21:48 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:21:48 user nova-compute[74311]:   <metadata>
Oct 20 10:21:48 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:21:48 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:21:48 user nova-compute[74311]:       <nova:name>tempest-AttachVolumeTestJSON-server-1673768130</nova:name>
Oct 20 10:21:48 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:21:47</nova:creationTime>
Oct 20 10:21:48 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:21:48 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:21:48 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:21:48 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:21:48 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:21:48 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:21:48 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:21:48 user nova-compute[74311]:       <nova:owner>
Oct 20 10:21:48 user nova-compute[74311]:         <nova:user uuid="3599c6c5ec984a3599dbdd732ffd0977">tempest-AttachVolumeTestJSON-1992975846-project-member</nova:user>
Oct 20 10:21:48 user nova-compute[74311]:         <nova:project uuid="5f725dba626242d6ada4ccceab72c55c">tempest-AttachVolumeTestJSON-1992975846</nova:project>
Oct 20 10:21:48 user nova-compute[74311]:       </nova:owner>
Oct 20 10:21:48 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:21:48 user nova-compute[74311]:       <nova:ports>
Oct 20 10:21:48 user nova-compute[74311]:         <nova:port uuid="98eb8ce2-6b43-43ac-99f6-e908d0688d20">
Oct 20 10:21:48 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 10:21:48 user nova-compute[74311]:         </nova:port>
Oct 20 10:21:48 user nova-compute[74311]:       </nova:ports>
Oct 20 10:21:48 user nova-compute[74311]:     </nova:instance>
Oct 20 10:21:48 user nova-compute[74311]:   </metadata>
Oct 20 10:21:48 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:21:48 user nova-compute[74311]:     <system>
Oct 20 10:21:48 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:21:48 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:21:48 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:21:48 user nova-compute[74311]:       <entry name="serial">6a964d89-1f48-405b-bf64-31b9eef9ece3</entry>
Oct 20 10:21:48 user nova-compute[74311]:       <entry name="uuid">6a964d89-1f48-405b-bf64-31b9eef9ece3</entry>
Oct 20 10:21:48 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:21:48 user nova-compute[74311]:     </system>
Oct 20 10:21:48 user nova-compute[74311]:   </sysinfo>
Oct 20 10:21:48 user nova-compute[74311]:   <os>
Oct 20 10:21:48 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:21:48 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:21:48 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:21:48 user nova-compute[74311]:   </os>
Oct 20 10:21:48 user nova-compute[74311]:   <features>
Oct 20 10:21:48 user nova-compute[74311]:     <acpi/>
Oct 20 10:21:48 user nova-compute[74311]:     <apic/>
Oct 20 10:21:48 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:21:48 user nova-compute[74311]:   </features>
Oct 20 10:21:48 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:21:48 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:21:48 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:21:48 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:21:48 user nova-compute[74311]:   </clock>
Oct 20 10:21:48 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:21:48 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:21:48 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:21:48 user nova-compute[74311]:   </cpu>
Oct 20 10:21:48 user nova-compute[74311]:   <devices>
Oct 20 10:21:48 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:21:48 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:21:48 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk"/>
Oct 20 10:21:48 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:21:48 user nova-compute[74311]:     </disk>
Oct 20 10:21:48 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:21:48 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:21:48 user nova-compute[74311]:       <source dev="/dev/sdb"/>
Oct 20 10:21:48 user nova-compute[74311]:       <target dev="vdb" bus="virtio"/>
Oct 20 10:21:48 user nova-compute[74311]:       <serial>45d09622-5546-491c-9b1d-25e121614b1b</serial>
Oct 20 10:21:48 user nova-compute[74311]:     </disk>
Oct 20 10:21:48 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:21:48 user nova-compute[74311]:       <mac address="fa:16:3e:6e:64:47"/>
Oct 20 10:21:48 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:21:48 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:21:48 user nova-compute[74311]:       <target dev="tap98eb8ce2-6b"/>
Oct 20 10:21:48 user nova-compute[74311]:     </interface>
Oct 20 10:21:48 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:21:48 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/console.log" append="off"/>
Oct 20 10:21:48 user nova-compute[74311]:     </serial>
Oct 20 10:21:48 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:21:48 user nova-compute[74311]:     <video>
Oct 20 10:21:48 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:21:48 user nova-compute[74311]:     </video>
Oct 20 10:21:48 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:21:48 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:21:48 user nova-compute[74311]:     </rng>
Oct 20 10:21:48 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:21:48 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:21:48 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:21:48 user nova-compute[74311]:     </memballoon>
Oct 20 10:21:48 user nova-compute[74311]:   </devices>
Oct 20 10:21:48 user nova-compute[74311]: </domain>
Oct 20 10:21:48 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:21:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG nova.objects.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Object Instance<6a964d89-1f48-405b-bf64-31b9eef9ece3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Cannot resize image /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'migration_context' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG nova.objects.base [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Object Instance<6a964d89-1f48-405b-bf64-31b9eef9ece3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1673768130',display_name='tempest-AttachVolumeTestJSON-server-1673768130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1673768130',id=18,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJYcmNlzLpysvhxPxGUSP0j7sh5O9o25thL4eCR81ZsGW+B6UHXUeUQVHkIIazQJidMRU0G/6rN9EQv2+Mt89HRMjWiUYCfGHIzOVJ/WhTEW9pqoD8o/FnFRAAvE/JYDw==',key_name='tempest-keypair-2078286093',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5f725dba626242d6ada4ccceab72c55c',ramdisk_id='',reservation_id='r-dtf2wxoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1992975846',owner_user_name='tempest-AttachVolumeTestJSON-1992975846-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:19:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3599c6c5ec984a3599dbdd732ffd0977',uuid=6a964d89-1f48-405b-bf64-31b9eef9ece3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converting VIF {"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG os_vif [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f2e914d-200e-57a1-807d-49598e3fc93d', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98eb8ce2-6b, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98eb8ce2-6b, col_values=(('qos', UUID('3ab9ec4d-777f-43b6-99f7-4d312a6e6a4c')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98eb8ce2-6b, col_values=(('external_ids', {'iface-id': '98eb8ce2-6b43-43ac-99f6-e908d0688d20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:64:47', 'vm-uuid': '6a964d89-1f48-405b-bf64-31b9eef9ece3'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:49 user nova-compute[74311]: INFO os_vif [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b')
Oct 20 10:21:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-87a46e00-a0eb-433f-8569-7dcd4aae0a74 req-76f42b9a-0397-4e85-8cb0-740cbf263ba4 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-87a46e00-a0eb-433f-8569-7dcd4aae0a74 req-76f42b9a-0397-4e85-8cb0-740cbf263ba4 service nova] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-87a46e00-a0eb-433f-8569-7dcd4aae0a74 req-76f42b9a-0397-4e85-8cb0-740cbf263ba4 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-87a46e00-a0eb-433f-8569-7dcd4aae0a74 req-76f42b9a-0397-4e85-8cb0-740cbf263ba4 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-87a46e00-a0eb-433f-8569-7dcd4aae0a74 req-76f42b9a-0397-4e85-8cb0-740cbf263ba4 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] No waiting events found dispatching network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:51 user nova-compute[74311]: WARNING nova.compute.manager [req-87a46e00-a0eb-433f-8569-7dcd4aae0a74 req-76f42b9a-0397-4e85-8cb0-740cbf263ba4 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received unexpected event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 for instance with vm_state stopped and task_state powering-on.
Oct 20 10:21:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:21:53 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Instance rebooted successfully.
Oct 20 10:21:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0a498eb8-7cc9-42a4-8882-2d1f98f853ad tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:21:53 user nova-compute[74311]: DEBUG nova.compute.manager [req-2e8fa7b9-05e6-4647-8ffd-2196d305a290 req-018ad77c-f504-4353-8eac-658f16e56520 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e8fa7b9-05e6-4647-8ffd-2196d305a290 req-018ad77c-f504-4353-8eac-658f16e56520 service nova] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e8fa7b9-05e6-4647-8ffd-2196d305a290 req-018ad77c-f504-4353-8eac-658f16e56520 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e8fa7b9-05e6-4647-8ffd-2196d305a290 req-018ad77c-f504-4353-8eac-658f16e56520 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:53 user nova-compute[74311]: DEBUG nova.compute.manager [req-2e8fa7b9-05e6-4647-8ffd-2196d305a290 req-018ad77c-f504-4353-8eac-658f16e56520 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] No waiting events found dispatching network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:53 user nova-compute[74311]: WARNING nova.compute.manager [req-2e8fa7b9-05e6-4647-8ffd-2196d305a290 req-018ad77c-f504-4353-8eac-658f16e56520 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received unexpected event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 for instance with vm_state stopped and task_state powering-on.
Oct 20 10:21:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:57 user nova-compute[74311]: INFO nova.virt.block_device [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Booting with volume 24cea100-4f10-4efd-909a-6cf30a418e53 at /dev/vdc
Oct 20 10:21:57 user nova-compute[74311]: DEBUG os_brick.utils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f90d8e-73aa-4ab5-8d6c-0547f4824dd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[944a1de4-fe61-4970-9924-88d94d5bb92f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f064061-5d9a-408d-83e2-8bc5f36d6dff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7b4288-8854-484c-8995-c9e73963227b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:21:57 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57370e4-bda5-4730-a0df-da3bc4ed7db3]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG os_brick.utils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating existing volume attachment record: c4a0ac0d-fec7-4a10-9df0-64330c26dc08 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:57 user nova-compute[74311]: INFO nova.compute.manager [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Terminating instance
Oct 20 10:21:57 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG nova.compute.manager [req-f8ea8695-197a-4f8e-9b01-90c98d992a67 req-d30998c3-5a0c-4410-85a4-80c34dd1224b service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received event network-vif-unplugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f8ea8695-197a-4f8e-9b01-90c98d992a67 req-d30998c3-5a0c-4410-85a4-80c34dd1224b service nova] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f8ea8695-197a-4f8e-9b01-90c98d992a67 req-d30998c3-5a0c-4410-85a4-80c34dd1224b service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f8ea8695-197a-4f8e-9b01-90c98d992a67 req-d30998c3-5a0c-4410-85a4-80c34dd1224b service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG nova.compute.manager [req-f8ea8695-197a-4f8e-9b01-90c98d992a67 req-d30998c3-5a0c-4410-85a4-80c34dd1224b service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] No waiting events found dispatching network-vif-unplugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:21:57 user nova-compute[74311]: DEBUG nova.compute.manager [req-f8ea8695-197a-4f8e-9b01-90c98d992a67 req-d30998c3-5a0c-4410-85a4-80c34dd1224b service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received event network-vif-unplugged-5b30634a-aea2-4b86-b000-a108c2fb306b for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:58 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Instance destroyed successfully.
Oct 20 10:21:58 user nova-compute[74311]: DEBUG nova.objects.instance [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lazy-loading 'resources' on Instance uuid 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T10:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-914056221',display_name='tempest-ServerActionsTestOtherA-server-276569739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-914056221',id=15,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPveX+yAZpnzBzilkcm82E6+RHpmB0Xb/tXYm16sLT8H7wqp8K2NVg/iZiaW1MVGWyDcchuyOYeUsUsFBwuN8qHZxREI7vXeZa+FEOEsV4eO0AeOp/iLUFR9gTFEBuIiQ==',key_name='tempest-keypair-646262168',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:18:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-testi5fh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:18:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=54c0cdc3-ebcd-46bf-9a6e-be7b6e450897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "5b30634a-aea2-4b86-b000-a108c2fb306b", "address": "fa:16:3e:67:96:1e", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b30634a-ae", "ovs_interfaceid": "5b30634a-aea2-4b86-b000-a108c2fb306b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=5b30634a-aea2-4b86-b000-a108c2fb306b,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b30634a-ae') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG os_vif [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=5b30634a-aea2-4b86-b000-a108c2fb306b,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b30634a-ae') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b30634a-ae, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46a62b25-b668-4ac4-9cfd-f37269c69483) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:21:58 user nova-compute[74311]: INFO os_vif [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:96:1e,bridge_name='br-int',has_traffic_filtering=True,id=5b30634a-aea2-4b86-b000-a108c2fb306b,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b30634a-ae')
Oct 20 10:21:58 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Deleting instance files /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897_del
Oct 20 10:21:58 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Deletion of /opt/stack/data/nova/instances/54c0cdc3-ebcd-46bf-9a6e-be7b6e450897_del complete
Oct 20 10:21:58 user nova-compute[74311]: INFO nova.compute.manager [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 20 10:21:58 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:21:58 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:21:59 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:21:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:21:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:21:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:21:59 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:21:59 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:21:59 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Took 0.97 seconds to deallocate network for instance.
Oct 20 10:21:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-90acf73a-c1e6-4639-91d9-1c03d63e4e50 req-768508eb-24a7-4505-97bc-b7f2e7931130 service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received event network-vif-deleted-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:21:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:21:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:21:59 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Updating instance_info_cache with network_info: [{"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:21:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:21:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:21:59 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:21:59 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:21:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:21:59 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Deleted allocations for instance 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897
Oct 20 10:22:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-873eabdb-c18c-47bd-adb7-631db7bb8058 req-2aba299e-b859-4544-8fd7-51ef4e9580ee service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received event network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-873eabdb-c18c-47bd-adb7-631db7bb8058 req-2aba299e-b859-4544-8fd7-51ef4e9580ee service nova] Acquiring lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-873eabdb-c18c-47bd-adb7-631db7bb8058 req-2aba299e-b859-4544-8fd7-51ef4e9580ee service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-873eabdb-c18c-47bd-adb7-631db7bb8058 req-2aba299e-b859-4544-8fd7-51ef4e9580ee service nova] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-873eabdb-c18c-47bd-adb7-631db7bb8058 req-2aba299e-b859-4544-8fd7-51ef4e9580ee service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] No waiting events found dispatching network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:00 user nova-compute[74311]: WARNING nova.compute.manager [req-873eabdb-c18c-47bd-adb7-631db7bb8058 req-2aba299e-b859-4544-8fd7-51ef4e9580ee service nova] [instance: 54c0cdc3-ebcd-46bf-9a6e-be7b6e450897] Received unexpected event network-vif-plugged-5b30634a-aea2-4b86-b000-a108c2fb306b for instance with vm_state deleted and task_state None.
Oct 20 10:22:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f17044a8-d1fc-49b3-b313-638457d61b04 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "54c0cdc3-ebcd-46bf-9a6e-be7b6e450897" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.595s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:01 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:22:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:03 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:22:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:03 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:22:04 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:22:05 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:22:05 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:22:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:05 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:22:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:05 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.265s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:22:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:22:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:22:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:09 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:22:09 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7474MB free_disk=25.267261505126953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 4011fd9a-7109-46b7-b77e-51c29e36a7d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance dcecd43c-0d21-4413-8fa5-02856f450b6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 922b36b5-0575-4717-a876-dda27469ebb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:22:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.602s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:10 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:22:10 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:22:10 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:22:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:22:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG nova.objects.instance [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lazy-loading 'flavor' on Instance uuid 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:15 user nova-compute[74311]: INFO nova.compute.manager [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Attaching volume f375fade-d000-4d2e-ba16-066b56a75692 to /dev/vdb
Oct 20 10:22:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG os_brick.utils [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddb475c-f9b4-41c2-aebd-daa8ef1e2286]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[952a0d3f-4a3b-46ea-b37b-01cecf8cd571]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcc2df0-7320-4068-9312-9d3f1306b1a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b6a3d0-0fbd-4bad-8e2e-b301890e2a3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:22:15 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:22:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[64725afe-7de0-4dac-a9ed-f0cb6d166cad]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG os_brick.utils [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:22:15 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Updating existing volume attachment record: b9f2ea0f-47b7-4fc9-a464-2fd2005922f6 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:22:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:22 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:22:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:22 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:22:22 user nova-compute[74311]: INFO nova.compute.claims [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Claim successful on node user
Oct 20 10:22:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:22:23 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:22:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG nova.policy [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '497267775cc747b8b65b8bcb276806ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e99de7cef4b4569a497f77325515680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:22:23 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Creating image(s)
Oct 20 10:22:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "/opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "/opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.229s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.232s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk 1073741824" returned: 0 in 0.070s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Successfully created port: e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.199s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Cannot resize image /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Ensure instance console log exists: /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Successfully updated port: e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "refresh_cache-cfb50bd6-42e6-4f8a-af8c-712e52644cb5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquired lock "refresh_cache-cfb50bd6-42e6-4f8a-af8c-712e52644cb5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-96e09971-78bf-4f57-a279-6cd33fdfe629 req-81b56149-2c37-4d38-a21e-d50b7a4414fc service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Received event network-changed-e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-96e09971-78bf-4f57-a279-6cd33fdfe629 req-81b56149-2c37-4d38-a21e-d50b7a4414fc service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Refreshing instance network info cache due to event network-changed-e08b7c03-51f2-450b-b639-a16cf0cd5214. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-96e09971-78bf-4f57-a279-6cd33fdfe629 req-81b56149-2c37-4d38-a21e-d50b7a4414fc service nova] Acquiring lock "refresh_cache-cfb50bd6-42e6-4f8a-af8c-712e52644cb5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Updating instance_info_cache with network_info: [{"id": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "address": "fa:16:3e:44:5f:40", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08b7c03-51", "ovs_interfaceid": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Releasing lock "refresh_cache-cfb50bd6-42e6-4f8a-af8c-712e52644cb5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Instance network_info: |[{"id": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "address": "fa:16:3e:44:5f:40", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08b7c03-51", "ovs_interfaceid": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-96e09971-78bf-4f57-a279-6cd33fdfe629 req-81b56149-2c37-4d38-a21e-d50b7a4414fc service nova] Acquired lock "refresh_cache-cfb50bd6-42e6-4f8a-af8c-712e52644cb5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.network.neutron [req-96e09971-78bf-4f57-a279-6cd33fdfe629 req-81b56149-2c37-4d38-a21e-d50b7a4414fc service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Refreshing network info cache for port e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Start _get_guest_xml network_info=[{"id": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "address": "fa:16:3e:44:5f:40", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08b7c03-51", "ovs_interfaceid": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:22:25 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:22:25 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1448945593',display_name='tempest-AttachVolumeNegativeTest-server-1448945593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1448945593',id=24,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyhwcwXWTCkFAxqhOK3I4yKV1HFHdMwqt0hLrFZaSsPto+d0y2F3ufj+YukdrbpOjYbGHrElXcDGL27TzBKjwPAAzZMEaxp1dRL3MlI0oVVaKACoNwvj1xegWTpw/4+Ww==',key_name='tempest-keypair-1583343724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e99de7cef4b4569a497f77325515680',ramdisk_id='',reservation_id='r-69tg53on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-543930091',owner_user_name='tempest-AttachVolumeNegativeTest-543930091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:22:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497267775cc747b8b65b8bcb276806ba',uuid=cfb50bd6-42e6-4f8a-af8c-712e52644cb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "address": "fa:16:3e:44:5f:40", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08b7c03-51", "ovs_interfaceid": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converting VIF {"id": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "address": "fa:16:3e:44:5f:40", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08b7c03-51", "ovs_interfaceid": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:5f:40,bridge_name='br-int',has_traffic_filtering=True,id=e08b7c03-51f2-450b-b639-a16cf0cd5214,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08b7c03-51') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.objects.instance [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'pci_devices' on Instance uuid cfb50bd6-42e6-4f8a-af8c-712e52644cb5 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:22:25 user nova-compute[74311]:   <uuid>cfb50bd6-42e6-4f8a-af8c-712e52644cb5</uuid>
Oct 20 10:22:25 user nova-compute[74311]:   <name>instance-00000018</name>
Oct 20 10:22:25 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:22:25 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:22:25 user nova-compute[74311]:   <metadata>
Oct 20 10:22:25 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:22:25 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:22:25 user nova-compute[74311]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1448945593</nova:name>
Oct 20 10:22:25 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:22:25</nova:creationTime>
Oct 20 10:22:25 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:22:25 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:22:25 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:22:25 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:22:25 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:22:25 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:22:25 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:22:25 user nova-compute[74311]:       <nova:owner>
Oct 20 10:22:25 user nova-compute[74311]:         <nova:user uuid="497267775cc747b8b65b8bcb276806ba">tempest-AttachVolumeNegativeTest-543930091-project-member</nova:user>
Oct 20 10:22:25 user nova-compute[74311]:         <nova:project uuid="4e99de7cef4b4569a497f77325515680">tempest-AttachVolumeNegativeTest-543930091</nova:project>
Oct 20 10:22:25 user nova-compute[74311]:       </nova:owner>
Oct 20 10:22:25 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:22:25 user nova-compute[74311]:       <nova:ports>
Oct 20 10:22:25 user nova-compute[74311]:         <nova:port uuid="e08b7c03-51f2-450b-b639-a16cf0cd5214">
Oct 20 10:22:25 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 10:22:25 user nova-compute[74311]:         </nova:port>
Oct 20 10:22:25 user nova-compute[74311]:       </nova:ports>
Oct 20 10:22:25 user nova-compute[74311]:     </nova:instance>
Oct 20 10:22:25 user nova-compute[74311]:   </metadata>
Oct 20 10:22:25 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:22:25 user nova-compute[74311]:     <system>
Oct 20 10:22:25 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:22:25 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:22:25 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:22:25 user nova-compute[74311]:       <entry name="serial">cfb50bd6-42e6-4f8a-af8c-712e52644cb5</entry>
Oct 20 10:22:25 user nova-compute[74311]:       <entry name="uuid">cfb50bd6-42e6-4f8a-af8c-712e52644cb5</entry>
Oct 20 10:22:25 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:22:25 user nova-compute[74311]:     </system>
Oct 20 10:22:25 user nova-compute[74311]:   </sysinfo>
Oct 20 10:22:25 user nova-compute[74311]:   <os>
Oct 20 10:22:25 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:22:25 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:22:25 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:22:25 user nova-compute[74311]:   </os>
Oct 20 10:22:25 user nova-compute[74311]:   <features>
Oct 20 10:22:25 user nova-compute[74311]:     <acpi/>
Oct 20 10:22:25 user nova-compute[74311]:     <apic/>
Oct 20 10:22:25 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:22:25 user nova-compute[74311]:   </features>
Oct 20 10:22:25 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:22:25 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:22:25 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:22:25 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:22:25 user nova-compute[74311]:   </clock>
Oct 20 10:22:25 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:22:25 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:22:25 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:22:25 user nova-compute[74311]:   </cpu>
Oct 20 10:22:25 user nova-compute[74311]:   <devices>
Oct 20 10:22:25 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:22:25 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:22:25 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk"/>
Oct 20 10:22:25 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:22:25 user nova-compute[74311]:     </disk>
Oct 20 10:22:25 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:22:25 user nova-compute[74311]:       <mac address="fa:16:3e:44:5f:40"/>
Oct 20 10:22:25 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:25 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:22:25 user nova-compute[74311]:       <target dev="tape08b7c03-51"/>
Oct 20 10:22:25 user nova-compute[74311]:     </interface>
Oct 20 10:22:25 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:22:25 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/console.log" append="off"/>
Oct 20 10:22:25 user nova-compute[74311]:     </serial>
Oct 20 10:22:25 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:22:25 user nova-compute[74311]:     <video>
Oct 20 10:22:25 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:25 user nova-compute[74311]:     </video>
Oct 20 10:22:25 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:22:25 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:22:25 user nova-compute[74311]:     </rng>
Oct 20 10:22:25 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:22:25 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:22:25 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:22:25 user nova-compute[74311]:     </memballoon>
Oct 20 10:22:25 user nova-compute[74311]:   </devices>
Oct 20 10:22:25 user nova-compute[74311]: </domain>
Oct 20 10:22:25 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1448945593',display_name='tempest-AttachVolumeNegativeTest-server-1448945593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1448945593',id=24,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyhwcwXWTCkFAxqhOK3I4yKV1HFHdMwqt0hLrFZaSsPto+d0y2F3ufj+YukdrbpOjYbGHrElXcDGL27TzBKjwPAAzZMEaxp1dRL3MlI0oVVaKACoNwvj1xegWTpw/4+Ww==',key_name='tempest-keypair-1583343724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e99de7cef4b4569a497f77325515680',ramdisk_id='',reservation_id='r-69tg53on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-543930091',owner_user_name='tempest-AttachVolumeNegativeTest-543930091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:22:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497267775cc747b8b65b8bcb276806ba',uuid=cfb50bd6-42e6-4f8a-af8c-712e52644cb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "address": "fa:16:3e:44:5f:40", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08b7c03-51", "ovs_interfaceid": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converting VIF {"id": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "address": "fa:16:3e:44:5f:40", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08b7c03-51", "ovs_interfaceid": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:5f:40,bridge_name='br-int',has_traffic_filtering=True,id=e08b7c03-51f2-450b-b639-a16cf0cd5214,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08b7c03-51') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG os_vif [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:5f:40,bridge_name='br-int',has_traffic_filtering=True,id=e08b7c03-51f2-450b-b639-a16cf0cd5214,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08b7c03-51') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab7af574-619c-5cf7-9477-7a7f8e5a56a8', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape08b7c03-51, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape08b7c03-51, col_values=(('qos', UUID('f730341c-2b50-47e9-8c77-b9f569f124a7')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape08b7c03-51, col_values=(('external_ids', {'iface-id': 'e08b7c03-51f2-450b-b639-a16cf0cd5214', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:5f:40', 'vm-uuid': 'cfb50bd6-42e6-4f8a-af8c-712e52644cb5'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:25 user nova-compute[74311]: INFO os_vif [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:5f:40,bridge_name='br-int',has_traffic_filtering=True,id=e08b7c03-51f2-450b-b639-a16cf0cd5214,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08b7c03-51')
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:22:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No VIF found with MAC fa:16:3e:44:5f:40, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:22:26 user nova-compute[74311]: DEBUG nova.network.neutron [req-96e09971-78bf-4f57-a279-6cd33fdfe629 req-81b56149-2c37-4d38-a21e-d50b7a4414fc service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Updated VIF entry in instance network info cache for port e08b7c03-51f2-450b-b639-a16cf0cd5214. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:22:26 user nova-compute[74311]: DEBUG nova.network.neutron [req-96e09971-78bf-4f57-a279-6cd33fdfe629 req-81b56149-2c37-4d38-a21e-d50b7a4414fc service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Updating instance_info_cache with network_info: [{"id": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "address": "fa:16:3e:44:5f:40", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08b7c03-51", "ovs_interfaceid": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:22:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-96e09971-78bf-4f57-a279-6cd33fdfe629 req-81b56149-2c37-4d38-a21e-d50b7a4414fc service nova] Releasing lock "refresh_cache-cfb50bd6-42e6-4f8a-af8c-712e52644cb5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:22:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-702e468e-1f71-4f05-b60c-1e4184ec117e req-adba1477-4638-4d91-ab03-7f0b04a77e20 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Received event network-vif-plugged-e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-702e468e-1f71-4f05-b60c-1e4184ec117e req-adba1477-4638-4d91-ab03-7f0b04a77e20 service nova] Acquiring lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-702e468e-1f71-4f05-b60c-1e4184ec117e req-adba1477-4638-4d91-ab03-7f0b04a77e20 service nova] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-702e468e-1f71-4f05-b60c-1e4184ec117e req-adba1477-4638-4d91-ab03-7f0b04a77e20 service nova] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-702e468e-1f71-4f05-b60c-1e4184ec117e req-adba1477-4638-4d91-ab03-7f0b04a77e20 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] No waiting events found dispatching network-vif-plugged-e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:27 user nova-compute[74311]: WARNING nova.compute.manager [req-702e468e-1f71-4f05-b60c-1e4184ec117e req-adba1477-4638-4d91-ab03-7f0b04a77e20 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Received unexpected event network-vif-plugged-e08b7c03-51f2-450b-b639-a16cf0cd5214 for instance with vm_state building and task_state spawning.
Oct 20 10:22:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:28 user nova-compute[74311]: INFO nova.compute.manager [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Rescuing
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquired lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.network.neutron [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.compute.manager [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:22:28 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Creating image(s)
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Ensure instance console log exists: /opt/stack/data/nova/instances/4011fd9a-7109-46b7-b77e-51c29e36a7d1/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Start _get_guest_xml network_info=[{"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "address": "fa:16:3e:2e:ca:10", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b7d551-6e", "ovs_interfaceid": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "address": "fa:16:3e:83:21:b5", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80e2f85-5f", "ovs_interfaceid": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "address": "fa:16:3e:fa:10:3e", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36f74b7-eb", "ovs_interfaceid": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "address": "fa:16:3e:b4:ae:35", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff91ee0f-4d", "ovs_interfaceid": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '077d3368-b975-4e93-8ae1-fc8bffd0a691', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgiYtczr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4011fd9a-7109-46b7-b77e-51c29e36a7d1', 'attached_at': '', 'detached_at': '', 'volume_id': '3ad8b3b1-d047-46c9-b41b-6e3372b1eedd', 'serial': '3ad8b3b1-d047-46c9-b41b-6e3372b1eedd'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': 'ae9f65fb-672d-46f6-9595-a2349865e931', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPlmtTEe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4011fd9a-7109-46b7-b77e-51c29e36a7d1', 'attached_at': '', 'detached_at': '', 'volume_id': '9dc740f6-a328-44da-88b7-07275d6889f9', 'serial': '9dc740f6-a328-44da-88b7-07275d6889f9'}, 'boot_index': 1, 'device_type': 'disk', 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': 'c4a0ac0d-fec7-4a10-9df0-64330c26dc08', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zawTdpJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4011fd9a-7109-46b7-b77e-51c29e36a7d1', 'attached_at': '', 'detached_at': '', 'volume_id': '24cea100-4f10-4efd-909a-6cf30a418e53', 'serial': '24cea100-4f10-4efd-909a-6cf30a418e53'}, 'boot_index': 2, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:22:28 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:22:28 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgiYtczr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:22:28 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:22:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:22:28 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:22:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:22:28 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:22:28 user nova-compute[74311]: DEBUG nova.network.neutron [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Updating instance_info_cache with network_info: [{"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66d2b83-6322-4bae-9b14-c2765fe05387]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:22:28 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Releasing lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[747c7a1e-ff14-4e3e-8751-722c1f9efdda]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd] added
Oct 20 10:22:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.043s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4051e693-ebc7-47a9-9fdc-6ed328738b44]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca98b00-92e3-4036-a9a8-0cad2d410cca]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgiYtczr {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgiYtczr" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a73fed-f4a5-4e9d-97dc-4df19fed7e43]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xgiYtczr'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eba18b2-5b73-41fa-8c51-af65bf7e5727]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53e7822-202f-46d4-9863-3cfa41eca3c3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:28 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:28 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:28 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:28 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0be5ac-91fb-412c-8185-6d5ce1b61315]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd, portal: 172.16.0.220,3260]
Oct 20 10:22:28 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd, portal: 172.16.0.220,3260] successful.
Oct 20 10:22:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9dc470-aca9-4d5a-9970-243832d30484]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[35eea515-485b-4b42-86ac-98c0e487e020]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:29 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:29 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:29 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:29 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:29 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:29 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:29 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:29 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f293827-2803-45fb-b4b1-f43c74a2afff]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgiYtczr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:29 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Instance destroyed successfully.
Oct 20 10:22:29 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Attempting rescue
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74311) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Instance directory exists: not creating {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 10:22:29 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Creating image(s)
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "/opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "/opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.objects.instance [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'trusted_certs' on Instance uuid c0f944dd-b256-4b47-9e2e-7ba50188f636 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.206s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.rescue {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.rescue" returned: 0 in 0.055s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.objects.instance [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'migration_context' on Instance uuid c0f944dd-b256-4b47-9e2e-7ba50188f636 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.objects.base [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<c0f944dd-b256-4b47-9e2e-7ba50188f636> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Start _get_guest_xml network_info=[{"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "vif_mac": "fa:16:3e:8a:ce:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.objects.instance [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'resources' on Instance uuid c0f944dd-b256-4b47-9e2e-7ba50188f636 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.objects.base [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<c0f944dd-b256-4b47-9e2e-7ba50188f636> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.objects.instance [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'numa_topology' on Instance uuid c0f944dd-b256-4b47-9e2e-7ba50188f636 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.objects.base [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<c0f944dd-b256-4b47-9e2e-7ba50188f636> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:22:29 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:22:29 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.objects.instance [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'vcpu_model' on Instance uuid c0f944dd-b256-4b47-9e2e-7ba50188f636 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.objects.base [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<c0f944dd-b256-4b47-9e2e-7ba50188f636> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-175292247',display_name='tempest-ServerRescueNegativeTestJSON-server-175292247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-175292247',id=19,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07b7c2a684a3466eba4799473c725066',ramdisk_id='',reservation_id='r-iqhej24v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-320006607',owner_user_name='tempest-ServerRescueNegativeTestJSON-320006607-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:17:49Z,user_data=None,user_id='302a265253b14a19be48546953baaebf',uuid=c0f944dd-b256-4b47-9e2e-7ba50188f636,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "vif_mac": "fa:16:3e:8a:ce:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converting VIF {"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "vif_mac": "fa:16:3e:8a:ce:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:ce:2a,bridge_name='br-int',has_traffic_filtering=True,id=131d4c92-ce07-4319-9261-609009fbdaee,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d4c92-ce') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.objects.instance [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'pci_devices' on Instance uuid c0f944dd-b256-4b47-9e2e-7ba50188f636 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-51314ea5-1bd7-4b7b-9d0b-d16cec4422e0 req-b5546de3-c67e-492f-a408-ca2222497ab8 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Received event network-vif-plugged-e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-51314ea5-1bd7-4b7b-9d0b-d16cec4422e0 req-b5546de3-c67e-492f-a408-ca2222497ab8 service nova] Acquiring lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-51314ea5-1bd7-4b7b-9d0b-d16cec4422e0 req-b5546de3-c67e-492f-a408-ca2222497ab8 service nova] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-51314ea5-1bd7-4b7b-9d0b-d16cec4422e0 req-b5546de3-c67e-492f-a408-ca2222497ab8 service nova] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-51314ea5-1bd7-4b7b-9d0b-d16cec4422e0 req-b5546de3-c67e-492f-a408-ca2222497ab8 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] No waiting events found dispatching network-vif-plugged-e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:29 user nova-compute[74311]: WARNING nova.compute.manager [req-51314ea5-1bd7-4b7b-9d0b-d16cec4422e0 req-b5546de3-c67e-492f-a408-ca2222497ab8 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Received unexpected event network-vif-plugged-e08b7c03-51f2-450b-b639-a16cf0cd5214 for instance with vm_state building and task_state spawning.
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.objects.base [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<c0f944dd-b256-4b47-9e2e-7ba50188f636> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:22:29 user nova-compute[74311]:   <uuid>c0f944dd-b256-4b47-9e2e-7ba50188f636</uuid>
Oct 20 10:22:29 user nova-compute[74311]:   <name>instance-00000013</name>
Oct 20 10:22:29 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:22:29 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:22:29 user nova-compute[74311]:   <metadata>
Oct 20 10:22:29 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:22:29 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:22:29 user nova-compute[74311]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-175292247</nova:name>
Oct 20 10:22:29 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:22:29</nova:creationTime>
Oct 20 10:22:29 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:22:29 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:22:29 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:22:29 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:22:29 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:22:29 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:22:29 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:22:29 user nova-compute[74311]:       <nova:owner>
Oct 20 10:22:29 user nova-compute[74311]:         <nova:user uuid="302a265253b14a19be48546953baaebf">tempest-ServerRescueNegativeTestJSON-320006607-project-member</nova:user>
Oct 20 10:22:29 user nova-compute[74311]:         <nova:project uuid="07b7c2a684a3466eba4799473c725066">tempest-ServerRescueNegativeTestJSON-320006607</nova:project>
Oct 20 10:22:29 user nova-compute[74311]:       </nova:owner>
Oct 20 10:22:29 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:22:29 user nova-compute[74311]:       <nova:ports>
Oct 20 10:22:29 user nova-compute[74311]:         <nova:port uuid="131d4c92-ce07-4319-9261-609009fbdaee">
Oct 20 10:22:29 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 10:22:29 user nova-compute[74311]:         </nova:port>
Oct 20 10:22:29 user nova-compute[74311]:       </nova:ports>
Oct 20 10:22:29 user nova-compute[74311]:     </nova:instance>
Oct 20 10:22:29 user nova-compute[74311]:   </metadata>
Oct 20 10:22:29 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:22:29 user nova-compute[74311]:     <system>
Oct 20 10:22:29 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:22:29 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:22:29 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:22:29 user nova-compute[74311]:       <entry name="serial">c0f944dd-b256-4b47-9e2e-7ba50188f636</entry>
Oct 20 10:22:29 user nova-compute[74311]:       <entry name="uuid">c0f944dd-b256-4b47-9e2e-7ba50188f636</entry>
Oct 20 10:22:29 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:22:29 user nova-compute[74311]:     </system>
Oct 20 10:22:29 user nova-compute[74311]:   </sysinfo>
Oct 20 10:22:29 user nova-compute[74311]:   <os>
Oct 20 10:22:29 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:22:29 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:22:29 user nova-compute[74311]:   </os>
Oct 20 10:22:29 user nova-compute[74311]:   <features>
Oct 20 10:22:29 user nova-compute[74311]:     <acpi/>
Oct 20 10:22:29 user nova-compute[74311]:     <apic/>
Oct 20 10:22:29 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:22:29 user nova-compute[74311]:   </features>
Oct 20 10:22:29 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:22:29 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:22:29 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:22:29 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:22:29 user nova-compute[74311]:   </clock>
Oct 20 10:22:29 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:22:29 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:22:29 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:22:29 user nova-compute[74311]:   </cpu>
Oct 20 10:22:29 user nova-compute[74311]:   <devices>
Oct 20 10:22:29 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:22:29 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:22:29 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.rescue"/>
Oct 20 10:22:29 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:22:29 user nova-compute[74311]:     </disk>
Oct 20 10:22:29 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:22:29 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:22:29 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk"/>
Oct 20 10:22:29 user nova-compute[74311]:       <target dev="vdb" bus="virtio"/>
Oct 20 10:22:29 user nova-compute[74311]:     </disk>
Oct 20 10:22:29 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:22:29 user nova-compute[74311]:       <mac address="fa:16:3e:8a:ce:2a"/>
Oct 20 10:22:29 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:29 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:22:29 user nova-compute[74311]:       <target dev="tap131d4c92-ce"/>
Oct 20 10:22:29 user nova-compute[74311]:     </interface>
Oct 20 10:22:29 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:22:29 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/console.log" append="off"/>
Oct 20 10:22:29 user nova-compute[74311]:     </serial>
Oct 20 10:22:29 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:22:29 user nova-compute[74311]:     <video>
Oct 20 10:22:29 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:29 user nova-compute[74311]:     </video>
Oct 20 10:22:29 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:22:29 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:22:29 user nova-compute[74311]:     </rng>
Oct 20 10:22:29 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:22:29 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:22:29 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:22:29 user nova-compute[74311]:     </memballoon>
Oct 20 10:22:29 user nova-compute[74311]:   </devices>
Oct 20 10:22:29 user nova-compute[74311]: </domain>
Oct 20 10:22:29 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:22:29 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Instance spawned successfully.
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:22:29 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Instance destroyed successfully.
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No VIF found with MAC fa:16:3e:8a:ce:2a, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:22:30 user nova-compute[74311]: INFO nova.compute.manager [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Took 6.32 seconds to spawn the instance on the hypervisor.
Oct 20 10:22:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.455s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '26666306632376532', 'path': '/dev/sdd'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666306632376532', 'path': '/dev/sdd'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPlmtTEe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:22:30 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:22:30 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:22:30 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6411540-2373-4524-a34b-ae2f17eddde0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:22:30 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:30 user nova-compute[74311]: INFO nova.compute.manager [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Took 7.59 seconds to build instance.
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfcf996-1df3-45a6-92b4-da3106f85258]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9] added
Oct 20 10:22:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ba407344-4274-460e-875a-48f0676f8c38 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.863s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eae66a5-4ba5-4457-8121-bc10e124e636]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7208f207-a8ab-4b7f-a60c-cd918969c3e0]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPlmtTEe {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPlmtTEe" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1245225-85df-45d5-a0d8-94bb2e22a098]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cPlmtTEe'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85067bf-b543-4c66-a15b-1badcd65f7b9]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f677a7-b4d6-4106-8ce9-48eb19d0b814]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:30 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:30 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:30 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:30 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:30 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:30 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[06deeb5b-2c9c-4be3-924e-b159792db8dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9, portal: 172.16.0.220,3260]
Oct 20 10:22:30 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9, portal: 172.16.0.220,3260] successful.
Oct 20 10:22:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eac81f-e4b4-4633-a180-48c98317b84d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f2a868-a285-4e06-b240-4dd7883ed5cf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:30 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:30 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:30 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:30 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:22:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:30 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:30 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:30 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:30 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:22:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4afbda5-c219-4dc4-b1eb-fbf362e56549]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:22:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPlmtTEe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23131633833373635', 'path': '/dev/sde'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131633833373635', 'path': '/dev/sde'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zawTdpJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:22:31 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:22:31 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:22:31 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0093428f-77b8-4404-ad12-a5c0519a358e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:22:31 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1256872a-f061-4d38-ba2d-8744a7615b83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53] added
Oct 20 10:22:31 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d461777-f32f-488e-a3b9-ff3ee7cc924b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da8f24c-3ce5-4ed1-8612-beda8395fb50]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zawTdpJv {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zawTdpJv" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ad38ac-0334-4283-b4d7-29da1a7dbe05]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zawTdpJv'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc8c0e9-ea85-4b69-8813-9d10e611431b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed537452-1718-4f18-a750-d6fd2b7669ff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:22:31 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:22:31 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[318ad8d3-4b52-41c1-b807-6373cbf4b859]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53, portal: 172.16.0.220,3260]
Oct 20 10:22:31 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53, portal: 172.16.0.220,3260] successful.
Oct 20 10:22:31 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98e30cb-3316-463d-ac2c-cbc3ccf85c4d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5424cebf-bb9e-48a1-81cd-f04bdc269bb7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:22:31 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:22:31 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:22:31 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:22:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.056s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b2a0fb-d698-4d3a-bfb9-ac62b5db6b67]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:32 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:22:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zawTdpJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:22:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '23630356335393832', 'path': '/dev/sdg'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630356335393832', 'path': '/dev/sdg'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:c5:e1,bridge_name='br-int',has_traffic_filtering=True,id=43f2ca57-55c4-4353-8f52-e05381b6962a,network=Network(cae021ee-7a99-4553-86aa-3cdd96f98587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f2ca57-55') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:d7:c9,bridge_name='br-int',has_traffic_filtering=True,id=281e2888-41a8-45d3-a5aa-d74493218291,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap281e2888-41') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:01:02,bridge_name='br-int',has_traffic_filtering=True,id=baec8fe4-8243-407a-86fc-2aac48dbf893,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaec8fe4-82') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "address": "fa:16:3e:2e:ca:10", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b7d551-6e", "ovs_interfaceid": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "address": "fa:16:3e:2e:ca:10", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b7d551-6e", "ovs_interfaceid": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:10,bridge_name='br-int',has_traffic_filtering=True,id=c2b7d551-6eab-4972-a0e7-b277b31f284c,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b7d551-6e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "address": "fa:16:3e:83:21:b5", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80e2f85-5f", "ovs_interfaceid": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "address": "fa:16:3e:83:21:b5", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80e2f85-5f", "ovs_interfaceid": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=f80e2f85-5f8c-456b-aa14-3eca6f495a92,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf80e2f85-5f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "address": "fa:16:3e:fa:10:3e", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36f74b7-eb", "ovs_interfaceid": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "address": "fa:16:3e:fa:10:3e", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36f74b7-eb", "ovs_interfaceid": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:10:3e,bridge_name='br-int',has_traffic_filtering=True,id=f36f74b7-eb86-45d9-b1c3-edabd62f26c7,network=Network(9b446ba2-82de-4805-aa3c-4f349cca5cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36f74b7-eb') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "address": "fa:16:3e:b4:ae:35", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff91ee0f-4d", "ovs_interfaceid": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "address": "fa:16:3e:b4:ae:35", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff91ee0f-4d", "ovs_interfaceid": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ae:35,bridge_name='br-int',has_traffic_filtering=True,id=ff91ee0f-4db6-4246-8cfc-f42691975fe3,network=Network(9b446ba2-82de-4805-aa3c-4f349cca5cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff91ee0f-4d') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.objects.instance [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lazy-loading 'pci_devices' on Instance uuid 4011fd9a-7109-46b7-b77e-51c29e36a7d1 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:22:33 user nova-compute[74311]:   <uuid>4011fd9a-7109-46b7-b77e-51c29e36a7d1</uuid>
Oct 20 10:22:33 user nova-compute[74311]:   <name>instance-00000016</name>
Oct 20 10:22:33 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:22:33 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:22:33 user nova-compute[74311]:   <metadata>
Oct 20 10:22:33 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:22:33 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:22:33 user nova-compute[74311]:       <nova:name>tempest-device-tagging-server-1060440575</nova:name>
Oct 20 10:22:33 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:22:28</nova:creationTime>
Oct 20 10:22:33 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:22:33 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:22:33 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:22:33 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:22:33 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:22:33 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:22:33 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:22:33 user nova-compute[74311]:       <nova:owner>
Oct 20 10:22:33 user nova-compute[74311]:         <nova:user uuid="e415285f7ab2498f8102dc4994d1edae">tempest-TaggedBootDevicesTest_v242-565303546-project-member</nova:user>
Oct 20 10:22:33 user nova-compute[74311]:         <nova:project uuid="5cb23819b2a548eab36b4b8ca922313d">tempest-TaggedBootDevicesTest_v242-565303546</nova:project>
Oct 20 10:22:33 user nova-compute[74311]:       </nova:owner>
Oct 20 10:22:33 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:22:33 user nova-compute[74311]:       <nova:ports>
Oct 20 10:22:33 user nova-compute[74311]:         <nova:port uuid="43f2ca57-55c4-4353-8f52-e05381b6962a">
Oct 20 10:22:33 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 10:22:33 user nova-compute[74311]:         </nova:port>
Oct 20 10:22:33 user nova-compute[74311]:         <nova:port uuid="281e2888-41a8-45d3-a5aa-d74493218291">
Oct 20 10:22:33 user nova-compute[74311]:           <nova:ip type="fixed" address="10.1.1.186" ipVersion="4"/>
Oct 20 10:22:33 user nova-compute[74311]:         </nova:port>
Oct 20 10:22:33 user nova-compute[74311]:         <nova:port uuid="baec8fe4-8243-407a-86fc-2aac48dbf893">
Oct 20 10:22:33 user nova-compute[74311]:           <nova:ip type="fixed" address="10.1.1.246" ipVersion="4"/>
Oct 20 10:22:33 user nova-compute[74311]:         </nova:port>
Oct 20 10:22:33 user nova-compute[74311]:         <nova:port uuid="c2b7d551-6eab-4972-a0e7-b277b31f284c">
Oct 20 10:22:33 user nova-compute[74311]:           <nova:ip type="fixed" address="10.1.1.52" ipVersion="4"/>
Oct 20 10:22:33 user nova-compute[74311]:         </nova:port>
Oct 20 10:22:33 user nova-compute[74311]:         <nova:port uuid="f80e2f85-5f8c-456b-aa14-3eca6f495a92">
Oct 20 10:22:33 user nova-compute[74311]:           <nova:ip type="fixed" address="10.1.1.169" ipVersion="4"/>
Oct 20 10:22:33 user nova-compute[74311]:         </nova:port>
Oct 20 10:22:33 user nova-compute[74311]:         <nova:port uuid="f36f74b7-eb86-45d9-b1c3-edabd62f26c7">
Oct 20 10:22:33 user nova-compute[74311]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 10:22:33 user nova-compute[74311]:         </nova:port>
Oct 20 10:22:33 user nova-compute[74311]:         <nova:port uuid="ff91ee0f-4db6-4246-8cfc-f42691975fe3">
Oct 20 10:22:33 user nova-compute[74311]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 10:22:33 user nova-compute[74311]:         </nova:port>
Oct 20 10:22:33 user nova-compute[74311]:       </nova:ports>
Oct 20 10:22:33 user nova-compute[74311]:     </nova:instance>
Oct 20 10:22:33 user nova-compute[74311]:   </metadata>
Oct 20 10:22:33 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:22:33 user nova-compute[74311]:     <system>
Oct 20 10:22:33 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:22:33 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:22:33 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:22:33 user nova-compute[74311]:       <entry name="serial">4011fd9a-7109-46b7-b77e-51c29e36a7d1</entry>
Oct 20 10:22:33 user nova-compute[74311]:       <entry name="uuid">4011fd9a-7109-46b7-b77e-51c29e36a7d1</entry>
Oct 20 10:22:33 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:22:33 user nova-compute[74311]:     </system>
Oct 20 10:22:33 user nova-compute[74311]:   </sysinfo>
Oct 20 10:22:33 user nova-compute[74311]:   <os>
Oct 20 10:22:33 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:22:33 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:22:33 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:22:33 user nova-compute[74311]:   </os>
Oct 20 10:22:33 user nova-compute[74311]:   <features>
Oct 20 10:22:33 user nova-compute[74311]:     <acpi/>
Oct 20 10:22:33 user nova-compute[74311]:     <apic/>
Oct 20 10:22:33 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:22:33 user nova-compute[74311]:   </features>
Oct 20 10:22:33 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:22:33 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:22:33 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:22:33 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:22:33 user nova-compute[74311]:   </clock>
Oct 20 10:22:33 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:22:33 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:22:33 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:22:33 user nova-compute[74311]:   </cpu>
Oct 20 10:22:33 user nova-compute[74311]:   <devices>
Oct 20 10:22:33 user nova-compute[74311]:     <disk type="file" device="cdrom">
Oct 20 10:22:33 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 10:22:33 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/4011fd9a-7109-46b7-b77e-51c29e36a7d1/disk.config"/>
Oct 20 10:22:33 user nova-compute[74311]:       <target dev="hda" bus="ide"/>
Oct 20 10:22:33 user nova-compute[74311]:     </disk>
Oct 20 10:22:33 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:22:33 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:22:33 user nova-compute[74311]:       <source dev="/dev/sdd"/>
Oct 20 10:22:33 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:22:33 user nova-compute[74311]:       <serial>3ad8b3b1-d047-46c9-b41b-6e3372b1eedd</serial>
Oct 20 10:22:33 user nova-compute[74311]:     </disk>
Oct 20 10:22:33 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:22:33 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:22:33 user nova-compute[74311]:       <source dev="/dev/sde"/>
Oct 20 10:22:33 user nova-compute[74311]:       <target dev="vdb" bus="virtio"/>
Oct 20 10:22:33 user nova-compute[74311]:       <serial>9dc740f6-a328-44da-88b7-07275d6889f9</serial>
Oct 20 10:22:33 user nova-compute[74311]:     </disk>
Oct 20 10:22:33 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:22:33 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:22:33 user nova-compute[74311]:       <source dev="/dev/sdg"/>
Oct 20 10:22:33 user nova-compute[74311]:       <target dev="vdc" bus="virtio"/>
Oct 20 10:22:33 user nova-compute[74311]:       <serial>24cea100-4f10-4efd-909a-6cf30a418e53</serial>
Oct 20 10:22:33 user nova-compute[74311]:     </disk>
Oct 20 10:22:33 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:22:33 user nova-compute[74311]:       <mac address="fa:16:3e:45:c5:e1"/>
Oct 20 10:22:33 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:33 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:22:33 user nova-compute[74311]:       <target dev="tap43f2ca57-55"/>
Oct 20 10:22:33 user nova-compute[74311]:     </interface>
Oct 20 10:22:33 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:22:33 user nova-compute[74311]:       <mac address="fa:16:3e:83:d7:c9"/>
Oct 20 10:22:33 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:33 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:22:33 user nova-compute[74311]:       <target dev="tap281e2888-41"/>
Oct 20 10:22:33 user nova-compute[74311]:     </interface>
Oct 20 10:22:33 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:22:33 user nova-compute[74311]:       <mac address="fa:16:3e:0e:01:02"/>
Oct 20 10:22:33 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:33 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:22:33 user nova-compute[74311]:       <target dev="tapbaec8fe4-82"/>
Oct 20 10:22:33 user nova-compute[74311]:     </interface>
Oct 20 10:22:33 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:22:33 user nova-compute[74311]:       <mac address="fa:16:3e:2e:ca:10"/>
Oct 20 10:22:33 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:33 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:22:33 user nova-compute[74311]:       <target dev="tapc2b7d551-6e"/>
Oct 20 10:22:33 user nova-compute[74311]:     </interface>
Oct 20 10:22:33 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:22:33 user nova-compute[74311]:       <mac address="fa:16:3e:83:21:b5"/>
Oct 20 10:22:33 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:33 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:22:33 user nova-compute[74311]:       <target dev="tapf80e2f85-5f"/>
Oct 20 10:22:33 user nova-compute[74311]:     </interface>
Oct 20 10:22:33 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:22:33 user nova-compute[74311]:       <mac address="fa:16:3e:fa:10:3e"/>
Oct 20 10:22:33 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:33 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:22:33 user nova-compute[74311]:       <target dev="tapf36f74b7-eb"/>
Oct 20 10:22:33 user nova-compute[74311]:     </interface>
Oct 20 10:22:33 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:22:33 user nova-compute[74311]:       <mac address="fa:16:3e:b4:ae:35"/>
Oct 20 10:22:33 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:33 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:22:33 user nova-compute[74311]:       <target dev="tapff91ee0f-4d"/>
Oct 20 10:22:33 user nova-compute[74311]:     </interface>
Oct 20 10:22:33 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:22:33 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/4011fd9a-7109-46b7-b77e-51c29e36a7d1/console.log" append="off"/>
Oct 20 10:22:33 user nova-compute[74311]:     </serial>
Oct 20 10:22:33 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:22:33 user nova-compute[74311]:     <video>
Oct 20 10:22:33 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:33 user nova-compute[74311]:     </video>
Oct 20 10:22:33 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:22:33 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:22:33 user nova-compute[74311]:     </rng>
Oct 20 10:22:33 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:22:33 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:22:33 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:22:33 user nova-compute[74311]:     </memballoon>
Oct 20 10:22:33 user nova-compute[74311]:   </devices>
Oct 20 10:22:33 user nova-compute[74311]: </domain>
Oct 20 10:22:33 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:c5:e1,bridge_name='br-int',has_traffic_filtering=True,id=43f2ca57-55c4-4353-8f52-e05381b6962a,network=Network(cae021ee-7a99-4553-86aa-3cdd96f98587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f2ca57-55') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG os_vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:c5:e1,bridge_name='br-int',has_traffic_filtering=True,id=43f2ca57-55c4-4353-8f52-e05381b6962a,network=Network(cae021ee-7a99-4553-86aa-3cdd96f98587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f2ca57-55') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64bb19e8-2b01-5973-a075-3a055347d04a', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43f2ca57-55, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43f2ca57-55, col_values=(('qos', UUID('2a7ba9ac-017c-47f6-91f6-1d927c197408')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43f2ca57-55, col_values=(('external_ids', {'iface-id': '43f2ca57-55c4-4353-8f52-e05381b6962a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:c5:e1', 'vm-uuid': '4011fd9a-7109-46b7-b77e-51c29e36a7d1'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: INFO os_vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:c5:e1,bridge_name='br-int',has_traffic_filtering=True,id=43f2ca57-55c4-4353-8f52-e05381b6962a,network=Network(cae021ee-7a99-4553-86aa-3cdd96f98587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f2ca57-55')
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:d7:c9,bridge_name='br-int',has_traffic_filtering=True,id=281e2888-41a8-45d3-a5aa-d74493218291,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap281e2888-41') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG os_vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d7:c9,bridge_name='br-int',has_traffic_filtering=True,id=281e2888-41a8-45d3-a5aa-d74493218291,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap281e2888-41') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b19257c3-0a2d-5610-82b0-63c07a888b87', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap281e2888-41, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap281e2888-41, col_values=(('qos', UUID('25d9a20b-e762-44af-8e53-eb6639ff65f2')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap281e2888-41, col_values=(('external_ids', {'iface-id': '281e2888-41a8-45d3-a5aa-d74493218291', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:d7:c9', 'vm-uuid': '4011fd9a-7109-46b7-b77e-51c29e36a7d1'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: INFO os_vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d7:c9,bridge_name='br-int',has_traffic_filtering=True,id=281e2888-41a8-45d3-a5aa-d74493218291,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap281e2888-41')
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:01:02,bridge_name='br-int',has_traffic_filtering=True,id=baec8fe4-8243-407a-86fc-2aac48dbf893,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaec8fe4-82') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG os_vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:01:02,bridge_name='br-int',has_traffic_filtering=True,id=baec8fe4-8243-407a-86fc-2aac48dbf893,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaec8fe4-82') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bad010b-e45b-59e0-81fd-edc21176def5', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbaec8fe4-82, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbaec8fe4-82, col_values=(('qos', UUID('fac5f6d5-e258-4333-a545-c9128e76b002')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbaec8fe4-82, col_values=(('external_ids', {'iface-id': 'baec8fe4-8243-407a-86fc-2aac48dbf893', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:01:02', 'vm-uuid': '4011fd9a-7109-46b7-b77e-51c29e36a7d1'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: INFO os_vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:01:02,bridge_name='br-int',has_traffic_filtering=True,id=baec8fe4-8243-407a-86fc-2aac48dbf893,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaec8fe4-82')
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "address": "fa:16:3e:2e:ca:10", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b7d551-6e", "ovs_interfaceid": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "address": "fa:16:3e:2e:ca:10", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b7d551-6e", "ovs_interfaceid": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:10,bridge_name='br-int',has_traffic_filtering=True,id=c2b7d551-6eab-4972-a0e7-b277b31f284c,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b7d551-6e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG os_vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:10,bridge_name='br-int',has_traffic_filtering=True,id=c2b7d551-6eab-4972-a0e7-b277b31f284c,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b7d551-6e') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e4ef676-3708-5a0e-84d1-66aaec5567ed', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2b7d551-6e, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2b7d551-6e, col_values=(('qos', UUID('df86850a-4201-448a-b488-b66f4070e05c')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2b7d551-6e, col_values=(('external_ids', {'iface-id': 'c2b7d551-6eab-4972-a0e7-b277b31f284c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:ca:10', 'vm-uuid': '4011fd9a-7109-46b7-b77e-51c29e36a7d1'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: INFO os_vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:10,bridge_name='br-int',has_traffic_filtering=True,id=c2b7d551-6eab-4972-a0e7-b277b31f284c,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b7d551-6e')
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "address": "fa:16:3e:83:21:b5", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80e2f85-5f", "ovs_interfaceid": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "address": "fa:16:3e:83:21:b5", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80e2f85-5f", "ovs_interfaceid": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=f80e2f85-5f8c-456b-aa14-3eca6f495a92,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf80e2f85-5f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG os_vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=f80e2f85-5f8c-456b-aa14-3eca6f495a92,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf80e2f85-5f') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f7b67aa-0121-56ca-8ce5-a00c3cb698cd', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf80e2f85-5f, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf80e2f85-5f, col_values=(('qos', UUID('62be0d0c-f963-4cb4-872b-91c32cf88364')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf80e2f85-5f, col_values=(('external_ids', {'iface-id': 'f80e2f85-5f8c-456b-aa14-3eca6f495a92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:21:b5', 'vm-uuid': '4011fd9a-7109-46b7-b77e-51c29e36a7d1'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: INFO os_vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=f80e2f85-5f8c-456b-aa14-3eca6f495a92,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf80e2f85-5f')
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "address": "fa:16:3e:fa:10:3e", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36f74b7-eb", "ovs_interfaceid": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "address": "fa:16:3e:fa:10:3e", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36f74b7-eb", "ovs_interfaceid": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:10:3e,bridge_name='br-int',has_traffic_filtering=True,id=f36f74b7-eb86-45d9-b1c3-edabd62f26c7,network=Network(9b446ba2-82de-4805-aa3c-4f349cca5cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36f74b7-eb') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG os_vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:10:3e,bridge_name='br-int',has_traffic_filtering=True,id=f36f74b7-eb86-45d9-b1c3-edabd62f26c7,network=Network(9b446ba2-82de-4805-aa3c-4f349cca5cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36f74b7-eb') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec81aacf-d413-54c4-8ae9-c50fa9f12cf1', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf36f74b7-eb, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf36f74b7-eb, col_values=(('qos', UUID('186b6249-2adf-4ede-a075-8cc5b6cc9fb0')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf36f74b7-eb, col_values=(('external_ids', {'iface-id': 'f36f74b7-eb86-45d9-b1c3-edabd62f26c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:10:3e', 'vm-uuid': '4011fd9a-7109-46b7-b77e-51c29e36a7d1'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: INFO os_vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:10:3e,bridge_name='br-int',has_traffic_filtering=True,id=f36f74b7-eb86-45d9-b1c3-edabd62f26c7,network=Network(9b446ba2-82de-4805-aa3c-4f349cca5cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36f74b7-eb')
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "address": "fa:16:3e:b4:ae:35", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff91ee0f-4d", "ovs_interfaceid": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "address": "fa:16:3e:b4:ae:35", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff91ee0f-4d", "ovs_interfaceid": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ae:35,bridge_name='br-int',has_traffic_filtering=True,id=ff91ee0f-4db6-4246-8cfc-f42691975fe3,network=Network(9b446ba2-82de-4805-aa3c-4f349cca5cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff91ee0f-4d') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG os_vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ae:35,bridge_name='br-int',has_traffic_filtering=True,id=ff91ee0f-4db6-4246-8cfc-f42691975fe3,network=Network(9b446ba2-82de-4805-aa3c-4f349cca5cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff91ee0f-4d') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a14f77a7-2871-5ab5-8102-4c1a3ceea50a', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff91ee0f-4d, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff91ee0f-4d, col_values=(('qos', UUID('aeedec64-6260-4533-b7b0-920fe66c4eb7')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff91ee0f-4d, col_values=(('external_ids', {'iface-id': 'ff91ee0f-4db6-4246-8cfc-f42691975fe3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:ae:35', 'vm-uuid': '4011fd9a-7109-46b7-b77e-51c29e36a7d1'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:33 user nova-compute[74311]: INFO os_vif [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ae:35,bridge_name='br-int',has_traffic_filtering=True,id=ff91ee0f-4db6-4246-8cfc-f42691975fe3,network=Network(9b446ba2-82de-4805-aa3c-4f349cca5cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff91ee0f-4d')
Oct 20 10:22:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] No BDM found with device name hda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:22:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:22:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] No VIF found with MAC fa:16:3e:45:c5:e1, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:22:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] No VIF found with MAC fa:16:3e:83:21:b5, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:22:34 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Using config drive
Oct 20 10:22:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:34 user nova-compute[74311]: DEBUG nova.compute.manager [None req-afad4817-2fd1-4fa4-bf6e-4bc448558372 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:22:34 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Creating config drive at /opt/stack/data/nova/instances/4011fd9a-7109-46b7-b77e-51c29e36a7d1/disk.config
Oct 20 10:22:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4011fd9a-7109-46b7-b77e-51c29e36a7d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3nxvwdk0 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4011fd9a-7109-46b7-b77e-51c29e36a7d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3nxvwdk0" returned: 0 in 0.077s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-ca55072d-b7c6-4791-b288-6ddccd09d305 req-8312dc6f-f26e-4df4-b77e-3a240c4ee66a service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-vif-unplugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ca55072d-b7c6-4791-b288-6ddccd09d305 req-8312dc6f-f26e-4df4-b77e-3a240c4ee66a service nova] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ca55072d-b7c6-4791-b288-6ddccd09d305 req-8312dc6f-f26e-4df4-b77e-3a240c4ee66a service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ca55072d-b7c6-4791-b288-6ddccd09d305 req-8312dc6f-f26e-4df4-b77e-3a240c4ee66a service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-ca55072d-b7c6-4791-b288-6ddccd09d305 req-8312dc6f-f26e-4df4-b77e-3a240c4ee66a service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] No waiting events found dispatching network-vif-unplugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:35 user nova-compute[74311]: WARNING nova.compute.manager [req-ca55072d-b7c6-4791-b288-6ddccd09d305 req-8312dc6f-f26e-4df4-b77e-3a240c4ee66a service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received unexpected event network-vif-unplugged-131d4c92-ce07-4319-9261-609009fbdaee for instance with vm_state rescued and task_state None.
Oct 20 10:22:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:36 user nova-compute[74311]: DEBUG nova.compute.manager [req-c321351f-58b3-40fd-956f-7e780518ef0c req-aa78cad1-44e5-4471-823e-cef55747571c service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c321351f-58b3-40fd-956f-7e780518ef0c req-aa78cad1-44e5-4471-823e-cef55747571c service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c321351f-58b3-40fd-956f-7e780518ef0c req-aa78cad1-44e5-4471-823e-cef55747571c service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c321351f-58b3-40fd-956f-7e780518ef0c req-aa78cad1-44e5-4471-823e-cef55747571c service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:36 user nova-compute[74311]: DEBUG nova.compute.manager [req-c321351f-58b3-40fd-956f-7e780518ef0c req-aa78cad1-44e5-4471-823e-cef55747571c service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:36 user nova-compute[74311]: WARNING nova.compute.manager [req-c321351f-58b3-40fd-956f-7e780518ef0c req-aa78cad1-44e5-4471-823e-cef55747571c service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-43f2ca57-55c4-4353-8f52-e05381b6962a for instance with vm_state building and task_state spawning.
Oct 20 10:22:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] No waiting events found dispatching network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:37 user nova-compute[74311]: WARNING nova.compute.manager [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received unexpected event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee for instance with vm_state rescued and task_state None.
Oct 20 10:22:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] No waiting events found dispatching network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:37 user nova-compute[74311]: WARNING nova.compute.manager [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received unexpected event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee for instance with vm_state rescued and task_state None.
Oct 20 10:22:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] No waiting events found dispatching network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:37 user nova-compute[74311]: WARNING nova.compute.manager [req-18280245-a0b6-43f6-9fb8-caa2a999a841 req-4f7d9cea-cc7d-40d1-a2bd-18bb0eb7317f service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received unexpected event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee for instance with vm_state rescued and task_state None.
Oct 20 10:22:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Acquiring lock "84361c20-e801-4e16-9ca2-b9eff8620917" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "84361c20-e801-4e16-9ca2-b9eff8620917" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:22:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:22:38 user nova-compute[74311]: INFO nova.compute.claims [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Claim successful on node user
Oct 20 10:22:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:39 user nova-compute[74311]: WARNING nova.compute.manager [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-43f2ca57-55c4-4353-8f52-e05381b6962a for instance with vm_state building and task_state spawning.
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-c2b7d551-6eab-4972-a0e7-b277b31f284c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-c2b7d551-6eab-4972-a0e7-b277b31f284c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:39 user nova-compute[74311]: WARNING nova.compute.manager [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-c2b7d551-6eab-4972-a0e7-b277b31f284c for instance with vm_state building and task_state spawning.
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-c2b7d551-6eab-4972-a0e7-b277b31f284c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-c2b7d551-6eab-4972-a0e7-b277b31f284c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:39 user nova-compute[74311]: WARNING nova.compute.manager [req-57675b05-d425-48a3-af83-7438a5548715 req-00e94607-024f-431f-a1ee-198593420b04 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-c2b7d551-6eab-4972-a0e7-b277b31f284c for instance with vm_state building and task_state spawning.
Oct 20 10:22:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-281e2888-41a8-45d3-a5aa-d74493218291 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-281e2888-41a8-45d3-a5aa-d74493218291 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:39 user nova-compute[74311]: WARNING nova.compute.manager [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-281e2888-41a8-45d3-a5aa-d74493218291 for instance with vm_state building and task_state spawning.
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-281e2888-41a8-45d3-a5aa-d74493218291 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-281e2888-41a8-45d3-a5aa-d74493218291 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:39 user nova-compute[74311]: WARNING nova.compute.manager [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-281e2888-41a8-45d3-a5aa-d74493218291 for instance with vm_state building and task_state spawning.
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-f36f74b7-eb86-45d9-b1c3-edabd62f26c7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-f36f74b7-eb86-45d9-b1c3-edabd62f26c7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:39 user nova-compute[74311]: WARNING nova.compute.manager [req-a3ef61c5-c824-4191-b423-1a5093c60994 req-69704391-9a59-45d7-b3a9-01529943fd27 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-f36f74b7-eb86-45d9-b1c3-edabd62f26c7 for instance with vm_state building and task_state spawning.
Oct 20 10:22:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGTJPFYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:22:39 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:22:39 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:22:39 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccc1bcc-3ee1-40a9-bdad-282388d71d76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:22:39 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[47604f24-1917-45dd-a9b6-af145bfdb5a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692] added
Oct 20 10:22:39 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8b071f-3dcd-4410-82b3-dc31580e8fcd]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.042s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e096a699-c0f1-4827-bb27-0b618d005306]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CGTJPFYc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CGTJPFYc" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e060c7e-9aa7-4761-9465-2aa1600df050]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CGTJPFYc'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bcd8c1-9ab8-4386-83b0-1733984d266e]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[da20d57e-1ca8-4e27-8fba-b5aa77405fa7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:22:39 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:22:39 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cf3328-c6b6-46ba-8219-79569f98de75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692, portal: 172.16.0.220,3260]
Oct 20 10:22:39 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692, portal: 172.16.0.220,3260] successful.
Oct 20 10:22:39 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3d3f10-d0c3-4b9b-b9cb-617870bda3f8]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c0eb7b-f2fd-40e8-9c1c-465155371b2d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:22:39 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:22:39 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:22:39 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.512s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] HCTL ('39', '-', '-', 0) found on session 26 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db8e71b-34cc-4fc6-a0fb-1f3a1a2fc45c]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Searching for a device in session 26 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGTJPFYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:22:39 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.055s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG nova.network.neutron [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:22:40 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:22:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG nova.policy [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b5f9d22dceb4dc0af82280861e3ae44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97431e31c9c43589464cb6f54c98ec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:22:40 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Creating image(s)
Oct 20 10:22:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Acquiring lock "/opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "/opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "/opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.238s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.208s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.591s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] <== connect_volume: return (1596ms) {'type': 'block', 'scsi_wwn': '26562376639396536', 'path': '/dev/sdh'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562376639396536', 'path': '/dev/sdh'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG nova.objects.instance [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lazy-loading 'flavor' on Instance uuid 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk 1073741824" returned: 0 in 0.087s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:22:41 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:22:41 user nova-compute[74311]:   <source dev="/dev/sdh"/>
Oct 20 10:22:41 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:22:41 user nova-compute[74311]:   <serial>f375fade-d000-4d2e-ba16-066b56a75692</serial>
Oct 20 10:22:41 user nova-compute[74311]: </disk>
Oct 20 10:22:41 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Successfully created port: 373868c2-efc4-4844-a47a-cb8e93add3df {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-cb8445e4-d44e-443b-a02d-84e24b19e034 req-cf80e3da-9b96-4e98-ae03-2aba9d506822 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-ff91ee0f-4db6-4246-8cfc-f42691975fe3 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cb8445e4-d44e-443b-a02d-84e24b19e034 req-cf80e3da-9b96-4e98-ae03-2aba9d506822 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cb8445e4-d44e-443b-a02d-84e24b19e034 req-cf80e3da-9b96-4e98-ae03-2aba9d506822 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cb8445e4-d44e-443b-a02d-84e24b19e034 req-cf80e3da-9b96-4e98-ae03-2aba9d506822 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-cb8445e4-d44e-443b-a02d-84e24b19e034 req-cf80e3da-9b96-4e98-ae03-2aba9d506822 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-ff91ee0f-4db6-4246-8cfc-f42691975fe3 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:41 user nova-compute[74311]: WARNING nova.compute.manager [req-cb8445e4-d44e-443b-a02d-84e24b19e034 req-cf80e3da-9b96-4e98-ae03-2aba9d506822 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-ff91ee0f-4db6-4246-8cfc-f42691975fe3 for instance with vm_state building and task_state spawning.
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-cb8445e4-d44e-443b-a02d-84e24b19e034 req-cf80e3da-9b96-4e98-ae03-2aba9d506822 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-ff91ee0f-4db6-4246-8cfc-f42691975fe3 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cb8445e4-d44e-443b-a02d-84e24b19e034 req-cf80e3da-9b96-4e98-ae03-2aba9d506822 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cb8445e4-d44e-443b-a02d-84e24b19e034 req-cf80e3da-9b96-4e98-ae03-2aba9d506822 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cb8445e4-d44e-443b-a02d-84e24b19e034 req-cf80e3da-9b96-4e98-ae03-2aba9d506822 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-cb8445e4-d44e-443b-a02d-84e24b19e034 req-cf80e3da-9b96-4e98-ae03-2aba9d506822 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-ff91ee0f-4db6-4246-8cfc-f42691975fe3 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:41 user nova-compute[74311]: WARNING nova.compute.manager [req-cb8445e4-d44e-443b-a02d-84e24b19e034 req-cf80e3da-9b96-4e98-ae03-2aba9d506822 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-ff91ee0f-4db6-4246-8cfc-f42691975fe3 for instance with vm_state building and task_state spawning.
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.299s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-22643200-4117-430d-b3ed-54a02c760dab req-f56e3762-bc44-454d-9998-eaf9065fff44 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-f36f74b7-eb86-45d9-b1c3-edabd62f26c7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-22643200-4117-430d-b3ed-54a02c760dab req-f56e3762-bc44-454d-9998-eaf9065fff44 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-22643200-4117-430d-b3ed-54a02c760dab req-f56e3762-bc44-454d-9998-eaf9065fff44 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-22643200-4117-430d-b3ed-54a02c760dab req-f56e3762-bc44-454d-9998-eaf9065fff44 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-22643200-4117-430d-b3ed-54a02c760dab req-f56e3762-bc44-454d-9998-eaf9065fff44 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-f36f74b7-eb86-45d9-b1c3-edabd62f26c7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:41 user nova-compute[74311]: WARNING nova.compute.manager [req-22643200-4117-430d-b3ed-54a02c760dab req-f56e3762-bc44-454d-9998-eaf9065fff44 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-f36f74b7-eb86-45d9-b1c3-edabd62f26c7 for instance with vm_state building and task_state spawning.
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Cannot resize image /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Ensure instance console log exists: /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] No VIF found with MAC fa:16:3e:ea:eb:6a, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-adf16804-8ce3-4ed7-8fb1-2ec114efb759 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.527s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.network.neutron [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Successfully updated port: 373868c2-efc4-4844-a47a-cb8e93add3df {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Acquiring lock "refresh_cache-84361c20-e801-4e16-9ca2-b9eff8620917" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Acquired lock "refresh_cache-84361c20-e801-4e16-9ca2-b9eff8620917" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.network.neutron [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-4eaf6526-d1d6-42b8-9c89-98c685dfea43 req-56618adc-f2d0-48ff-b637-c2a5d2fd672b service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Received event network-changed-373868c2-efc4-4844-a47a-cb8e93add3df {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-4eaf6526-d1d6-42b8-9c89-98c685dfea43 req-56618adc-f2d0-48ff-b637-c2a5d2fd672b service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Refreshing instance network info cache due to event network-changed-373868c2-efc4-4844-a47a-cb8e93add3df. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4eaf6526-d1d6-42b8-9c89-98c685dfea43 req-56618adc-f2d0-48ff-b637-c2a5d2fd672b service nova] Acquiring lock "refresh_cache-84361c20-e801-4e16-9ca2-b9eff8620917" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.compute.manager [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.network.neutron [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:22:42 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Instance spawned successfully.
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:42 user nova-compute[74311]: INFO nova.compute.manager [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Rescuing
Oct 20 10:22:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquired lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.network.neutron [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:22:42 user nova-compute[74311]: INFO nova.compute.manager [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Took 13.86 seconds to spawn the instance on the hypervisor.
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.compute.manager [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:22:42 user nova-compute[74311]: INFO nova.compute.manager [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Took 112.35 seconds to build instance.
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.network.neutron [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Updating instance_info_cache with network_info: [{"id": "373868c2-efc4-4844-a47a-cb8e93add3df", "address": "fa:16:3e:86:ab:91", "network": {"id": "166cf710-5a3f-46b7-b648-8bd3f0418422", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733058383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97431e31c9c43589464cb6f54c98ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373868c2-ef", "ovs_interfaceid": "373868c2-efc4-4844-a47a-cb8e93add3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Releasing lock "refresh_cache-84361c20-e801-4e16-9ca2-b9eff8620917" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.compute.manager [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Instance network_info: |[{"id": "373868c2-efc4-4844-a47a-cb8e93add3df", "address": "fa:16:3e:86:ab:91", "network": {"id": "166cf710-5a3f-46b7-b648-8bd3f0418422", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733058383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97431e31c9c43589464cb6f54c98ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373868c2-ef", "ovs_interfaceid": "373868c2-efc4-4844-a47a-cb8e93add3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4eaf6526-d1d6-42b8-9c89-98c685dfea43 req-56618adc-f2d0-48ff-b637-c2a5d2fd672b service nova] Acquired lock "refresh_cache-84361c20-e801-4e16-9ca2-b9eff8620917" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.network.neutron [req-4eaf6526-d1d6-42b8-9c89-98c685dfea43 req-56618adc-f2d0-48ff-b637-c2a5d2fd672b service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Refreshing network info cache for port 373868c2-efc4-4844-a47a-cb8e93add3df {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Start _get_guest_xml network_info=[{"id": "373868c2-efc4-4844-a47a-cb8e93add3df", "address": "fa:16:3e:86:ab:91", "network": {"id": "166cf710-5a3f-46b7-b648-8bd3f0418422", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733058383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97431e31c9c43589464cb6f54c98ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373868c2-ef", "ovs_interfaceid": "373868c2-efc4-4844-a47a-cb8e93add3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-38b21a96-736e-4d31-b95b-110b60c9d277 tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 112.466s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:42 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:22:42 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-586227952',display_name='tempest-VolumesActionsTest-instance-586227952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-586227952',id=25,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f97431e31c9c43589464cb6f54c98ec1',ramdisk_id='',reservation_id='r-7by2xvvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-674463254',owner_user_name='tempest-VolumesActionsTest-674463254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:22:40Z,user_data=None,user_id='1b5f9d22dceb4dc0af82280861e3ae44',uuid=84361c20-e801-4e16-9ca2-b9eff8620917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "373868c2-efc4-4844-a47a-cb8e93add3df", "address": "fa:16:3e:86:ab:91", "network": {"id": "166cf710-5a3f-46b7-b648-8bd3f0418422", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733058383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97431e31c9c43589464cb6f54c98ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373868c2-ef", "ovs_interfaceid": "373868c2-efc4-4844-a47a-cb8e93add3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Converting VIF {"id": "373868c2-efc4-4844-a47a-cb8e93add3df", "address": "fa:16:3e:86:ab:91", "network": {"id": "166cf710-5a3f-46b7-b648-8bd3f0418422", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733058383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97431e31c9c43589464cb6f54c98ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373868c2-ef", "ovs_interfaceid": "373868c2-efc4-4844-a47a-cb8e93add3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:91,bridge_name='br-int',has_traffic_filtering=True,id=373868c2-efc4-4844-a47a-cb8e93add3df,network=Network(166cf710-5a3f-46b7-b648-8bd3f0418422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373868c2-ef') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.objects.instance [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lazy-loading 'pci_devices' on Instance uuid 84361c20-e801-4e16-9ca2-b9eff8620917 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:22:42 user nova-compute[74311]:   <uuid>84361c20-e801-4e16-9ca2-b9eff8620917</uuid>
Oct 20 10:22:42 user nova-compute[74311]:   <name>instance-00000019</name>
Oct 20 10:22:42 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:22:42 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:22:42 user nova-compute[74311]:   <metadata>
Oct 20 10:22:42 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:22:42 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:22:42 user nova-compute[74311]:       <nova:name>tempest-VolumesActionsTest-instance-586227952</nova:name>
Oct 20 10:22:42 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:22:42</nova:creationTime>
Oct 20 10:22:42 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:22:42 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:22:42 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:22:42 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:22:42 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:22:42 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:22:42 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:22:42 user nova-compute[74311]:       <nova:owner>
Oct 20 10:22:42 user nova-compute[74311]:         <nova:user uuid="1b5f9d22dceb4dc0af82280861e3ae44">tempest-VolumesActionsTest-674463254-project-member</nova:user>
Oct 20 10:22:42 user nova-compute[74311]:         <nova:project uuid="f97431e31c9c43589464cb6f54c98ec1">tempest-VolumesActionsTest-674463254</nova:project>
Oct 20 10:22:42 user nova-compute[74311]:       </nova:owner>
Oct 20 10:22:42 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:22:42 user nova-compute[74311]:       <nova:ports>
Oct 20 10:22:42 user nova-compute[74311]:         <nova:port uuid="373868c2-efc4-4844-a47a-cb8e93add3df">
Oct 20 10:22:42 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 10:22:42 user nova-compute[74311]:         </nova:port>
Oct 20 10:22:42 user nova-compute[74311]:       </nova:ports>
Oct 20 10:22:42 user nova-compute[74311]:     </nova:instance>
Oct 20 10:22:42 user nova-compute[74311]:   </metadata>
Oct 20 10:22:42 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:22:42 user nova-compute[74311]:     <system>
Oct 20 10:22:42 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:22:42 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:22:42 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:22:42 user nova-compute[74311]:       <entry name="serial">84361c20-e801-4e16-9ca2-b9eff8620917</entry>
Oct 20 10:22:42 user nova-compute[74311]:       <entry name="uuid">84361c20-e801-4e16-9ca2-b9eff8620917</entry>
Oct 20 10:22:42 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:22:42 user nova-compute[74311]:     </system>
Oct 20 10:22:42 user nova-compute[74311]:   </sysinfo>
Oct 20 10:22:42 user nova-compute[74311]:   <os>
Oct 20 10:22:42 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:22:42 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:22:42 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:22:42 user nova-compute[74311]:   </os>
Oct 20 10:22:42 user nova-compute[74311]:   <features>
Oct 20 10:22:42 user nova-compute[74311]:     <acpi/>
Oct 20 10:22:42 user nova-compute[74311]:     <apic/>
Oct 20 10:22:42 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:22:42 user nova-compute[74311]:   </features>
Oct 20 10:22:42 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:22:42 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:22:42 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:22:42 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:22:42 user nova-compute[74311]:   </clock>
Oct 20 10:22:42 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:22:42 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:22:42 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:22:42 user nova-compute[74311]:   </cpu>
Oct 20 10:22:42 user nova-compute[74311]:   <devices>
Oct 20 10:22:42 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:22:42 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:22:42 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk"/>
Oct 20 10:22:42 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:22:42 user nova-compute[74311]:     </disk>
Oct 20 10:22:42 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:22:42 user nova-compute[74311]:       <mac address="fa:16:3e:86:ab:91"/>
Oct 20 10:22:42 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:42 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:22:42 user nova-compute[74311]:       <target dev="tap373868c2-ef"/>
Oct 20 10:22:42 user nova-compute[74311]:     </interface>
Oct 20 10:22:42 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:22:42 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/console.log" append="off"/>
Oct 20 10:22:42 user nova-compute[74311]:     </serial>
Oct 20 10:22:42 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:22:42 user nova-compute[74311]:     <video>
Oct 20 10:22:42 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:42 user nova-compute[74311]:     </video>
Oct 20 10:22:42 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:22:42 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:22:42 user nova-compute[74311]:     </rng>
Oct 20 10:22:42 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:22:42 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:22:42 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:22:42 user nova-compute[74311]:     </memballoon>
Oct 20 10:22:42 user nova-compute[74311]:   </devices>
Oct 20 10:22:42 user nova-compute[74311]: </domain>
Oct 20 10:22:42 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-586227952',display_name='tempest-VolumesActionsTest-instance-586227952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-586227952',id=25,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f97431e31c9c43589464cb6f54c98ec1',ramdisk_id='',reservation_id='r-7by2xvvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-674463254',owner_user_name='tempest-VolumesActionsTest-674463254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:22:40Z,user_data=None,user_id='1b5f9d22dceb4dc0af82280861e3ae44',uuid=84361c20-e801-4e16-9ca2-b9eff8620917,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "373868c2-efc4-4844-a47a-cb8e93add3df", "address": "fa:16:3e:86:ab:91", "network": {"id": "166cf710-5a3f-46b7-b648-8bd3f0418422", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733058383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97431e31c9c43589464cb6f54c98ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373868c2-ef", "ovs_interfaceid": "373868c2-efc4-4844-a47a-cb8e93add3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Converting VIF {"id": "373868c2-efc4-4844-a47a-cb8e93add3df", "address": "fa:16:3e:86:ab:91", "network": {"id": "166cf710-5a3f-46b7-b648-8bd3f0418422", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733058383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97431e31c9c43589464cb6f54c98ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373868c2-ef", "ovs_interfaceid": "373868c2-efc4-4844-a47a-cb8e93add3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:91,bridge_name='br-int',has_traffic_filtering=True,id=373868c2-efc4-4844-a47a-cb8e93add3df,network=Network(166cf710-5a3f-46b7-b648-8bd3f0418422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373868c2-ef') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG os_vif [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:91,bridge_name='br-int',has_traffic_filtering=True,id=373868c2-efc4-4844-a47a-cb8e93add3df,network=Network(166cf710-5a3f-46b7-b648-8bd3f0418422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373868c2-ef') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddb49f74-cc3a-56cc-89ca-42ab8b7f53f2', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap373868c2-ef, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap373868c2-ef, col_values=(('qos', UUID('d7873b72-0cba-4dc7-a971-b23d0c8654cc')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap373868c2-ef, col_values=(('external_ids', {'iface-id': '373868c2-efc4-4844-a47a-cb8e93add3df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:ab:91', 'vm-uuid': '84361c20-e801-4e16-9ca2-b9eff8620917'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:42 user nova-compute[74311]: INFO os_vif [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:91,bridge_name='br-int',has_traffic_filtering=True,id=373868c2-efc4-4844-a47a-cb8e93add3df,network=Network(166cf710-5a3f-46b7-b648-8bd3f0418422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373868c2-ef')
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.network.neutron [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Updating instance_info_cache with network_info: [{"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] No VIF found with MAC fa:16:3e:86:ab:91, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Releasing lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:22:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:43 user nova-compute[74311]: DEBUG nova.network.neutron [req-4eaf6526-d1d6-42b8-9c89-98c685dfea43 req-56618adc-f2d0-48ff-b637-c2a5d2fd672b service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Updated VIF entry in instance network info cache for port 373868c2-efc4-4844-a47a-cb8e93add3df. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:22:43 user nova-compute[74311]: DEBUG nova.network.neutron [req-4eaf6526-d1d6-42b8-9c89-98c685dfea43 req-56618adc-f2d0-48ff-b637-c2a5d2fd672b service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Updating instance_info_cache with network_info: [{"id": "373868c2-efc4-4844-a47a-cb8e93add3df", "address": "fa:16:3e:86:ab:91", "network": {"id": "166cf710-5a3f-46b7-b648-8bd3f0418422", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733058383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97431e31c9c43589464cb6f54c98ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373868c2-ef", "ovs_interfaceid": "373868c2-efc4-4844-a47a-cb8e93add3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:22:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4eaf6526-d1d6-42b8-9c89-98c685dfea43 req-56618adc-f2d0-48ff-b637-c2a5d2fd672b service nova] Releasing lock "refresh_cache-84361c20-e801-4e16-9ca2-b9eff8620917" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:22:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-882f350f-be76-48d5-a0ff-52c643340e43 req-43f98104-c575-4470-ae5f-06c8c248347f service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-vif-unplugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-882f350f-be76-48d5-a0ff-52c643340e43 req-43f98104-c575-4470-ae5f-06c8c248347f service nova] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-882f350f-be76-48d5-a0ff-52c643340e43 req-43f98104-c575-4470-ae5f-06c8c248347f service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-882f350f-be76-48d5-a0ff-52c643340e43 req-43f98104-c575-4470-ae5f-06c8c248347f service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-882f350f-be76-48d5-a0ff-52c643340e43 req-43f98104-c575-4470-ae5f-06c8c248347f service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] No waiting events found dispatching network-vif-unplugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:43 user nova-compute[74311]: WARNING nova.compute.manager [req-882f350f-be76-48d5-a0ff-52c643340e43 req-43f98104-c575-4470-ae5f-06c8c248347f service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received unexpected event network-vif-unplugged-058da87e-19f4-49ec-9ddd-c9e793db0844 for instance with vm_state active and task_state rescuing.
Oct 20 10:22:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-baec8fe4-8243-407a-86fc-2aac48dbf893 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-baec8fe4-8243-407a-86fc-2aac48dbf893 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:44 user nova-compute[74311]: WARNING nova.compute.manager [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-baec8fe4-8243-407a-86fc-2aac48dbf893 for instance with vm_state active and task_state None.
Oct 20 10:22:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-baec8fe4-8243-407a-86fc-2aac48dbf893 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-baec8fe4-8243-407a-86fc-2aac48dbf893 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:44 user nova-compute[74311]: WARNING nova.compute.manager [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-baec8fe4-8243-407a-86fc-2aac48dbf893 for instance with vm_state active and task_state None.
Oct 20 10:22:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-f80e2f85-5f8c-456b-aa14-3eca6f495a92 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-f80e2f85-5f8c-456b-aa14-3eca6f495a92 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:44 user nova-compute[74311]: WARNING nova.compute.manager [req-bf088405-e366-40ee-8f88-f91a59d08d73 req-f8b20872-628b-4b51-ad34-bbb0b1502c0b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-f80e2f85-5f8c-456b-aa14-3eca6f495a92 for instance with vm_state active and task_state None.
Oct 20 10:22:44 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Instance destroyed successfully.
Oct 20 10:22:44 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Attempting a stable device rescue
Oct 20 10:22:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74311) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Instance directory exists: not creating {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 10:22:44 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Creating image(s)
Oct 20 10:22:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "/opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "/opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG nova.objects.instance [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "5642d7050e9009ba2c59697cf5eafe85833c92f3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "5642d7050e9009ba2c59697cf5eafe85833c92f3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3.part --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-dd365d41-7a20-4ef9-9a18-734fe69583d4 req-c6631d68-5ba1-4505-b6a9-dc161fa91037 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-dd365d41-7a20-4ef9-9a18-734fe69583d4 req-c6631d68-5ba1-4505-b6a9-dc161fa91037 service nova] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-dd365d41-7a20-4ef9-9a18-734fe69583d4 req-c6631d68-5ba1-4505-b6a9-dc161fa91037 service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-dd365d41-7a20-4ef9-9a18-734fe69583d4 req-c6631d68-5ba1-4505-b6a9-dc161fa91037 service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-dd365d41-7a20-4ef9-9a18-734fe69583d4 req-c6631d68-5ba1-4505-b6a9-dc161fa91037 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] No waiting events found dispatching network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:46 user nova-compute[74311]: WARNING nova.compute.manager [req-dd365d41-7a20-4ef9-9a18-734fe69583d4 req-c6631d68-5ba1-4505-b6a9-dc161fa91037 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received unexpected event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 for instance with vm_state active and task_state rescuing.
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3.part --force-share --output=json" returned: 0 in 0.314s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG nova.virt.images [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] 132b39c4-16cd-47ac-aaaa-4ad342df7314 was qcow2, converting to raw {{(pid=74311) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3.part /opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3.converted {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-f80e2f85-5f8c-456b-aa14-3eca6f495a92 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-f80e2f85-5f8c-456b-aa14-3eca6f495a92 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:46 user nova-compute[74311]: WARNING nova.compute.manager [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-f80e2f85-5f8c-456b-aa14-3eca6f495a92 for instance with vm_state active and task_state None.
Oct 20 10:22:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Received event network-vif-plugged-373868c2-efc4-4844-a47a-cb8e93add3df {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] Acquiring lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] Lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] Lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] No waiting events found dispatching network-vif-plugged-373868c2-efc4-4844-a47a-cb8e93add3df {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:46 user nova-compute[74311]: WARNING nova.compute.manager [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Received unexpected event network-vif-plugged-373868c2-efc4-4844-a47a-cb8e93add3df for instance with vm_state building and task_state spawning.
Oct 20 10:22:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Received event network-vif-plugged-373868c2-efc4-4844-a47a-cb8e93add3df {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] Acquiring lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] Lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] Lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] No waiting events found dispatching network-vif-plugged-373868c2-efc4-4844-a47a-cb8e93add3df {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:46 user nova-compute[74311]: WARNING nova.compute.manager [req-f62de299-cd87-48ba-8274-220958bf2911 req-03bc707c-a414-46a8-b027-d4081de77d3d service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Received unexpected event network-vif-plugged-373868c2-efc4-4844-a47a-cb8e93add3df for instance with vm_state building and task_state spawning.
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3.part /opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3.converted" returned: 0 in 0.483s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3.converted --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3.converted --force-share --output=json" returned: 0 in 0.234s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "5642d7050e9009ba2c59697cf5eafe85833c92f3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.606s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "5642d7050e9009ba2c59697cf5eafe85833c92f3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "5642d7050e9009ba2c59697cf5eafe85833c92f3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3 --force-share --output=json" returned: 0 in 0.227s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3,backing_fmt=raw /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.rescue {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3,backing_fmt=raw /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.rescue" returned: 0 in 0.062s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "5642d7050e9009ba2c59697cf5eafe85833c92f3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.objects.instance [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lazy-loading 'migration_context' on Instance uuid 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.objects.base [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Object Instance<2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Start _get_guest_xml network_info=[{"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "vif_mac": "fa:16:3e:ea:eb:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '132b39c4-16cd-47ac-aaaa-4ad342df7314', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'b9f2ea0f-47b7-4fc9-a464-2fd2005922f6', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGTJPFYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9', 'attached_at': '', 'detached_at': '', 'volume_id': 'f375fade-d000-4d2e-ba16-066b56a75692', 'serial': 'f375fade-d000-4d2e-ba16-066b56a75692'}, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.objects.instance [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lazy-loading 'resources' on Instance uuid 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.objects.base [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Object Instance<2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.objects.instance [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lazy-loading 'numa_topology' on Instance uuid 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.objects.base [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Object Instance<2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:22:47 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:22:47 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.objects.instance [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.objects.base [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Object Instance<2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGTJPFYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:22:47 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:22:47 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:22:47 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260" returned: 0 in 0.059s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9d89fe-e8f2-42f2-9fb3-570e97923eee]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = CGTJPFYc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 10:22:47 user nova-compute[74311]: node.name = iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692
Oct 20 10:22:47 user nova-compute[74311]: node.tpgt = -1
Oct 20 10:22:47 user nova-compute[74311]: node.startup = automatic
Oct 20 10:22:47 user nova-compute[74311]: node.leading_login = No
Oct 20 10:22:47 user nova-compute[74311]: iface.iscsi_ifacename = default
Oct 20 10:22:47 user nova-compute[74311]: iface.net_ifacename = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.ipaddress = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.prefix_len = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.hwaddress = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.transport_name = tcp
Oct 20 10:22:47 user nova-compute[74311]: iface.initiatorname = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.state = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.vlan_id = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.vlan_priority = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.vlan_state = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.iface_num = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.mtu = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.port = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.bootproto = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.subnet_mask = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.gateway = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.dhcp_alt_client_id = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.dhcp_dns = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.dhcp_learn_iqn = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.dhcp_vendor_id_state = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.dhcp_vendor_id = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.dhcp_slp_da = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.fragmentation = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.gratuitous_arp = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.incoming_forwarding = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.tos_state = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.tos = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.ttl = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.delayed_ack = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.tcp_nagle = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.tcp_wsf_state = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.tcp_wsf = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.tcp_timer_scale = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.tcp_timestamp = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.redirect = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.def_task_mgmt_timeout = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.header_digest = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.data_digest = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.immediate_data = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.initial_r2t = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.data_seq_inorder = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.data_pdu_inorder = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.erl = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.max_receive_data_len = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.first_burst_len = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.max_outstanding_r2t = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.max_burst_len = 0
Oct 20 10:22:47 user nova-compute[74311]: iface.chap_auth = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.bidi_chap = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.strict_login_compliance = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.discovery_auth = <empty>
Oct 20 10:22:47 user nova-compute[74311]: iface.discovery_logout = <empty>
Oct 20 10:22:47 user nova-compute[74311]: node.discovery_address = <empty>
Oct 20 10:22:47 user nova-compute[74311]: node.discovery_port = 0
Oct 20 10:22:47 user nova-compute[74311]: node.discovery_type = static
Oct 20 10:22:47 user nova-compute[74311]: node.session.initial_cmdsn = 0
Oct 20 10:22:47 user nova-compute[74311]: node.session.initial_login_retry_max = 8
Oct 20 10:22:47 user nova-compute[74311]: node.session.xmit_thread_priority = -20
Oct 20 10:22:47 user nova-compute[74311]: node.session.cmds_max = 128
Oct 20 10:22:47 user nova-compute[74311]: node.session.queue_depth = 32
Oct 20 10:22:47 user nova-compute[74311]: node.session.nr_sessions = 1
Oct 20 10:22:47 user nova-compute[74311]: node.session.auth.authmethod = CHAP
Oct 20 10:22:47 user nova-compute[74311]: node.session.auth.username = CGTJPFYc
Oct 20 10:22:47 user nova-compute[74311]: node.session.auth.password = ***
Oct 20 10:22:47 user nova-compute[74311]: node.session.auth.username_in = <empty>
Oct 20 10:22:47 user nova-compute[74311]: node.session.auth.password_in = <empty>
Oct 20 10:22:47 user nova-compute[74311]: node.session.auth.chap_algs = MD5
Oct 20 10:22:47 user nova-compute[74311]: node.session.timeo.replacement_timeout = 120
Oct 20 10:22:47 user nova-compute[74311]: node.session.err_timeo.abort_timeout = 15
Oct 20 10:22:47 user nova-compute[74311]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 10:22:47 user nova-compute[74311]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 10:22:47 user nova-compute[74311]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 10:22:47 user nova-compute[74311]: node.session.iscsi.FastAbort = Yes
Oct 20 10:22:47 user nova-compute[74311]: node.session.iscsi.InitialR2T = No
Oct 20 10:22:47 user nova-compute[74311]: node.session.iscsi.ImmediateData = Yes
Oct 20 10:22:47 user nova-compute[74311]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 10:22:47 user nova-compute[74311]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 10:22:47 user nova-compute[74311]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 10:22:47 user nova-compute[74311]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 10:22:47 user nova-compute[74311]: node.session.iscsi.MaxConnections = 1
Oct 20 10:22:47 user nova-compute[74311]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 10:22:47 user nova-compute[74311]: node.session.iscsi.ERL = 0
Oct 20 10:22:47 user nova-compute[74311]: node.session.scan = manual
Oct 20 10:22:47 user nova-compute[74311]: node.session.reopen_max = 0
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].address = 172.16.0.220
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].port = 3260
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].startup = manual
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].tcp.window_size = 524288
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].tcp.type_of_service = 0
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].timeo.logout_timeout = 15
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].timeo.login_timeout = 15
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].timeo.auth_timeout = 45
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].iscsi.DataDigest = None
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].iscsi.IFMarker = No
Oct 20 10:22:47 user nova-compute[74311]: node.conn[0].iscsi.OFMarker = No
Oct 20 10:22:47 user nova-compute[74311]: # END RECORD
Oct 20 10:22:47 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d44ded-355e-4267-890d-4c3ca18c1d26]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c211a2d-94fb-4d65-9014-4cc4311283b4]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CGTJPFYc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CGTJPFYc" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daefa92-0245-492a-8c60-0bb0fd0bbb51]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CGTJPFYc'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca5c354-dc87-428f-99f5-af7b6822a404]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a12b0af-d19d-4a9b-867f-354f9c614948]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:47 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:47 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:47 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:47 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:22:47 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:22:47 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:22:47 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:47 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:47 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:47 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:47 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:22:47 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:22:47 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:22:47 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.222s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] HCTL ('39', '0', '0', 0) found on session 26 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bbedb8-d12c-4b3f-96ca-8608bb478d3e]: (4, ('0 0 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Searching for a device in session 26 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGTJPFYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.252s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] <== connect_volume: return (253ms) {'type': 'block', 'scsi_wwn': '26562376639396536', 'path': '/dev/sdh'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:22:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562376639396536', 'path': '/dev/sdh'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-475240772',display_name='tempest-ServerStableDeviceRescueTest-server-475240772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-475240772',id=21,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSaHAPJXPwHtr2z75hfGwvgYy3fJDl5BHYwTboRDjafFsh+foIsirIZZlOfDFQCIr1XyckI18S7vdaeeKQn22XSAYFAeShpR9yHRJWrgjTk9bykSFraTWi88/itm+f41A==',key_name='tempest-keypair-735267954',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:18:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9724497a866463aa572a186693520b8',ramdisk_id='',reservation_id='r-7efu0f60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1321548002',owner_user_name='tempest-ServerStableDeviceRescueTest-1321548002-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:20:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eacf2bfd21e24516b6613c5e62f9c815',uuid=2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "vif_mac": "fa:16:3e:ea:eb:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Converting VIF {"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "vif_mac": "fa:16:3e:ea:eb:6a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:eb:6a,bridge_name='br-int',has_traffic_filtering=True,id=058da87e-19f4-49ec-9ddd-c9e793db0844,network=Network(faf442c8-81aa-425e-a35c-f3cbe7afa1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap058da87e-19') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.objects.instance [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.objects.base [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Object Instance<2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:22:48 user nova-compute[74311]:   <uuid>2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9</uuid>
Oct 20 10:22:48 user nova-compute[74311]:   <name>instance-00000015</name>
Oct 20 10:22:48 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:22:48 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:22:48 user nova-compute[74311]:   <metadata>
Oct 20 10:22:48 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:22:48 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:22:48 user nova-compute[74311]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-475240772</nova:name>
Oct 20 10:22:48 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:22:47</nova:creationTime>
Oct 20 10:22:48 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:22:48 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:22:48 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:22:48 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:22:48 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:22:48 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:22:48 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:22:48 user nova-compute[74311]:       <nova:owner>
Oct 20 10:22:48 user nova-compute[74311]:         <nova:user uuid="eacf2bfd21e24516b6613c5e62f9c815">tempest-ServerStableDeviceRescueTest-1321548002-project-member</nova:user>
Oct 20 10:22:48 user nova-compute[74311]:         <nova:project uuid="f9724497a866463aa572a186693520b8">tempest-ServerStableDeviceRescueTest-1321548002</nova:project>
Oct 20 10:22:48 user nova-compute[74311]:       </nova:owner>
Oct 20 10:22:48 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:22:48 user nova-compute[74311]:       <nova:ports>
Oct 20 10:22:48 user nova-compute[74311]:         <nova:port uuid="058da87e-19f4-49ec-9ddd-c9e793db0844">
Oct 20 10:22:48 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 10:22:48 user nova-compute[74311]:         </nova:port>
Oct 20 10:22:48 user nova-compute[74311]:       </nova:ports>
Oct 20 10:22:48 user nova-compute[74311]:     </nova:instance>
Oct 20 10:22:48 user nova-compute[74311]:   </metadata>
Oct 20 10:22:48 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:22:48 user nova-compute[74311]:     <system>
Oct 20 10:22:48 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:22:48 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:22:48 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:22:48 user nova-compute[74311]:       <entry name="serial">2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9</entry>
Oct 20 10:22:48 user nova-compute[74311]:       <entry name="uuid">2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9</entry>
Oct 20 10:22:48 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:22:48 user nova-compute[74311]:     </system>
Oct 20 10:22:48 user nova-compute[74311]:   </sysinfo>
Oct 20 10:22:48 user nova-compute[74311]:   <os>
Oct 20 10:22:48 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:22:48 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:22:48 user nova-compute[74311]:   </os>
Oct 20 10:22:48 user nova-compute[74311]:   <features>
Oct 20 10:22:48 user nova-compute[74311]:     <acpi/>
Oct 20 10:22:48 user nova-compute[74311]:     <apic/>
Oct 20 10:22:48 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:22:48 user nova-compute[74311]:   </features>
Oct 20 10:22:48 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:22:48 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:22:48 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:22:48 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:22:48 user nova-compute[74311]:   </clock>
Oct 20 10:22:48 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:22:48 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:22:48 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:22:48 user nova-compute[74311]:   </cpu>
Oct 20 10:22:48 user nova-compute[74311]:   <devices>
Oct 20 10:22:48 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:22:48 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:22:48 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk"/>
Oct 20 10:22:48 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:22:48 user nova-compute[74311]:     </disk>
Oct 20 10:22:48 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:22:48 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:22:48 user nova-compute[74311]:       <source dev="/dev/sdh"/>
Oct 20 10:22:48 user nova-compute[74311]:       <target dev="vdb" bus="virtio"/>
Oct 20 10:22:48 user nova-compute[74311]:       <serial>f375fade-d000-4d2e-ba16-066b56a75692</serial>
Oct 20 10:22:48 user nova-compute[74311]:     </disk>
Oct 20 10:22:48 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:22:48 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:22:48 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.rescue"/>
Oct 20 10:22:48 user nova-compute[74311]:       <target dev="vdc" bus="virtio"/>
Oct 20 10:22:48 user nova-compute[74311]:       <boot order="1"/>
Oct 20 10:22:48 user nova-compute[74311]:     </disk>
Oct 20 10:22:48 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:22:48 user nova-compute[74311]:       <mac address="fa:16:3e:ea:eb:6a"/>
Oct 20 10:22:48 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:48 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:22:48 user nova-compute[74311]:       <target dev="tap058da87e-19"/>
Oct 20 10:22:48 user nova-compute[74311]:     </interface>
Oct 20 10:22:48 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:22:48 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/console.log" append="off"/>
Oct 20 10:22:48 user nova-compute[74311]:     </serial>
Oct 20 10:22:48 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:22:48 user nova-compute[74311]:     <video>
Oct 20 10:22:48 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:22:48 user nova-compute[74311]:     </video>
Oct 20 10:22:48 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:22:48 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:22:48 user nova-compute[74311]:     </rng>
Oct 20 10:22:48 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:22:48 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:22:48 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:22:48 user nova-compute[74311]:     </memballoon>
Oct 20 10:22:48 user nova-compute[74311]:   </devices>
Oct 20 10:22:48 user nova-compute[74311]: </domain>
Oct 20 10:22:48 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:22:48 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Instance destroyed successfully.
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] No VIF found with MAC fa:16:3e:ea:eb:6a, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.compute.manager [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:22:48 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Instance spawned successfully.
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:22:48 user nova-compute[74311]: INFO nova.compute.manager [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Took 8.19 seconds to spawn the instance on the hypervisor.
Oct 20 10:22:48 user nova-compute[74311]: DEBUG nova.compute.manager [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:22:48 user nova-compute[74311]: INFO nova.compute.manager [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Took 9.75 seconds to build instance.
Oct 20 10:22:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-42ef5d01-ecbc-4b00-ac88-f709d132ed43 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "84361c20-e801-4e16-9ca2-b9eff8620917" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.889s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:50 user nova-compute[74311]: DEBUG nova.compute.manager [req-166235a2-550b-4503-8a38-31c2a8b45864 req-7864d36c-7d85-4f3e-a42a-ff2ddcf0411d service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-166235a2-550b-4503-8a38-31c2a8b45864 req-7864d36c-7d85-4f3e-a42a-ff2ddcf0411d service nova] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-166235a2-550b-4503-8a38-31c2a8b45864 req-7864d36c-7d85-4f3e-a42a-ff2ddcf0411d service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-166235a2-550b-4503-8a38-31c2a8b45864 req-7864d36c-7d85-4f3e-a42a-ff2ddcf0411d service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:50 user nova-compute[74311]: DEBUG nova.compute.manager [req-166235a2-550b-4503-8a38-31c2a8b45864 req-7864d36c-7d85-4f3e-a42a-ff2ddcf0411d service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] No waiting events found dispatching network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:50 user nova-compute[74311]: WARNING nova.compute.manager [req-166235a2-550b-4503-8a38-31c2a8b45864 req-7864d36c-7d85-4f3e-a42a-ff2ddcf0411d service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received unexpected event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 for instance with vm_state active and task_state rescuing.
Oct 20 10:22:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-0ba6541b-ab48-48ea-b55f-28e5ab22f48b req-dfe6ffc0-6288-41af-ba16-78bd79ae93c9 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0ba6541b-ab48-48ea-b55f-28e5ab22f48b req-dfe6ffc0-6288-41af-ba16-78bd79ae93c9 service nova] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0ba6541b-ab48-48ea-b55f-28e5ab22f48b req-dfe6ffc0-6288-41af-ba16-78bd79ae93c9 service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0ba6541b-ab48-48ea-b55f-28e5ab22f48b req-dfe6ffc0-6288-41af-ba16-78bd79ae93c9 service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-0ba6541b-ab48-48ea-b55f-28e5ab22f48b req-dfe6ffc0-6288-41af-ba16-78bd79ae93c9 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] No waiting events found dispatching network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:52 user nova-compute[74311]: WARNING nova.compute.manager [req-0ba6541b-ab48-48ea-b55f-28e5ab22f48b req-dfe6ffc0-6288-41af-ba16-78bd79ae93c9 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received unexpected event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 for instance with vm_state active and task_state rescuing.
Oct 20 10:22:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-6b17d095-efe1-4cde-9970-7c010493b125 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:22:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:53 user nova-compute[74311]: INFO nova.compute.manager [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Terminating instance
Oct 20 10:22:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:22:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-f0f3498e-9c3a-44a7-9062-b5fbc7c8ff79 req-7fccb1d8-9f9e-4838-b518-cd5c221fa834 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-vif-unplugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f0f3498e-9c3a-44a7-9062-b5fbc7c8ff79 req-7fccb1d8-9f9e-4838-b518-cd5c221fa834 service nova] Acquiring lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f0f3498e-9c3a-44a7-9062-b5fbc7c8ff79 req-7fccb1d8-9f9e-4838-b518-cd5c221fa834 service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f0f3498e-9c3a-44a7-9062-b5fbc7c8ff79 req-7fccb1d8-9f9e-4838-b518-cd5c221fa834 service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-f0f3498e-9c3a-44a7-9062-b5fbc7c8ff79 req-7fccb1d8-9f9e-4838-b518-cd5c221fa834 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] No waiting events found dispatching network-vif-unplugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-f0f3498e-9c3a-44a7-9062-b5fbc7c8ff79 req-7fccb1d8-9f9e-4838-b518-cd5c221fa834 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-vif-unplugged-75daa4b7-a58b-4b60-afe8-97f535c09013 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:22:54 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Instance destroyed successfully.
Oct 20 10:22:54 user nova-compute[74311]: DEBUG nova.objects.instance [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lazy-loading 'resources' on Instance uuid dcecd43c-0d21-4413-8fa5-02856f450b6a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T10:17:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1629854730',display_name='tempest-TestShelveInstance-server-1629854730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1629854730',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2UxbbXgt1Yjqj2Jy+4hK+bHV+8XArE1GdXdX6r3BeFQkm5c7q7uB2eCMejr9+vfpzUQXSvTiWFoqEOQyEZWoIyoI17DF/JmFIRD9vSrs/u5ApnK+LyZ3AJ/6PG25kn0w==',key_name='tempest-TestShelveInstance-252767667',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dd35c1e7d774f1db10dce2f42915a80',ramdisk_id='',reservation_id='r-norxghh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1328079289',owner_user_name='tempest-TestShelveInstance-1328079289-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:21:30Z,user_data=None,user_id='7d74f45f32004531a84f76f16254d459',uuid=dcecd43c-0d21-4413-8fa5-02856f450b6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Converting VIF {"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=75daa4b7-a58b-4b60-afe8-97f535c09013,network=Network(b5d1e6f9-d369-41f2-a536-07de25499fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75daa4b7-a5') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_vif [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=75daa4b7-a58b-4b60-afe8-97f535c09013,network=Network(b5d1e6f9-d369-41f2-a536-07de25499fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75daa4b7-a5') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75daa4b7-a5, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68f04944-0f33-4c02-95c3-f1230b902687) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:22:54 user nova-compute[74311]: INFO os_vif [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=75daa4b7-a58b-4b60-afe8-97f535c09013,network=Network(b5d1e6f9-d369-41f2-a536-07de25499fe5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75daa4b7-a5')
Oct 20 10:22:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGCHmwir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:22:54 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d14d475-4320-4b1e-95f4-d373a76a12b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:22:54 user nova-compute[74311]: No targets found.
Oct 20 10:22:54 user nova-compute[74311]: iSNS:
Oct 20 10:22:54 user nova-compute[74311]: No targets found.
Oct 20 10:22:54 user nova-compute[74311]: STATIC:
Oct 20 10:22:54 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd
Oct 20 10:22:54 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:22:54 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:22:54 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9
Oct 20 10:22:54 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:22:54 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:22:54 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:22:54 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:22:54 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:22:54 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f
Oct 20 10:22:54 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:22:54 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:22:54 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b
Oct 20 10:22:54 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:22:54 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:22:54 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53
Oct 20 10:22:54 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:22:54 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:22:54 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692
Oct 20 10:22:54 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:22:54 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:22:54 user nova-compute[74311]: FIRMWARE:
Oct 20 10:22:54 user nova-compute[74311]: No targets found.
Oct 20 10:22:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:22:54 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:22:54 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6694aa59-f803-4471-a67b-86091155d1a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acf7868-718e-451c-9dd6-fa7d5850aa93]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:54 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:54 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:54 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:54 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:22:54 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:22:54 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:22:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:22:54 user nova-compute[74311]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f (non-flash)
Oct 20 10:22:54 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:22:54 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:22:54 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:22:54 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:22:54 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:22:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164f8f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f'): ({'sdc'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Removing single pathed devices sdc {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[153fed12-f4aa-49d0-b222-0c615d7efbd1]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-a14d890b-251d-47b9-8b56-a52abf7b6401 req-bbc2ec2f-a055-45bc-b740-641b269f268e service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-changed-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-a14d890b-251d-47b9-8b56-a52abf7b6401 req-bbc2ec2f-a055-45bc-b740-641b269f268e service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Refreshing instance network info cache due to event network-changed-75daa4b7-a58b-4b60-afe8-97f535c09013. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a14d890b-251d-47b9-8b56-a52abf7b6401 req-bbc2ec2f-a055-45bc-b740-641b269f268e service nova] Acquiring lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a14d890b-251d-47b9-8b56-a52abf7b6401 req-bbc2ec2f-a055-45bc-b740-641b269f268e service nova] Acquired lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG nova.network.neutron [req-a14d890b-251d-47b9-8b56-a52abf7b6401 req-bbc2ec2f-a055-45bc-b740-641b269f268e service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Refreshing network info cache for port 75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.047s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc3c7ae-7c5e-45cd-86a5-cd94ac48bea4]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Flushing IO for device /dev/sdc {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d6a535-5440-43e6-9272-622d203c6f87]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c449fbc-fe3c-4333-bd75-df1b858b440a]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de73314-47c5-449e-8c7d-1956cb2c5523]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaabaa0-cd16-4bdd-af71-337e7db2dd36]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260]
Oct 20 10:22:54 user nova-compute[74311]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f, portal: 172.16.0.220,3260] successful.
Oct 20 10:22:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:472b7899-fb18-4cf3-aed5-dd75907cc03f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5488ba63-a037-4373-8460-ec3bdf1ec07f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] <== disconnect_volume: return (446ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:22:54 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Deleting instance files /opt/stack/data/nova/instances/dcecd43c-0d21-4413-8fa5-02856f450b6a_del
Oct 20 10:22:54 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Deletion of /opt/stack/data/nova/instances/dcecd43c-0d21-4413-8fa5-02856f450b6a_del complete
Oct 20 10:22:54 user nova-compute[74311]: INFO nova.compute.manager [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Took 1.53 seconds to destroy the instance on the hypervisor.
Oct 20 10:22:54 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:22:54 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:22:55 user nova-compute[74311]: DEBUG nova.network.neutron [req-a14d890b-251d-47b9-8b56-a52abf7b6401 req-bbc2ec2f-a055-45bc-b740-641b269f268e service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updated VIF entry in instance network info cache for port 75daa4b7-a58b-4b60-afe8-97f535c09013. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:22:55 user nova-compute[74311]: DEBUG nova.network.neutron [req-a14d890b-251d-47b9-8b56-a52abf7b6401 req-bbc2ec2f-a055-45bc-b740-641b269f268e service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updating instance_info_cache with network_info: [{"id": "75daa4b7-a58b-4b60-afe8-97f535c09013", "address": "fa:16:3e:d0:c5:3e", "network": {"id": "b5d1e6f9-d369-41f2-a536-07de25499fe5", "bridge": "br-int", "label": "tempest-TestShelveInstance-2088344646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dd35c1e7d774f1db10dce2f42915a80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75daa4b7-a5", "ovs_interfaceid": "75daa4b7-a58b-4b60-afe8-97f535c09013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:22:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a14d890b-251d-47b9-8b56-a52abf7b6401 req-bbc2ec2f-a055-45bc-b740-641b269f268e service nova] Releasing lock "refresh_cache-dcecd43c-0d21-4413-8fa5-02856f450b6a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:22:55 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:22:55 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Took 0.84 seconds to deallocate network for instance.
Oct 20 10:22:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-8f6c95ae-f98a-4654-9ab3-bdf999abccb2 req-b00ac720-c768-4cc6-829b-24ade3a4a9d3 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8f6c95ae-f98a-4654-9ab3-bdf999abccb2 req-b00ac720-c768-4cc6-829b-24ade3a4a9d3 service nova] Acquiring lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8f6c95ae-f98a-4654-9ab3-bdf999abccb2 req-b00ac720-c768-4cc6-829b-24ade3a4a9d3 service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8f6c95ae-f98a-4654-9ab3-bdf999abccb2 req-b00ac720-c768-4cc6-829b-24ade3a4a9d3 service nova] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-8f6c95ae-f98a-4654-9ab3-bdf999abccb2 req-b00ac720-c768-4cc6-829b-24ade3a4a9d3 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] No waiting events found dispatching network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:22:56 user nova-compute[74311]: WARNING nova.compute.manager [req-8f6c95ae-f98a-4654-9ab3-bdf999abccb2 req-b00ac720-c768-4cc6-829b-24ade3a4a9d3 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received unexpected event network-vif-plugged-75daa4b7-a58b-4b60-afe8-97f535c09013 for instance with vm_state active and task_state deleting.
Oct 20 10:22:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-c04a9f94-037d-4993-9521-ec34f114d72a req-4ae6e73c-b46f-4bf4-bdb7-5450b4a18cf2 service nova] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Received event network-vif-deleted-75daa4b7-a58b-4b60-afe8-97f535c09013 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:22:56 user nova-compute[74311]: INFO nova.compute.manager [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Took 1.05 seconds to detach 1 volumes for instance.
Oct 20 10:22:56 user nova-compute[74311]: DEBUG nova.compute.manager [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] [instance: dcecd43c-0d21-4413-8fa5-02856f450b6a] Deleting volume: 472b7899-fb18-4cf3-aed5-dd75907cc03f {{(pid=74311) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 10:22:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:22:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:22:57 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:22:57 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:22:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.677s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:57 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Deleted allocations for instance dcecd43c-0d21-4413-8fa5-02856f450b6a
Oct 20 10:22:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3899a9ea-f2a9-41d5-bdc5-8ba0430889e9 tempest-TestShelveInstance-1328079289 tempest-TestShelveInstance-1328079289-project-member] Lock "dcecd43c-0d21-4413-8fa5-02856f450b6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.504s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:22:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:58 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:22:59 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:22:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:22:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:22:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:22:59 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: cfc97865-6f94-4924-afc5-188d50543672] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:22:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:22:59 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: cfc97865-6f94-4924-afc5-188d50543672] Updating instance_info_cache with network_info: [{"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:22:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:22:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: cfc97865-6f94-4924-afc5-188d50543672] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:23:01 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:23:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:05 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:23:05 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:23:06 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:23:06 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:23:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:23:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:23:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:23:06 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:23:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:23:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:11 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:23:11 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7070MB free_disk=25.099273681640625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 4011fd9a-7109-46b7-b77e-51c29e36a7d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 922b36b5-0575-4717-a876-dda27469ebb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfb50bd6-42e6-4f8a-af8c-712e52644cb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 84361c20-e801-4e16-9ca2-b9eff8620917 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing inventories for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Updating ProviderTree inventory for provider 77cac819-3c22-4fec-a59d-0525ac40a90b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Updating inventory in ProviderTree for provider 77cac819-3c22-4fec-a59d-0525ac40a90b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing aggregate associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, aggregates: None {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 10:23:11 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing trait associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3 {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 10:23:12 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:23:12 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:23:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:23:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.908s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:23:12 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:23:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 10:23:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] There are 0 instances to clean {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 10:23:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:13 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:23:13 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:23:13 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:23:13 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:23:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:17 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:23:17 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74311) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 10:23:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:18 user nova-compute[74311]: DEBUG nova.compute.manager [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:23:18 user nova-compute[74311]: INFO nova.compute.manager [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] instance snapshotting
Oct 20 10:23:18 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Beginning live snapshot process
Oct 20 10:23:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json -f qcow2 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json -f qcow2 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.167s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp08289whz/8b3b093dcb2048eea4d463917ed897a4.delta 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp08289whz/8b3b093dcb2048eea4d463917ed897a4.delta 1073741824" returned: 0 in 0.045s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:19 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 10:23:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:23:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] COPY block job progress, current cursor: 19202048 final cursor: 75497472 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:23:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:23:21 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 10:23:21 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:23:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp08289whz/8b3b093dcb2048eea4d463917ed897a4.delta /opt/stack/data/nova/instances/snapshots/tmp08289whz/8b3b093dcb2048eea4d463917ed897a4 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp08289whz/8b3b093dcb2048eea4d463917ed897a4.delta /opt/stack/data/nova/instances/snapshots/tmp08289whz/8b3b093dcb2048eea4d463917ed897a4" returned: 0 in 0.449s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:21 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Snapshot extracted, beginning image upload
Oct 20 10:23:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:24 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Snapshot image upload complete
Oct 20 10:23:24 user nova-compute[74311]: INFO nova.compute.manager [None req-7f3420f1-d24d-4f3b-81af-c6db3716907b tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Took 6.11 seconds to snapshot the instance on the hypervisor.
Oct 20 10:23:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:23:30 user nova-compute[74311]: INFO nova.compute.claims [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Claim successful on node user
Oct 20 10:23:30 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:23:30 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:23:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG nova.policy [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56f4022992534cb0b81e393ccbac8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed6d454e3a3423682cd4a6b21c685df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:23:30 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Creating image(s)
Oct 20 10:23:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "/opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "/opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:23:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.190s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Successfully created port: 06adef33-e2c4-4f11-95a4-bf02825e98e9 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk 1073741824" returned: 0 in 0.048s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.173s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Cannot resize image /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Ensure instance console log exists: /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Successfully updated port: 06adef33-e2c4-4f11-95a4-bf02825e98e9 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "refresh_cache-5d80f7e2-d18d-4d6f-b10d-73802d04aea2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquired lock "refresh_cache-5d80f7e2-d18d-4d6f-b10d-73802d04aea2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG nova.compute.manager [req-c34ed32c-b7ea-4411-bd73-c0eb2730bf86 req-666f96d1-493d-48de-a5cb-c19ae841ffe7 service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Received event network-changed-06adef33-e2c4-4f11-95a4-bf02825e98e9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG nova.compute.manager [req-c34ed32c-b7ea-4411-bd73-c0eb2730bf86 req-666f96d1-493d-48de-a5cb-c19ae841ffe7 service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Refreshing instance network info cache due to event network-changed-06adef33-e2c4-4f11-95a4-bf02825e98e9. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c34ed32c-b7ea-4411-bd73-c0eb2730bf86 req-666f96d1-493d-48de-a5cb-c19ae841ffe7 service nova] Acquiring lock "refresh_cache-5d80f7e2-d18d-4d6f-b10d-73802d04aea2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:23:31 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Updating instance_info_cache with network_info: [{"id": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "address": "fa:16:3e:5a:e9:4a", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06adef33-e2", "ovs_interfaceid": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Releasing lock "refresh_cache-5d80f7e2-d18d-4d6f-b10d-73802d04aea2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Instance network_info: |[{"id": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "address": "fa:16:3e:5a:e9:4a", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06adef33-e2", "ovs_interfaceid": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c34ed32c-b7ea-4411-bd73-c0eb2730bf86 req-666f96d1-493d-48de-a5cb-c19ae841ffe7 service nova] Acquired lock "refresh_cache-5d80f7e2-d18d-4d6f-b10d-73802d04aea2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.network.neutron [req-c34ed32c-b7ea-4411-bd73-c0eb2730bf86 req-666f96d1-493d-48de-a5cb-c19ae841ffe7 service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Refreshing network info cache for port 06adef33-e2c4-4f11-95a4-bf02825e98e9 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Start _get_guest_xml network_info=[{"id": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "address": "fa:16:3e:5a:e9:4a", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06adef33-e2", "ovs_interfaceid": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:23:32 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:23:32 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:23:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1367546423',display_name='tempest-VolumesActionsTest-instance-1367546423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1367546423',id=26,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed6d454e3a3423682cd4a6b21c685df',ramdisk_id='',reservation_id='r-5ds61iwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-711255224',owner_user_name='tempest-VolumesActionsTest-711255224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:23:31Z,user_data=None,user_id='56f4022992534cb0b81e393ccbac8d52',uuid=5d80f7e2-d18d-4d6f-b10d-73802d04aea2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "address": "fa:16:3e:5a:e9:4a", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06adef33-e2", "ovs_interfaceid": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Converting VIF {"id": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "address": "fa:16:3e:5a:e9:4a", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06adef33-e2", "ovs_interfaceid": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e9:4a,bridge_name='br-int',has_traffic_filtering=True,id=06adef33-e2c4-4f11-95a4-bf02825e98e9,network=Network(534777ae-0aa3-4431-9cf5-9154ace6d1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06adef33-e2') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.objects.instance [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d80f7e2-d18d-4d6f-b10d-73802d04aea2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:23:32 user nova-compute[74311]:   <uuid>5d80f7e2-d18d-4d6f-b10d-73802d04aea2</uuid>
Oct 20 10:23:32 user nova-compute[74311]:   <name>instance-0000001a</name>
Oct 20 10:23:32 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:23:32 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:23:32 user nova-compute[74311]:   <metadata>
Oct 20 10:23:32 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:23:32 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:23:32 user nova-compute[74311]:       <nova:name>tempest-VolumesActionsTest-instance-1367546423</nova:name>
Oct 20 10:23:32 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:23:32</nova:creationTime>
Oct 20 10:23:32 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:23:32 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:23:32 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:23:32 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:23:32 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:23:32 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:23:32 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:23:32 user nova-compute[74311]:       <nova:owner>
Oct 20 10:23:32 user nova-compute[74311]:         <nova:user uuid="56f4022992534cb0b81e393ccbac8d52">tempest-VolumesActionsTest-711255224-project-member</nova:user>
Oct 20 10:23:32 user nova-compute[74311]:         <nova:project uuid="bed6d454e3a3423682cd4a6b21c685df">tempest-VolumesActionsTest-711255224</nova:project>
Oct 20 10:23:32 user nova-compute[74311]:       </nova:owner>
Oct 20 10:23:32 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:23:32 user nova-compute[74311]:       <nova:ports>
Oct 20 10:23:32 user nova-compute[74311]:         <nova:port uuid="06adef33-e2c4-4f11-95a4-bf02825e98e9">
Oct 20 10:23:32 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 10:23:32 user nova-compute[74311]:         </nova:port>
Oct 20 10:23:32 user nova-compute[74311]:       </nova:ports>
Oct 20 10:23:32 user nova-compute[74311]:     </nova:instance>
Oct 20 10:23:32 user nova-compute[74311]:   </metadata>
Oct 20 10:23:32 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:23:32 user nova-compute[74311]:     <system>
Oct 20 10:23:32 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:23:32 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:23:32 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:23:32 user nova-compute[74311]:       <entry name="serial">5d80f7e2-d18d-4d6f-b10d-73802d04aea2</entry>
Oct 20 10:23:32 user nova-compute[74311]:       <entry name="uuid">5d80f7e2-d18d-4d6f-b10d-73802d04aea2</entry>
Oct 20 10:23:32 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:23:32 user nova-compute[74311]:     </system>
Oct 20 10:23:32 user nova-compute[74311]:   </sysinfo>
Oct 20 10:23:32 user nova-compute[74311]:   <os>
Oct 20 10:23:32 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:23:32 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:23:32 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:23:32 user nova-compute[74311]:   </os>
Oct 20 10:23:32 user nova-compute[74311]:   <features>
Oct 20 10:23:32 user nova-compute[74311]:     <acpi/>
Oct 20 10:23:32 user nova-compute[74311]:     <apic/>
Oct 20 10:23:32 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:23:32 user nova-compute[74311]:   </features>
Oct 20 10:23:32 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:23:32 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:23:32 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:23:32 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:23:32 user nova-compute[74311]:   </clock>
Oct 20 10:23:32 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:23:32 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:23:32 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:23:32 user nova-compute[74311]:   </cpu>
Oct 20 10:23:32 user nova-compute[74311]:   <devices>
Oct 20 10:23:32 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:23:32 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:23:32 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk"/>
Oct 20 10:23:32 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:23:32 user nova-compute[74311]:     </disk>
Oct 20 10:23:32 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:23:32 user nova-compute[74311]:       <mac address="fa:16:3e:5a:e9:4a"/>
Oct 20 10:23:32 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:23:32 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:23:32 user nova-compute[74311]:       <target dev="tap06adef33-e2"/>
Oct 20 10:23:32 user nova-compute[74311]:     </interface>
Oct 20 10:23:32 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:23:32 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/console.log" append="off"/>
Oct 20 10:23:32 user nova-compute[74311]:     </serial>
Oct 20 10:23:32 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:23:32 user nova-compute[74311]:     <video>
Oct 20 10:23:32 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:23:32 user nova-compute[74311]:     </video>
Oct 20 10:23:32 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:23:32 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:23:32 user nova-compute[74311]:     </rng>
Oct 20 10:23:32 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:23:32 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:23:32 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:23:32 user nova-compute[74311]:     </memballoon>
Oct 20 10:23:32 user nova-compute[74311]:   </devices>
Oct 20 10:23:32 user nova-compute[74311]: </domain>
Oct 20 10:23:32 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:23:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1367546423',display_name='tempest-VolumesActionsTest-instance-1367546423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1367546423',id=26,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed6d454e3a3423682cd4a6b21c685df',ramdisk_id='',reservation_id='r-5ds61iwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-711255224',owner_user_name='tempest-VolumesActionsTest-711255224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:23:31Z,user_data=None,user_id='56f4022992534cb0b81e393ccbac8d52',uuid=5d80f7e2-d18d-4d6f-b10d-73802d04aea2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "address": "fa:16:3e:5a:e9:4a", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06adef33-e2", "ovs_interfaceid": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Converting VIF {"id": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "address": "fa:16:3e:5a:e9:4a", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06adef33-e2", "ovs_interfaceid": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e9:4a,bridge_name='br-int',has_traffic_filtering=True,id=06adef33-e2c4-4f11-95a4-bf02825e98e9,network=Network(534777ae-0aa3-4431-9cf5-9154ace6d1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06adef33-e2') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG os_vif [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e9:4a,bridge_name='br-int',has_traffic_filtering=True,id=06adef33-e2c4-4f11-95a4-bf02825e98e9,network=Network(534777ae-0aa3-4431-9cf5-9154ace6d1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06adef33-e2') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '398be7af-ce8f-53d6-a877-c7d5b7315a37', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06adef33-e2, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06adef33-e2, col_values=(('qos', UUID('582fb298-089f-4302-b833-0410eb5a2a09')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06adef33-e2, col_values=(('external_ids', {'iface-id': '06adef33-e2c4-4f11-95a4-bf02825e98e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:e9:4a', 'vm-uuid': '5d80f7e2-d18d-4d6f-b10d-73802d04aea2'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:32 user nova-compute[74311]: INFO os_vif [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e9:4a,bridge_name='br-int',has_traffic_filtering=True,id=06adef33-e2c4-4f11-95a4-bf02825e98e9,network=Network(534777ae-0aa3-4431-9cf5-9154ace6d1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06adef33-e2')
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] No VIF found with MAC fa:16:3e:5a:e9:4a, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.network.neutron [req-c34ed32c-b7ea-4411-bd73-c0eb2730bf86 req-666f96d1-493d-48de-a5cb-c19ae841ffe7 service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Updated VIF entry in instance network info cache for port 06adef33-e2c4-4f11-95a4-bf02825e98e9. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG nova.network.neutron [req-c34ed32c-b7ea-4411-bd73-c0eb2730bf86 req-666f96d1-493d-48de-a5cb-c19ae841ffe7 service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Updating instance_info_cache with network_info: [{"id": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "address": "fa:16:3e:5a:e9:4a", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06adef33-e2", "ovs_interfaceid": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c34ed32c-b7ea-4411-bd73-c0eb2730bf86 req-666f96d1-493d-48de-a5cb-c19ae841ffe7 service nova] Releasing lock "refresh_cache-5d80f7e2-d18d-4d6f-b10d-73802d04aea2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:23:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-b3b89d6a-3546-4024-8c57-b9de51f2a5b1 req-8c638588-b51f-42c8-b4c7-0dfd2c17f7b8 service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Received event network-vif-plugged-06adef33-e2c4-4f11-95a4-bf02825e98e9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:23:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b3b89d6a-3546-4024-8c57-b9de51f2a5b1 req-8c638588-b51f-42c8-b4c7-0dfd2c17f7b8 service nova] Acquiring lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:23:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b3b89d6a-3546-4024-8c57-b9de51f2a5b1 req-8c638588-b51f-42c8-b4c7-0dfd2c17f7b8 service nova] Lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:23:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b3b89d6a-3546-4024-8c57-b9de51f2a5b1 req-8c638588-b51f-42c8-b4c7-0dfd2c17f7b8 service nova] Lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:23:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-b3b89d6a-3546-4024-8c57-b9de51f2a5b1 req-8c638588-b51f-42c8-b4c7-0dfd2c17f7b8 service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] No waiting events found dispatching network-vif-plugged-06adef33-e2c4-4f11-95a4-bf02825e98e9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:23:33 user nova-compute[74311]: WARNING nova.compute.manager [req-b3b89d6a-3546-4024-8c57-b9de51f2a5b1 req-8c638588-b51f-42c8-b4c7-0dfd2c17f7b8 service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Received unexpected event network-vif-plugged-06adef33-e2c4-4f11-95a4-bf02825e98e9 for instance with vm_state building and task_state spawning.
Oct 20 10:23:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:35 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:23:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:23:35 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Instance spawned successfully.
Oct 20 10:23:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:23:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:23:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:23:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:23:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:23:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:23:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:23:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-fef69b83-958e-490c-8ef2-f18e8ea8aaf0 req-45d16e8f-7baa-48d5-b151-65f891303d29 service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Received event network-vif-plugged-06adef33-e2c4-4f11-95a4-bf02825e98e9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:23:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fef69b83-958e-490c-8ef2-f18e8ea8aaf0 req-45d16e8f-7baa-48d5-b151-65f891303d29 service nova] Acquiring lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:23:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fef69b83-958e-490c-8ef2-f18e8ea8aaf0 req-45d16e8f-7baa-48d5-b151-65f891303d29 service nova] Lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:23:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fef69b83-958e-490c-8ef2-f18e8ea8aaf0 req-45d16e8f-7baa-48d5-b151-65f891303d29 service nova] Lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:23:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-fef69b83-958e-490c-8ef2-f18e8ea8aaf0 req-45d16e8f-7baa-48d5-b151-65f891303d29 service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] No waiting events found dispatching network-vif-plugged-06adef33-e2c4-4f11-95a4-bf02825e98e9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:23:35 user nova-compute[74311]: WARNING nova.compute.manager [req-fef69b83-958e-490c-8ef2-f18e8ea8aaf0 req-45d16e8f-7baa-48d5-b151-65f891303d29 service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Received unexpected event network-vif-plugged-06adef33-e2c4-4f11-95a4-bf02825e98e9 for instance with vm_state building and task_state spawning.
Oct 20 10:23:36 user nova-compute[74311]: INFO nova.compute.manager [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Took 5.08 seconds to spawn the instance on the hypervisor.
Oct 20 10:23:36 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:23:36 user nova-compute[74311]: INFO nova.compute.manager [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Took 5.89 seconds to build instance.
Oct 20 10:23:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a4202280-195f-466e-888f-52b9482bc888 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.984s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:23:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:23:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:23:38 user nova-compute[74311]: INFO nova.compute.manager [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Detaching volume 45d09622-5546-491c-9b1d-25e121614b1b
Oct 20 10:23:38 user nova-compute[74311]: INFO nova.virt.block_device [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Attempting to driver detach volume 45d09622-5546-491c-9b1d-25e121614b1b from mountpoint /dev/vdb
Oct 20 10:23:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Attempting to detach device vdb from instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:23:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:23:38 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:23:38 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:23:38 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:23:38 user nova-compute[74311]:   <serial>45d09622-5546-491c-9b1d-25e121614b1b</serial>
Oct 20 10:23:38 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 10:23:38 user nova-compute[74311]: </disk>
Oct 20 10:23:38 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:23:38 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Successfully detached device vdb from instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 from the persistent domain config.
Oct 20 10:23:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:23:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:23:38 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:23:38 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:23:38 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:23:38 user nova-compute[74311]:   <serial>45d09622-5546-491c-9b1d-25e121614b1b</serial>
Oct 20 10:23:38 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 10:23:38 user nova-compute[74311]: </disk>
Oct 20 10:23:38 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:23:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:23:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:23:58 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 is timed out.
Oct 20 10:23:58 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Successfully detached device vdb from instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 from the live domain config.
Oct 20 10:23:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VfIEDNey', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:23:58 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d59667-3d31-4ac4-8aaf-5a726b76fcad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:23:58 user nova-compute[74311]: No targets found.
Oct 20 10:23:58 user nova-compute[74311]: iSNS:
Oct 20 10:23:58 user nova-compute[74311]: No targets found.
Oct 20 10:23:58 user nova-compute[74311]: STATIC:
Oct 20 10:23:58 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd
Oct 20 10:23:58 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:23:58 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:23:58 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9
Oct 20 10:23:58 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:23:58 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:23:58 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:23:58 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:23:58 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:23:58 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b
Oct 20 10:23:58 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:23:58 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:23:58 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53
Oct 20 10:23:58 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:23:58 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:23:58 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692
Oct 20 10:23:58 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:23:58 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:23:58 user nova-compute[74311]: FIRMWARE:
Oct 20 10:23:58 user nova-compute[74311]: No targets found.
Oct 20 10:23:58 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:23:58 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:23:58 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bda6c3-83c8-40a0-9031-49bf15297dd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6256c8d7-62ff-4ef5-b222-af0b985fd488]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:23:58 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:23:58 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:23:58 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:23:58 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:23:58 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:23:58 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:23:58 user nova-compute[74311]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b (non-flash)
Oct 20 10:23:58 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:23:58 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:23:58 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:23:58 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:23:58 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164f8e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e5ed7c-1a08-4659-97f6-668351d83c19]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0055d90-bd6c-403a-83fe-b0780ffb84d1]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7355d1b0-fcbf-4e2e-b694-316c4e2840df]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7260687-86ee-4410-9498-31ad5e82a34d]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce72005-2c5b-4ddb-bfb6-9f867a19c873]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:23:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:23:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:59 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[07237f2d-7ddc-4362-b330-0254eec1f753]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:23:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260]
Oct 20 10:23:59 user nova-compute[74311]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b, portal: 172.16.0.220,3260] successful.
Oct 20 10:23:59 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:23:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:23:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45d09622-5546-491c-9b1d-25e121614b1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:23:59 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e40bca-1ce5-4a58-b7b3-2220317e244f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:23:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:23:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:23:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] <== disconnect_volume: return (359ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:23:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:24:00 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:24:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:24:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:24:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:24:00 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:24:00 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Updating instance_info_cache with network_info: [{"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:24:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:24:02 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:24:02 user nova-compute[74311]: DEBUG nova.objects.instance [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'flavor' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:24:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0b49da62-5b50-4f80-8600-4d1725b05f54 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.144s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-71408a22-bf81-44f9-8e82-f698ff0dc119 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-71408a22-bf81-44f9-8e82-f698ff0dc119 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-71408a22-bf81-44f9-8e82-f698ff0dc119 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:24:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-71408a22-bf81-44f9-8e82-f698ff0dc119 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74311) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 20 10:24:02 user nova-compute[74311]: DEBUG nova.objects.instance [None req-71408a22-bf81-44f9-8e82-f698ff0dc119 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'flavor' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:24:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:03 user nova-compute[74311]: DEBUG nova.compute.manager [req-6c0e9632-1596-499b-b3c1-c61df30a45b0 req-772e08f2-6b6d-449d-8fd5-7ce6c0154d74 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-vif-unplugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6c0e9632-1596-499b-b3c1-c61df30a45b0 req-772e08f2-6b6d-449d-8fd5-7ce6c0154d74 service nova] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6c0e9632-1596-499b-b3c1-c61df30a45b0 req-772e08f2-6b6d-449d-8fd5-7ce6c0154d74 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6c0e9632-1596-499b-b3c1-c61df30a45b0 req-772e08f2-6b6d-449d-8fd5-7ce6c0154d74 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:03 user nova-compute[74311]: DEBUG nova.compute.manager [req-6c0e9632-1596-499b-b3c1-c61df30a45b0 req-772e08f2-6b6d-449d-8fd5-7ce6c0154d74 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] No waiting events found dispatching network-vif-unplugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:03 user nova-compute[74311]: WARNING nova.compute.manager [req-6c0e9632-1596-499b-b3c1-c61df30a45b0 req-772e08f2-6b6d-449d-8fd5-7ce6c0154d74 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received unexpected event network-vif-unplugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 for instance with vm_state active and task_state powering-off.
Oct 20 10:24:03 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Instance destroyed successfully.
Oct 20 10:24:03 user nova-compute[74311]: DEBUG nova.compute.manager [None req-71408a22-bf81-44f9-8e82-f698ff0dc119 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:24:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-71408a22-bf81-44f9-8e82-f698ff0dc119 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.837s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:05 user nova-compute[74311]: DEBUG nova.compute.manager [req-9c246518-571b-4379-af18-d8532594c4a5 req-bad58323-2ae3-4f44-b0c4-ed9362b538d0 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9c246518-571b-4379-af18-d8532594c4a5 req-bad58323-2ae3-4f44-b0c4-ed9362b538d0 service nova] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9c246518-571b-4379-af18-d8532594c4a5 req-bad58323-2ae3-4f44-b0c4-ed9362b538d0 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9c246518-571b-4379-af18-d8532594c4a5 req-bad58323-2ae3-4f44-b0c4-ed9362b538d0 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:05 user nova-compute[74311]: DEBUG nova.compute.manager [req-9c246518-571b-4379-af18-d8532594c4a5 req-bad58323-2ae3-4f44-b0c4-ed9362b538d0 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] No waiting events found dispatching network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:05 user nova-compute[74311]: WARNING nova.compute.manager [req-9c246518-571b-4379-af18-d8532594c4a5 req-bad58323-2ae3-4f44-b0c4-ed9362b538d0 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received unexpected event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 for instance with vm_state stopped and task_state None.
Oct 20 10:24:06 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:24:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "3b70780c-e968-4fce-a887-121d4b00218a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "3b70780c-e968-4fce-a887-121d4b00218a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:24:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:24:06 user nova-compute[74311]: INFO nova.compute.claims [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Claim successful on node user
Oct 20 10:24:06 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:24:06 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:24:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:24:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:24:06 user nova-compute[74311]: DEBUG nova.network.neutron [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:24:06 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:24:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:24:06 user nova-compute[74311]: INFO nova.virt.block_device [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Booting with volume 78d2e0a3-6f17-494b-bb62-eee5bbb10728 at /dev/vda
Oct 20 10:24:06 user nova-compute[74311]: DEBUG nova.policy [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5eb8db6bee87451f95e4bfdc61854bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f61456f02bc4688b8cd9d66a2b1868d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:24:06 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG os_brick.utils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e0fedb-e960-4b84-9209-79ed73508e3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[68aa6a12-b588-4a51-902d-f88aca3c2829]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4fe8ba-573e-464a-b928-407e084c1afd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc614e2-84a5-4f65-9108-f3fd0e4b4bfd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:24:07 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[94798bfe-fecb-42f6-ad1a-7d0940153b7f]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG os_brick.utils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Updating existing volume attachment record: 9568e874-faa8-4456-8542-c1a8f836994a {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Successfully created port: e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG nova.network.neutron [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Successfully updated port: e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquired lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG nova.network.neutron [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-02ce4945-391e-42fb-a2d5-4aae145b6846 req-6e6bd29e-d775-491d-8bc6-36e7afb6f5f7 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received event network-changed-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-02ce4945-391e-42fb-a2d5-4aae145b6846 req-6e6bd29e-d775-491d-8bc6-36e7afb6f5f7 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Refreshing instance network info cache due to event network-changed-e240d2ee-098d-4047-97e1-e81090552740. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-02ce4945-391e-42fb-a2d5-4aae145b6846 req-6e6bd29e-d775-491d-8bc6-36e7afb6f5f7 service nova] Acquiring lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG nova.network.neutron [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG nova.network.neutron [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Updating instance_info_cache with network_info: [{"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Releasing lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Instance network_info: |[{"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-02ce4945-391e-42fb-a2d5-4aae145b6846 req-6e6bd29e-d775-491d-8bc6-36e7afb6f5f7 service nova] Acquired lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG nova.network.neutron [req-02ce4945-391e-42fb-a2d5-4aae145b6846 req-6e6bd29e-d775-491d-8bc6-36e7afb6f5f7 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Refreshing network info cache for port e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:24:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:09 user nova-compute[74311]: DEBUG nova.network.neutron [req-02ce4945-391e-42fb-a2d5-4aae145b6846 req-6e6bd29e-d775-491d-8bc6-36e7afb6f5f7 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Updated VIF entry in instance network info cache for port e240d2ee-098d-4047-97e1-e81090552740. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:24:09 user nova-compute[74311]: DEBUG nova.network.neutron [req-02ce4945-391e-42fb-a2d5-4aae145b6846 req-6e6bd29e-d775-491d-8bc6-36e7afb6f5f7 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Updating instance_info_cache with network_info: [{"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-02ce4945-391e-42fb-a2d5-4aae145b6846 req-6e6bd29e-d775-491d-8bc6-36e7afb6f5f7 service nova] Releasing lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:24:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:24:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:12 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:24:12 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7174MB free_disk=25.00769805908203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-9c645408-776e-497d-b1a2-48c605af75f7 req-2d1b22fa-0ca3-474b-854d-d436dd019507 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Received event network-changed-e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-9c645408-776e-497d-b1a2-48c605af75f7 req-2d1b22fa-0ca3-474b-854d-d436dd019507 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Refreshing instance network info cache due to event network-changed-e08b7c03-51f2-450b-b639-a16cf0cd5214. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9c645408-776e-497d-b1a2-48c605af75f7 req-2d1b22fa-0ca3-474b-854d-d436dd019507 service nova] Acquiring lock "refresh_cache-cfb50bd6-42e6-4f8a-af8c-712e52644cb5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9c645408-776e-497d-b1a2-48c605af75f7 req-2d1b22fa-0ca3-474b-854d-d436dd019507 service nova] Acquired lock "refresh_cache-cfb50bd6-42e6-4f8a-af8c-712e52644cb5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.network.neutron [req-9c645408-776e-497d-b1a2-48c605af75f7 req-2d1b22fa-0ca3-474b-854d-d436dd019507 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Refreshing network info cache for port e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 4011fd9a-7109-46b7-b77e-51c29e36a7d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 922b36b5-0575-4717-a876-dda27469ebb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfb50bd6-42e6-4f8a-af8c-712e52644cb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 84361c20-e801-4e16-9ca2-b9eff8620917 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 5d80f7e2-d18d-4d6f-b10d-73802d04aea2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 3b70780c-e968-4fce-a887-121d4b00218a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:24:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:24:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:13 user nova-compute[74311]: DEBUG nova.network.neutron [req-9c645408-776e-497d-b1a2-48c605af75f7 req-2d1b22fa-0ca3-474b-854d-d436dd019507 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Updated VIF entry in instance network info cache for port e08b7c03-51f2-450b-b639-a16cf0cd5214. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:24:13 user nova-compute[74311]: DEBUG nova.network.neutron [req-9c645408-776e-497d-b1a2-48c605af75f7 req-2d1b22fa-0ca3-474b-854d-d436dd019507 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Updating instance_info_cache with network_info: [{"id": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "address": "fa:16:3e:44:5f:40", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08b7c03-51", "ovs_interfaceid": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9c645408-776e-497d-b1a2-48c605af75f7 req-2d1b22fa-0ca3-474b-854d-d436dd019507 service nova] Releasing lock "refresh_cache-cfb50bd6-42e6-4f8a-af8c-712e52644cb5" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:24:13 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:24:13 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:24:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:24:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:15 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:24:15 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:24:15 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:24:15 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:24:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:18 user nova-compute[74311]: DEBUG nova.objects.instance [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'flavor' on Instance uuid cfb50bd6-42e6-4f8a-af8c-712e52644cb5 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:24:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:18 user nova-compute[74311]: INFO nova.compute.manager [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Attaching volume e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 to /dev/vdb
Oct 20 10:24:19 user nova-compute[74311]: DEBUG os_brick.utils [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b364f70d-0c25-4dd8-9b1a-295a42529d91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[383257f5-96ab-4c53-98ae-6d036620655b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3e1799-918b-4b5e-83dc-502a7a2ffc04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61377b5-e12c-464b-a8d7-0434019a68ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:24:19 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b1b243-8fad-4246-bb94-388dae2e698b]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG os_brick.utils [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Updating existing volume attachment record: c54040c1-d73c-41d8-a749-21728cbbfa47 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:24:19 user nova-compute[74311]: INFO nova.compute.manager [None req-b73e0eda-6513-40f0-aa48-a6507fb4e6ba tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Unrescuing
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b73e0eda-6513-40f0-aa48-a6507fb4e6ba tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b73e0eda-6513-40f0-aa48-a6507fb4e6ba tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquired lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:24:19 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b73e0eda-6513-40f0-aa48-a6507fb4e6ba tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:24:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b73e0eda-6513-40f0-aa48-a6507fb4e6ba tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Updating instance_info_cache with network_info: [{"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b73e0eda-6513-40f0-aa48-a6507fb4e6ba tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Releasing lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:24:20 user nova-compute[74311]: DEBUG nova.objects.instance [None req-b73e0eda-6513-40f0-aa48-a6507fb4e6ba tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'flavor' on Instance uuid c0f944dd-b256-4b47-9e2e-7ba50188f636 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:24:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:21 user nova-compute[74311]: DEBUG nova.compute.manager [req-2f4e48dc-a9db-4d21-a3da-48c7344ba6a8 req-eed051ec-bf2f-4e02-8ad2-c8f01946a2f6 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-vif-unplugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2f4e48dc-a9db-4d21-a3da-48c7344ba6a8 req-eed051ec-bf2f-4e02-8ad2-c8f01946a2f6 service nova] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2f4e48dc-a9db-4d21-a3da-48c7344ba6a8 req-eed051ec-bf2f-4e02-8ad2-c8f01946a2f6 service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2f4e48dc-a9db-4d21-a3da-48c7344ba6a8 req-eed051ec-bf2f-4e02-8ad2-c8f01946a2f6 service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:21 user nova-compute[74311]: DEBUG nova.compute.manager [req-2f4e48dc-a9db-4d21-a3da-48c7344ba6a8 req-eed051ec-bf2f-4e02-8ad2-c8f01946a2f6 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] No waiting events found dispatching network-vif-unplugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:21 user nova-compute[74311]: WARNING nova.compute.manager [req-2f4e48dc-a9db-4d21-a3da-48c7344ba6a8 req-eed051ec-bf2f-4e02-8ad2-c8f01946a2f6 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received unexpected event network-vif-unplugged-131d4c92-ce07-4319-9261-609009fbdaee for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:24:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:21 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Instance destroyed successfully.
Oct 20 10:24:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-76e2d701-f0c2-4bc0-b856-18135268adc5 req-c093762d-0de2-4c92-8e7e-9ca0d9712b2d service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-changed-43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-76e2d701-f0c2-4bc0-b856-18135268adc5 req-c093762d-0de2-4c92-8e7e-9ca0d9712b2d service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing instance network info cache due to event network-changed-43f2ca57-55c4-4353-8f52-e05381b6962a. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-76e2d701-f0c2-4bc0-b856-18135268adc5 req-c093762d-0de2-4c92-8e7e-9ca0d9712b2d service nova] Acquiring lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-76e2d701-f0c2-4bc0-b856-18135268adc5 req-c093762d-0de2-4c92-8e7e-9ca0d9712b2d service nova] Acquired lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG nova.network.neutron [req-76e2d701-f0c2-4bc0-b856-18135268adc5 req-c093762d-0de2-4c92-8e7e-9ca0d9712b2d service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Refreshing network info cache for port 43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-a2c90083-06ef-4b8f-a465-b5edc939481c req-7d72ebe8-7b07-473e-ac9b-e8524678f488 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a2c90083-06ef-4b8f-a465-b5edc939481c req-7d72ebe8-7b07-473e-ac9b-e8524678f488 service nova] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a2c90083-06ef-4b8f-a465-b5edc939481c req-7d72ebe8-7b07-473e-ac9b-e8524678f488 service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a2c90083-06ef-4b8f-a465-b5edc939481c req-7d72ebe8-7b07-473e-ac9b-e8524678f488 service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-a2c90083-06ef-4b8f-a465-b5edc939481c req-7d72ebe8-7b07-473e-ac9b-e8524678f488 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] No waiting events found dispatching network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:23 user nova-compute[74311]: WARNING nova.compute.manager [req-a2c90083-06ef-4b8f-a465-b5edc939481c req-7d72ebe8-7b07-473e-ac9b-e8524678f488 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received unexpected event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:24:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG nova.network.neutron [req-76e2d701-f0c2-4bc0-b856-18135268adc5 req-c093762d-0de2-4c92-8e7e-9ca0d9712b2d service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updated VIF entry in instance network info cache for port 43f2ca57-55c4-4353-8f52-e05381b6962a. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG nova.network.neutron [req-76e2d701-f0c2-4bc0-b856-18135268adc5 req-c093762d-0de2-4c92-8e7e-9ca0d9712b2d service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating instance_info_cache with network_info: [{"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "address": "fa:16:3e:2e:ca:10", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b7d551-6e", "ovs_interfaceid": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "address": "fa:16:3e:83:21:b5", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80e2f85-5f", "ovs_interfaceid": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "address": "fa:16:3e:fa:10:3e", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36f74b7-eb", "ovs_interfaceid": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "address": "fa:16:3e:b4:ae:35", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff91ee0f-4d", "ovs_interfaceid": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-76e2d701-f0c2-4bc0-b856-18135268adc5 req-c093762d-0de2-4c92-8e7e-9ca0d9712b2d service nova] Releasing lock "refresh_cache-4011fd9a-7109-46b7-b77e-51c29e36a7d1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:24:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b73e0eda-6513-40f0-aa48-a6507fb4e6ba tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:24:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-8c4de11b-73c8-4519-b267-debc6f99ad2b req-b0048f61-6a4c-478e-abfe-6296d20fc4db service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8c4de11b-73c8-4519-b267-debc6f99ad2b req-b0048f61-6a4c-478e-abfe-6296d20fc4db service nova] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8c4de11b-73c8-4519-b267-debc6f99ad2b req-b0048f61-6a4c-478e-abfe-6296d20fc4db service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8c4de11b-73c8-4519-b267-debc6f99ad2b req-b0048f61-6a4c-478e-abfe-6296d20fc4db service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-8c4de11b-73c8-4519-b267-debc6f99ad2b req-b0048f61-6a4c-478e-abfe-6296d20fc4db service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] No waiting events found dispatching network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:25 user nova-compute[74311]: WARNING nova.compute.manager [req-8c4de11b-73c8-4519-b267-debc6f99ad2b req-b0048f61-6a4c-478e-abfe-6296d20fc4db service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received unexpected event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:24:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-8c4de11b-73c8-4519-b267-debc6f99ad2b req-b0048f61-6a4c-478e-abfe-6296d20fc4db service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8c4de11b-73c8-4519-b267-debc6f99ad2b req-b0048f61-6a4c-478e-abfe-6296d20fc4db service nova] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8c4de11b-73c8-4519-b267-debc6f99ad2b req-b0048f61-6a4c-478e-abfe-6296d20fc4db service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8c4de11b-73c8-4519-b267-debc6f99ad2b req-b0048f61-6a4c-478e-abfe-6296d20fc4db service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-8c4de11b-73c8-4519-b267-debc6f99ad2b req-b0048f61-6a4c-478e-abfe-6296d20fc4db service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] No waiting events found dispatching network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:25 user nova-compute[74311]: WARNING nova.compute.manager [req-8c4de11b-73c8-4519-b267-debc6f99ad2b req-b0048f61-6a4c-478e-abfe-6296d20fc4db service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received unexpected event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:24:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:26 user nova-compute[74311]: INFO nova.compute.manager [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Terminating instance
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:24:26 user nova-compute[74311]: INFO nova.compute.claims [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Claim successful on node user
Oct 20 10:24:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:24:26 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Creating image(s)
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Ensure instance console log exists: /opt/stack/data/nova/instances/3b70780c-e968-4fce-a887-121d4b00218a/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Start _get_guest_xml network_info=[{"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '9568e874-faa8-4456-8542-c1a8f836994a', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlIvXJBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b70780c-e968-4fce-a887-121d4b00218a', 'attached_at': '', 'detached_at': '', 'volume_id': '78d2e0a3-6f17-494b-bb62-eee5bbb10728', 'serial': '78d2e0a3-6f17-494b-bb62-eee5bbb10728'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:26 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:24:26 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlIvXJBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:24:26 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:24:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:24:26 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:24:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:24:26 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:24:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4222c40-81a1-4821-85cc-3e835c4166bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:24:27 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-7956818a-df99-461d-b117-ad3439460737 req-9a867711-3bfe-434a-9e3f-f1f39edb7141 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-unplugged-43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7956818a-df99-461d-b117-ad3439460737 req-9a867711-3bfe-434a-9e3f-f1f39edb7141 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7956818a-df99-461d-b117-ad3439460737 req-9a867711-3bfe-434a-9e3f-f1f39edb7141 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7956818a-df99-461d-b117-ad3439460737 req-9a867711-3bfe-434a-9e3f-f1f39edb7141 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-7956818a-df99-461d-b117-ad3439460737 req-9a867711-3bfe-434a-9e3f-f1f39edb7141 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-unplugged-43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-7956818a-df99-461d-b117-ad3439460737 req-9a867711-3bfe-434a-9e3f-f1f39edb7141 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-unplugged-43f2ca57-55c4-4353-8f52-e05381b6962a for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f818412-0d62-4b1d-afb2-e004d27b4505]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728] added
Oct 20 10:24:27 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a0db02-49cd-4f5e-9141-3299dc4c6a6e]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7bbe29-c29e-44c0-81aa-5276fa3c8094]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MlIvXJBs {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MlIvXJBs" returned: 0 in 0.037s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f690c91-edd8-43c8-a6f5-525ad9f79355]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MlIvXJBs'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[10944deb-ade3-40bb-a8e9-7e561985699f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-3f6c34bd-852f-49e6-86a2-f9d539f2bea9 req-7e16f39e-29e7-4802-a244-89edd621db81 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-unplugged-baec8fe4-8243-407a-86fc-2aac48dbf893 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3f6c34bd-852f-49e6-86a2-f9d539f2bea9 req-7e16f39e-29e7-4802-a244-89edd621db81 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3f6c34bd-852f-49e6-86a2-f9d539f2bea9 req-7e16f39e-29e7-4802-a244-89edd621db81 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3f6c34bd-852f-49e6-86a2-f9d539f2bea9 req-7e16f39e-29e7-4802-a244-89edd621db81 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-3f6c34bd-852f-49e6-86a2-f9d539f2bea9 req-7e16f39e-29e7-4802-a244-89edd621db81 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-unplugged-baec8fe4-8243-407a-86fc-2aac48dbf893 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-3f6c34bd-852f-49e6-86a2-f9d539f2bea9 req-7e16f39e-29e7-4802-a244-89edd621db81 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-unplugged-baec8fe4-8243-407a-86fc-2aac48dbf893 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3222ab4a-fde1-43bb-9722-4dd904c2dd3c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:24:27 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:24:27 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --login" returned: 0 in 0.129s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf279328-0fdb-40aa-82de-97b8410cc4fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260]
Oct 20 10:24:27 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260] successful.
Oct 20 10:24:27 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c2c2bf-27d7-4c0b-904f-0349324f301b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f662daa-6c37-4cec-9a80-cf6191d22e0d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:24:27 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:24:27 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:24:27 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.524s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[47775ab4-d5dd-45d4-9f29-0c82d2ef64e0]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlIvXJBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-ac5638d9-03d8-4e66-b6ad-38fc46edb5a5 req-8e3fb73b-50e6-441f-a52d-5440c8bd606a service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-unplugged-281e2888-41a8-45d3-a5aa-d74493218291 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ac5638d9-03d8-4e66-b6ad-38fc46edb5a5 req-8e3fb73b-50e6-441f-a52d-5440c8bd606a service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ac5638d9-03d8-4e66-b6ad-38fc46edb5a5 req-8e3fb73b-50e6-441f-a52d-5440c8bd606a service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ac5638d9-03d8-4e66-b6ad-38fc46edb5a5 req-8e3fb73b-50e6-441f-a52d-5440c8bd606a service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-ac5638d9-03d8-4e66-b6ad-38fc46edb5a5 req-8e3fb73b-50e6-441f-a52d-5440c8bd606a service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-unplugged-281e2888-41a8-45d3-a5aa-d74493218291 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-ac5638d9-03d8-4e66-b6ad-38fc46edb5a5 req-8e3fb73b-50e6-441f-a52d-5440c8bd606a service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-unplugged-281e2888-41a8-45d3-a5aa-d74493218291 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.443s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:27 user nova-compute[74311]: DEBUG nova.compute.manager [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.compute.manager [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.network.neutron [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:24:28 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.compute.manager [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.policy [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c6b76de1f054ca0973f2f9ba2eafaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090bd6a8a14d4a308e67be7a12e47ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:24:28 user nova-compute[74311]: INFO nova.virt.block_device [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Booting with volume-backed-image 4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa at /dev/vda
Oct 20 10:24:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.582s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] <== connect_volume: return (1584ms) {'type': 'block', 'scsi_wwn': '23165313864306564', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165313864306564', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:24:28 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Instance destroyed successfully.
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.objects.instance [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lazy-loading 'resources' on Instance uuid 4011fd9a-7109-46b7-b77e-51c29e36a7d1 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:22:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:c5:e1,bridge_name='br-int',has_traffic_filtering=True,id=43f2ca57-55c4-4353-8f52-e05381b6962a,network=Network(cae021ee-7a99-4553-86aa-3cdd96f98587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f2ca57-55') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG os_vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:c5:e1,bridge_name='br-int',has_traffic_filtering=True,id=43f2ca57-55c4-4353-8f52-e05381b6962a,network=Network(cae021ee-7a99-4553-86aa-3cdd96f98587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f2ca57-55') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43f2ca57-55, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1216890647',display_name='tempest-ServerActionsTestOtherA-server-1216890647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1216890647',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrV3Ete25j/fWp9se4mxMWH8BlUBzypkEKDQ+cEJ4VP8hCjsvoAfM2JugNca5+qdBC1FO7G9hMianDZcBDCqTf2/GGIFqvMCvoR42Lgy+aDjy2Ay+qKFAL51raC0WY1Gw==',key_name='tempest-keypair-317846828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-0vwgd7k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=3b70780c-e968-4fce-a887-121d4b00218a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=e240d2ee-098d-4047-97e1-e81090552740,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240d2ee-09') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.objects.instance [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b70780c-e968-4fce-a887-121d4b00218a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:24:28 user nova-compute[74311]:   <uuid>3b70780c-e968-4fce-a887-121d4b00218a</uuid>
Oct 20 10:24:28 user nova-compute[74311]:   <name>instance-0000001b</name>
Oct 20 10:24:28 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:24:28 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:24:28 user nova-compute[74311]:   <metadata>
Oct 20 10:24:28 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:24:28 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:24:28 user nova-compute[74311]:       <nova:name>tempest-ServerActionsTestOtherA-server-1216890647</nova:name>
Oct 20 10:24:28 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:24:26</nova:creationTime>
Oct 20 10:24:28 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:24:28 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:24:28 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:24:28 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:24:28 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:24:28 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:24:28 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:24:28 user nova-compute[74311]:       <nova:owner>
Oct 20 10:24:28 user nova-compute[74311]:         <nova:user uuid="5eb8db6bee87451f95e4bfdc61854bc5">tempest-ServerActionsTestOtherA-2000022938-project-member</nova:user>
Oct 20 10:24:28 user nova-compute[74311]:         <nova:project uuid="2f61456f02bc4688b8cd9d66a2b1868d">tempest-ServerActionsTestOtherA-2000022938</nova:project>
Oct 20 10:24:28 user nova-compute[74311]:       </nova:owner>
Oct 20 10:24:28 user nova-compute[74311]:       <nova:ports>
Oct 20 10:24:28 user nova-compute[74311]:         <nova:port uuid="e240d2ee-098d-4047-97e1-e81090552740">
Oct 20 10:24:28 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 10:24:28 user nova-compute[74311]:         </nova:port>
Oct 20 10:24:28 user nova-compute[74311]:       </nova:ports>
Oct 20 10:24:28 user nova-compute[74311]:     </nova:instance>
Oct 20 10:24:28 user nova-compute[74311]:   </metadata>
Oct 20 10:24:28 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:24:28 user nova-compute[74311]:     <system>
Oct 20 10:24:28 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:24:28 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:24:28 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:24:28 user nova-compute[74311]:       <entry name="serial">3b70780c-e968-4fce-a887-121d4b00218a</entry>
Oct 20 10:24:28 user nova-compute[74311]:       <entry name="uuid">3b70780c-e968-4fce-a887-121d4b00218a</entry>
Oct 20 10:24:28 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:24:28 user nova-compute[74311]:     </system>
Oct 20 10:24:28 user nova-compute[74311]:   </sysinfo>
Oct 20 10:24:28 user nova-compute[74311]:   <os>
Oct 20 10:24:28 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:24:28 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:24:28 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:24:28 user nova-compute[74311]:   </os>
Oct 20 10:24:28 user nova-compute[74311]:   <features>
Oct 20 10:24:28 user nova-compute[74311]:     <acpi/>
Oct 20 10:24:28 user nova-compute[74311]:     <apic/>
Oct 20 10:24:28 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:24:28 user nova-compute[74311]:   </features>
Oct 20 10:24:28 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:24:28 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:24:28 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:24:28 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:24:28 user nova-compute[74311]:   </clock>
Oct 20 10:24:28 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:24:28 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:24:28 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:24:28 user nova-compute[74311]:   </cpu>
Oct 20 10:24:28 user nova-compute[74311]:   <devices>
Oct 20 10:24:28 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:24:28 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:24:28 user nova-compute[74311]:       <source dev="/dev/sdb"/>
Oct 20 10:24:28 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:24:28 user nova-compute[74311]:       <serial>78d2e0a3-6f17-494b-bb62-eee5bbb10728</serial>
Oct 20 10:24:28 user nova-compute[74311]:     </disk>
Oct 20 10:24:28 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:24:28 user nova-compute[74311]:       <mac address="fa:16:3e:36:f6:51"/>
Oct 20 10:24:28 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:24:28 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:24:28 user nova-compute[74311]:       <target dev="tape240d2ee-09"/>
Oct 20 10:24:28 user nova-compute[74311]:     </interface>
Oct 20 10:24:28 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:24:28 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/3b70780c-e968-4fce-a887-121d4b00218a/console.log" append="off"/>
Oct 20 10:24:28 user nova-compute[74311]:     </serial>
Oct 20 10:24:28 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:24:28 user nova-compute[74311]:     <video>
Oct 20 10:24:28 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:24:28 user nova-compute[74311]:     </video>
Oct 20 10:24:28 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:24:28 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:24:28 user nova-compute[74311]:     </rng>
Oct 20 10:24:28 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:24:28 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:24:28 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:24:28 user nova-compute[74311]:     </memballoon>
Oct 20 10:24:28 user nova-compute[74311]:   </devices>
Oct 20 10:24:28 user nova-compute[74311]: </domain>
Oct 20 10:24:28 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1216890647',display_name='tempest-ServerActionsTestOtherA-server-1216890647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1216890647',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrV3Ete25j/fWp9se4mxMWH8BlUBzypkEKDQ+cEJ4VP8hCjsvoAfM2JugNca5+qdBC1FO7G9hMianDZcBDCqTf2/GGIFqvMCvoR42Lgy+aDjy2Ay+qKFAL51raC0WY1Gw==',key_name='tempest-keypair-317846828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-0vwgd7k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=3b70780c-e968-4fce-a887-121d4b00218a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=e240d2ee-098d-4047-97e1-e81090552740,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240d2ee-09') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG os_vif [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=e240d2ee-098d-4047-97e1-e81090552740,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240d2ee-09') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a7ba9ac-017c-47f6-91f6-1d927c197408) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c5cb85d-38a9-5f85-8277-b852260e601a', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:28 user nova-compute[74311]: INFO os_vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:c5:e1,bridge_name='br-int',has_traffic_filtering=True,id=43f2ca57-55c4-4353-8f52-e05381b6962a,network=Network(cae021ee-7a99-4553-86aa-3cdd96f98587),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43f2ca57-55')
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:22:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:d7:c9,bridge_name='br-int',has_traffic_filtering=True,id=281e2888-41a8-45d3-a5aa-d74493218291,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap281e2888-41') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG os_vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d7:c9,bridge_name='br-int',has_traffic_filtering=True,id=281e2888-41a8-45d3-a5aa-d74493218291,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap281e2888-41') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap281e2888-41, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape240d2ee-09, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape240d2ee-09, col_values=(('qos', UUID('11e08a4d-9bfa-4a4a-a8f7-4c5f836da7cb')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape240d2ee-09, col_values=(('external_ids', {'iface-id': 'e240d2ee-098d-4047-97e1-e81090552740', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:f6:51', 'vm-uuid': '3b70780c-e968-4fce-a887-121d4b00218a'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:28 user nova-compute[74311]: DEBUG nova.network.neutron [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Successfully created port: 24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: INFO os_vif [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=e240d2ee-098d-4047-97e1-e81090552740,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240d2ee-09')
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25d9a20b-e762-44af-8e53-eb6639ff65f2) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] No VIF found with MAC fa:16:3e:36:f6:51, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: INFO os_vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d7:c9,bridge_name='br-int',has_traffic_filtering=True,id=281e2888-41a8-45d3-a5aa-d74493218291,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap281e2888-41')
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:22:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:01:02,bridge_name='br-int',has_traffic_filtering=True,id=baec8fe4-8243-407a-86fc-2aac48dbf893,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaec8fe4-82') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:01:02,bridge_name='br-int',has_traffic_filtering=True,id=baec8fe4-8243-407a-86fc-2aac48dbf893,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaec8fe4-82') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbaec8fe4-82, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:29 user nova-compute[74311]: WARNING nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-43f2ca57-55c4-4353-8f52-e05381b6962a for instance with vm_state active and task_state deleting.
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-unplugged-c2b7d551-6eab-4972-a0e7-b277b31f284c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-unplugged-c2b7d551-6eab-4972-a0e7-b277b31f284c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-unplugged-c2b7d551-6eab-4972-a0e7-b277b31f284c for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-c2b7d551-6eab-4972-a0e7-b277b31f284c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-c2b7d551-6eab-4972-a0e7-b277b31f284c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:29 user nova-compute[74311]: WARNING nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-c2b7d551-6eab-4972-a0e7-b277b31f284c for instance with vm_state active and task_state deleting.
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-unplugged-ff91ee0f-4db6-4246-8cfc-f42691975fe3 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-unplugged-ff91ee0f-4db6-4246-8cfc-f42691975fe3 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-unplugged-ff91ee0f-4db6-4246-8cfc-f42691975fe3 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-ff91ee0f-4db6-4246-8cfc-f42691975fe3 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-ff91ee0f-4db6-4246-8cfc-f42691975fe3 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:29 user nova-compute[74311]: WARNING nova.compute.manager [req-40bf6f2c-849f-4309-8f05-91bfa4e0b3b8 req-9ad67bb5-432d-43b3-968c-ed986bb8b281 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-ff91ee0f-4db6-4246-8cfc-f42691975fe3 for instance with vm_state active and task_state deleting.
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fac5f6d5-e258-4333-a545-c9128e76b002) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: INFO os_vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:01:02,bridge_name='br-int',has_traffic_filtering=True,id=baec8fe4-8243-407a-86fc-2aac48dbf893,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbaec8fe4-82')
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:22:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "address": "fa:16:3e:2e:ca:10", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b7d551-6e", "ovs_interfaceid": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "address": "fa:16:3e:2e:ca:10", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b7d551-6e", "ovs_interfaceid": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:10,bridge_name='br-int',has_traffic_filtering=True,id=c2b7d551-6eab-4972-a0e7-b277b31f284c,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b7d551-6e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:10,bridge_name='br-int',has_traffic_filtering=True,id=c2b7d551-6eab-4972-a0e7-b277b31f284c,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b7d551-6e') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2b7d551-6e, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-baec8fe4-8243-407a-86fc-2aac48dbf893 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-baec8fe4-8243-407a-86fc-2aac48dbf893 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:29 user nova-compute[74311]: WARNING nova.compute.manager [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-baec8fe4-8243-407a-86fc-2aac48dbf893 for instance with vm_state active and task_state deleting.
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-unplugged-f80e2f85-5f8c-456b-aa14-3eca6f495a92 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-unplugged-f80e2f85-5f8c-456b-aa14-3eca6f495a92 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-unplugged-f80e2f85-5f8c-456b-aa14-3eca6f495a92 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-f80e2f85-5f8c-456b-aa14-3eca6f495a92 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-f80e2f85-5f8c-456b-aa14-3eca6f495a92 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:29 user nova-compute[74311]: WARNING nova.compute.manager [req-fbc46f52-430b-4258-8597-60dffba5d444 req-74c6290f-4532-44b4-b870-cbf2ea77de7b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-f80e2f85-5f8c-456b-aa14-3eca6f495a92 for instance with vm_state active and task_state deleting.
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df86850a-4201-448a-b488-b66f4070e05c) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: INFO os_vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:10,bridge_name='br-int',has_traffic_filtering=True,id=c2b7d551-6eab-4972-a0e7-b277b31f284c,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b7d551-6e')
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:22:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "address": "fa:16:3e:83:21:b5", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80e2f85-5f", "ovs_interfaceid": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "address": "fa:16:3e:83:21:b5", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80e2f85-5f", "ovs_interfaceid": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=f80e2f85-5f8c-456b-aa14-3eca6f495a92,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf80e2f85-5f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=f80e2f85-5f8c-456b-aa14-3eca6f495a92,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf80e2f85-5f') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf80e2f85-5f, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62be0d0c-f963-4cb4-872b-91c32cf88364) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: INFO os_vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=f80e2f85-5f8c-456b-aa14-3eca6f495a92,network=Network(e6b0b2c6-14ca-46e2-bd89-271660012580),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf80e2f85-5f')
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:22:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "address": "fa:16:3e:fa:10:3e", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36f74b7-eb", "ovs_interfaceid": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "address": "fa:16:3e:fa:10:3e", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36f74b7-eb", "ovs_interfaceid": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:10:3e,bridge_name='br-int',has_traffic_filtering=True,id=f36f74b7-eb86-45d9-b1c3-edabd62f26c7,network=Network(9b446ba2-82de-4805-aa3c-4f349cca5cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36f74b7-eb') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:10:3e,bridge_name='br-int',has_traffic_filtering=True,id=f36f74b7-eb86-45d9-b1c3-edabd62f26c7,network=Network(9b446ba2-82de-4805-aa3c-4f349cca5cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36f74b7-eb') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf36f74b7-eb, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=186b6249-2adf-4ede-a075-8cc5b6cc9fb0) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: INFO os_vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:10:3e,bridge_name='br-int',has_traffic_filtering=True,id=f36f74b7-eb86-45d9-b1c3-edabd62f26c7,network=Network(9b446ba2-82de-4805-aa3c-4f349cca5cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36f74b7-eb')
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T10:20:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1060440575',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1060440575',id=22,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbTMlrbEl6inTeTsEUFJur8y6XZBsu/k9Ga62p9e5YOh70xd0e4z6cYY4d2Bxvq+Erdk2N2azOYcmOFli+qg5duWLsC3nDfFA9HP8Ghm6VCYKJA78EOQCAvcFkPy/W8mw==',key_name='tempest-keypair-732463627',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:22:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cb23819b2a548eab36b4b8ca922313d',ramdisk_id='',reservation_id='r-h9yl0ex6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-565303546',owner_user_name='tempest-TaggedBootDevicesTest_v242-565303546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e415285f7ab2498f8102dc4994d1edae',uuid=4011fd9a-7109-46b7-b77e-51c29e36a7d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "address": "fa:16:3e:b4:ae:35", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff91ee0f-4d", "ovs_interfaceid": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converting VIF {"id": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "address": "fa:16:3e:b4:ae:35", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff91ee0f-4d", "ovs_interfaceid": "ff91ee0f-4db6-4246-8cfc-f42691975fe3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ae:35,bridge_name='br-int',has_traffic_filtering=True,id=ff91ee0f-4db6-4246-8cfc-f42691975fe3,network=Network(9b446ba2-82de-4805-aa3c-4f349cca5cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff91ee0f-4d') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ae:35,bridge_name='br-int',has_traffic_filtering=True,id=ff91ee0f-4db6-4246-8cfc-f42691975fe3,network=Network(9b446ba2-82de-4805-aa3c-4f349cca5cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff91ee0f-4d') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff91ee0f-4d, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aeedec64-6260-4533-b7b0-920fe66c4eb7) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:29 user nova-compute[74311]: INFO os_vif [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:ae:35,bridge_name='br-int',has_traffic_filtering=True,id=ff91ee0f-4db6-4246-8cfc-f42691975fe3,network=Network(9b446ba2-82de-4805-aa3c-4f349cca5cbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff91ee0f-4d')
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zawTdpJv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:24:29 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.network.neutron [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Successfully updated port: 24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be0c9b6-ce73-4ba0-bdd4-85a19eff332e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:24:29 user nova-compute[74311]: No targets found.
Oct 20 10:24:29 user nova-compute[74311]: iSNS:
Oct 20 10:24:29 user nova-compute[74311]: No targets found.
Oct 20 10:24:29 user nova-compute[74311]: STATIC:
Oct 20 10:24:29 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd
Oct 20 10:24:29 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:29 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:29 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9
Oct 20 10:24:29 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:29 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:29 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:24:29 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:29 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:29 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728
Oct 20 10:24:29 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:29 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:29 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53
Oct 20 10:24:29 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:29 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:29 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692
Oct 20 10:24:29 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:29 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:29 user nova-compute[74311]: FIRMWARE:
Oct 20 10:24:29 user nova-compute[74311]: No targets found.
Oct 20 10:24:29 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:24:29 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:24:29 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "refresh_cache-730bd2ce-cb53-411a-8b74-dafba0d5e2bb" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquired lock "refresh_cache-730bd2ce-cb53-411a-8b74-dafba0d5e2bb" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.network.neutron [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe3e24c-8ebc-48e2-94dc-395fb6182dd4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2d4329-4c95-4014-84d0-2696cdad4509]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:24:29 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:24:29 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:24:29 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:24:29 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:24:29 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:24:29 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:24:29 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:24:29 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:24:29 user nova-compute[74311]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 (non-flash)
Oct 20 10:24:29 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:24:29 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:24:29 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb188106b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53'): ({'sdg'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Removing single pathed devices sdg {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.network.neutron [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-281e2888-41a8-45d3-a5aa-d74493218291 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-281e2888-41a8-45d3-a5aa-d74493218291 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:29 user nova-compute[74311]: WARNING nova.compute.manager [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-281e2888-41a8-45d3-a5aa-d74493218291 for instance with vm_state active and task_state deleting.
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-unplugged-f36f74b7-eb86-45d9-b1c3-edabd62f26c7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-unplugged-f36f74b7-eb86-45d9-b1c3-edabd62f26c7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-unplugged-f36f74b7-eb86-45d9-b1c3-edabd62f26c7 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-plugged-f36f74b7-eb86-45d9-b1c3-edabd62f26c7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] Acquiring lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] No waiting events found dispatching network-vif-plugged-f36f74b7-eb86-45d9-b1c3-edabd62f26c7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:29 user nova-compute[74311]: WARNING nova.compute.manager [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received unexpected event network-vif-plugged-f36f74b7-eb86-45d9-b1c3-edabd62f26c7 for instance with vm_state active and task_state deleting.
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-changed-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Refreshing instance network info cache due to event network-changed-24df162f-75d9-4c7b-9b02-843587088e7c. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] Acquiring lock "refresh_cache-730bd2ce-cb53-411a-8b74-dafba0d5e2bb" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f371524-983d-4ce8-a18c-fbde8a0d4c71]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[642fc035-ec97-47ad-9707-9593890163fc]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Flushing IO for device /dev/sdg {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a62a230-cd94-4667-a5e4-e20955980bb8]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fd42c5-ddbe-4ab5-82d9-56e7c0564a4e]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] SCSI volumes sdg have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9acc94-38f8-40fd-b974-b8080e99d13f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ba567a-0ec0-4af6-8f3a-4291437998cd]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53, portal: 172.16.0.220,3260]
Oct 20 10:24:30 user nova-compute[74311]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53, portal: 172.16.0.220,3260] successful.
Oct 20 10:24:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24cea100-4f10-4efd-909a-6cf30a418e53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabe070c-64d6-4255-bd3c-68bfeeed98f5]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] <== disconnect_volume: return (379ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgiYtczr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:24:30 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG nova.network.neutron [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Updating instance_info_cache with network_info: [{"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5fa0b5-13e9-4fca-ab17-a2262185d37a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:24:30 user nova-compute[74311]: No targets found.
Oct 20 10:24:30 user nova-compute[74311]: iSNS:
Oct 20 10:24:30 user nova-compute[74311]: No targets found.
Oct 20 10:24:30 user nova-compute[74311]: STATIC:
Oct 20 10:24:30 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd
Oct 20 10:24:30 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:30 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:30 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9
Oct 20 10:24:30 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:30 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:30 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:24:30 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:30 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:30 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728
Oct 20 10:24:30 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:30 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:30 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692
Oct 20 10:24:30 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:30 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:30 user nova-compute[74311]: FIRMWARE:
Oct 20 10:24:30 user nova-compute[74311]: No targets found.
Oct 20 10:24:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:24:30 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:24:30 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Releasing lock "refresh_cache-730bd2ce-cb53-411a-8b74-dafba0d5e2bb" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Instance network_info: |[{"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] Acquired lock "refresh_cache-730bd2ce-cb53-411a-8b74-dafba0d5e2bb" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG nova.network.neutron [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Refreshing network info cache for port 24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[421a4204-2bd4-4f90-809b-6fca311548db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c7cdd3-561d-4ed7-9bac-c60de338a36f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:24:30 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:24:30 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:24:30 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:24:30 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:24:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:24:30 user nova-compute[74311]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd (non-flash)
Oct 20 10:24:30 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:24:30 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:24:30 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:24:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1a819e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd'): ({'sdd'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Removing single pathed devices sdd {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61bd260-7a78-48a4-97d5-dec4a4bde176]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e327d8-0352-4e53-a3d3-f97ee97605c9]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Flushing IO for device /dev/sdd {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e9f74e-59ed-4f1a-ab8d-a1dd10862b43]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.106s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb39a165-e4d0-4bf5-8f0d-69e966913a8b]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1a7e69-a2e6-4002-ad86-e9677d525b23]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7da45d-9e9e-4ccf-a5e0-1146fe3edd7d]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd, portal: 172.16.0.220,3260]
Oct 20 10:24:30 user nova-compute[74311]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd, portal: 172.16.0.220,3260] successful.
Oct 20 10:24:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ad8b3b1-d047-46c9-b41b-6e3372b1eedd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a4d968-6163-4d09-906f-0279667242a6]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] <== disconnect_volume: return (451ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPlmtTEe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:24:30 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f990256b-3c97-4fb9-8f70-6ab88f6fedf1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:24:30 user nova-compute[74311]: No targets found.
Oct 20 10:24:30 user nova-compute[74311]: iSNS:
Oct 20 10:24:30 user nova-compute[74311]: No targets found.
Oct 20 10:24:30 user nova-compute[74311]: STATIC:
Oct 20 10:24:30 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9
Oct 20 10:24:30 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:30 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:30 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:24:30 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:30 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:30 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728
Oct 20 10:24:30 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:30 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:30 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692
Oct 20 10:24:30 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:24:30 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:24:30 user nova-compute[74311]: FIRMWARE:
Oct 20 10:24:30 user nova-compute[74311]: No targets found.
Oct 20 10:24:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:24:30 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:24:30 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d707a745-510a-4f3e-ae79-4bef583d342c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8413e029-f560-44eb-87d2-ca9538589109]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:24:30 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:24:30 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:24:30 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:24:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:24:30 user nova-compute[74311]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 (non-flash)
Oct 20 10:24:30 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:24:30 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:24:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1a819e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9'): ({'sde'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Removing single pathed devices sde {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[473a546e-7bd2-40a6-8c0b-ee2b6a83ad5a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b9ebe8-d0b5-4428-91bc-c3ce537e55dc]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Flushing IO for device /dev/sde {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[56983687-3a36-4315-8afe-ec9728b32446]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG nova.network.neutron [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Updated VIF entry in instance network info cache for port 24df162f-75d9-4c7b-9b02-843587088e7c. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG nova.network.neutron [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Updating instance_info_cache with network_info: [{"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b4623fe6-6768-42ec-97cf-4a948a416a68 req-81d68ed7-f121-4fec-b38c-861d185e03ef service nova] Releasing lock "refresh_cache-730bd2ce-cb53-411a-8b74-dafba0d5e2bb" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[48865e39-5661-41f0-896f-628ee689756a]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] SCSI volumes sde have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aadc226-b993-436a-b569-14f4e0c3d425]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8451561a-5288-47eb-85c3-5542cbeaee7f]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9, portal: 172.16.0.220,3260]
Oct 20 10:24:30 user nova-compute[74311]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9, portal: 172.16.0.220,3260] successful.
Oct 20 10:24:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9dc740f6-a328-44da-88b7-07275d6889f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1b43ed-35db-42d1-b885-fdde64b133ae]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] <== disconnect_volume: return (394ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:24:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:24:30 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Deleting instance files /opt/stack/data/nova/instances/4011fd9a-7109-46b7-b77e-51c29e36a7d1_del
Oct 20 10:24:30 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Deletion of /opt/stack/data/nova/instances/4011fd9a-7109-46b7-b77e-51c29e36a7d1_del complete
Oct 20 10:24:31 user nova-compute[74311]: INFO nova.compute.manager [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Took 4.56 seconds to destroy the instance on the hypervisor.
Oct 20 10:24:31 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:24:31 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:24:31 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:24:31 user nova-compute[74311]: DEBUG nova.compute.manager [req-3bdd16f0-6c2d-4642-8f0f-73964072ee61 req-f856830e-05e6-4556-900a-72220ad91819 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received event network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3bdd16f0-6c2d-4642-8f0f-73964072ee61 req-f856830e-05e6-4556-900a-72220ad91819 service nova] Acquiring lock "3b70780c-e968-4fce-a887-121d4b00218a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3bdd16f0-6c2d-4642-8f0f-73964072ee61 req-f856830e-05e6-4556-900a-72220ad91819 service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3bdd16f0-6c2d-4642-8f0f-73964072ee61 req-f856830e-05e6-4556-900a-72220ad91819 service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:31 user nova-compute[74311]: DEBUG nova.compute.manager [req-3bdd16f0-6c2d-4642-8f0f-73964072ee61 req-f856830e-05e6-4556-900a-72220ad91819 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] No waiting events found dispatching network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:31 user nova-compute[74311]: WARNING nova.compute.manager [req-3bdd16f0-6c2d-4642-8f0f-73964072ee61 req-f856830e-05e6-4556-900a-72220ad91819 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received unexpected event network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 for instance with vm_state building and task_state spawning.
Oct 20 10:24:31 user nova-compute[74311]: DEBUG nova.compute.manager [req-3bdd16f0-6c2d-4642-8f0f-73964072ee61 req-f856830e-05e6-4556-900a-72220ad91819 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received event network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3bdd16f0-6c2d-4642-8f0f-73964072ee61 req-f856830e-05e6-4556-900a-72220ad91819 service nova] Acquiring lock "3b70780c-e968-4fce-a887-121d4b00218a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3bdd16f0-6c2d-4642-8f0f-73964072ee61 req-f856830e-05e6-4556-900a-72220ad91819 service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3bdd16f0-6c2d-4642-8f0f-73964072ee61 req-f856830e-05e6-4556-900a-72220ad91819 service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:31 user nova-compute[74311]: DEBUG nova.compute.manager [req-3bdd16f0-6c2d-4642-8f0f-73964072ee61 req-f856830e-05e6-4556-900a-72220ad91819 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] No waiting events found dispatching network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:31 user nova-compute[74311]: WARNING nova.compute.manager [req-3bdd16f0-6c2d-4642-8f0f-73964072ee61 req-f856830e-05e6-4556-900a-72220ad91819 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received unexpected event network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 for instance with vm_state building and task_state spawning.
Oct 20 10:24:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:24:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:24:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Instance spawned successfully.
Oct 20 10:24:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:24:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:24:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:24:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:24:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:24:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:24:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:24:33 user nova-compute[74311]: INFO nova.compute.manager [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Took 6.13 seconds to spawn the instance on the hypervisor.
Oct 20 10:24:33 user nova-compute[74311]: DEBUG nova.compute.manager [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:24:33 user nova-compute[74311]: INFO nova.compute.manager [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Took 26.90 seconds to build instance.
Oct 20 10:24:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-6309767d-fe61-4611-a927-3b94974b9397 req-a9723f6c-f26d-4dc9-a182-cc06d9168aa7 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-deleted-ff91ee0f-4db6-4246-8cfc-f42691975fe3 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:33 user nova-compute[74311]: INFO nova.compute.manager [req-6309767d-fe61-4611-a927-3b94974b9397 req-a9723f6c-f26d-4dc9-a182-cc06d9168aa7 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Neutron deleted interface ff91ee0f-4db6-4246-8cfc-f42691975fe3; detaching it from the instance and deleting it from the info cache
Oct 20 10:24:33 user nova-compute[74311]: DEBUG nova.network.neutron [req-6309767d-fe61-4611-a927-3b94974b9397 req-a9723f6c-f26d-4dc9-a182-cc06d9168aa7 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating instance_info_cache with network_info: [{"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "address": "fa:16:3e:2e:ca:10", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b7d551-6e", "ovs_interfaceid": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "address": "fa:16:3e:83:21:b5", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80e2f85-5f", "ovs_interfaceid": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "address": "fa:16:3e:fa:10:3e", "network": {"id": "9b446ba2-82de-4805-aa3c-4f349cca5cbc", "bridge": "br-int", "label": "tempest-device-tagging-net2-165919517", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36f74b7-eb", "ovs_interfaceid": "f36f74b7-eb86-45d9-b1c3-edabd62f26c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-17891946-94f0-4b91-9b2d-afd53cfb3fab tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "3b70780c-e968-4fce-a887-121d4b00218a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.028s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-6309767d-fe61-4611-a927-3b94974b9397 req-a9723f6c-f26d-4dc9-a182-cc06d9168aa7 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Detach interface failed, port_id=ff91ee0f-4db6-4246-8cfc-f42691975fe3, reason: Instance 4011fd9a-7109-46b7-b77e-51c29e36a7d1 could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:24:33 user nova-compute[74311]: INFO nova.compute.manager [None req-7cd1c019-8803-42e6-ac75-d697c7234d73 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Unrescuing
Oct 20 10:24:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7cd1c019-8803-42e6-ac75-d697c7234d73 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:24:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7cd1c019-8803-42e6-ac75-d697c7234d73 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquired lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:24:33 user nova-compute[74311]: DEBUG nova.network.neutron [None req-7cd1c019-8803-42e6-ac75-d697c7234d73 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:24:34 user nova-compute[74311]: DEBUG nova.network.neutron [None req-7cd1c019-8803-42e6-ac75-d697c7234d73 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Updating instance_info_cache with network_info: [{"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7cd1c019-8803-42e6-ac75-d697c7234d73 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Releasing lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:24:34 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7cd1c019-8803-42e6-ac75-d697c7234d73 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lazy-loading 'flavor' on Instance uuid 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:24:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:34 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Instance destroyed successfully.
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-b8a1cbfb-6806-4441-b95a-9efaf5ade4e0 req-abb9aac7-7b68-4416-b30e-451828ebc1db service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-changed-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-b8a1cbfb-6806-4441-b95a-9efaf5ade4e0 req-abb9aac7-7b68-4416-b30e-451828ebc1db service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Refreshing instance network info cache due to event network-changed-058da87e-19f4-49ec-9ddd-c9e793db0844. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b8a1cbfb-6806-4441-b95a-9efaf5ade4e0 req-abb9aac7-7b68-4416-b30e-451828ebc1db service nova] Acquiring lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b8a1cbfb-6806-4441-b95a-9efaf5ade4e0 req-abb9aac7-7b68-4416-b30e-451828ebc1db service nova] Acquired lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.network.neutron [req-b8a1cbfb-6806-4441-b95a-9efaf5ade4e0 req-abb9aac7-7b68-4416-b30e-451828ebc1db service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Refreshing network info cache for port 058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-deleted-f36f74b7-eb86-45d9-b1c3-edabd62f26c7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:35 user nova-compute[74311]: INFO nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Neutron deleted interface f36f74b7-eb86-45d9-b1c3-edabd62f26c7; detaching it from the instance and deleting it from the info cache
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.network.neutron [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating instance_info_cache with network_info: [{"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "address": "fa:16:3e:2e:ca:10", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b7d551-6e", "ovs_interfaceid": "c2b7d551-6eab-4972-a0e7-b277b31f284c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "address": "fa:16:3e:83:21:b5", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80e2f85-5f", "ovs_interfaceid": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Detach interface failed, port_id=f36f74b7-eb86-45d9-b1c3-edabd62f26c7, reason: Instance 4011fd9a-7109-46b7-b77e-51c29e36a7d1 could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-deleted-c2b7d551-6eab-4972-a0e7-b277b31f284c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:35 user nova-compute[74311]: INFO nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Neutron deleted interface c2b7d551-6eab-4972-a0e7-b277b31f284c; detaching it from the instance and deleting it from the info cache
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.network.neutron [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating instance_info_cache with network_info: [{"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "address": "fa:16:3e:83:21:b5", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80e2f85-5f", "ovs_interfaceid": "f80e2f85-5f8c-456b-aa14-3eca6f495a92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Detach interface failed, port_id=c2b7d551-6eab-4972-a0e7-b277b31f284c, reason: Instance 4011fd9a-7109-46b7-b77e-51c29e36a7d1 could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-vif-unplugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] No waiting events found dispatching network-vif-unplugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:35 user nova-compute[74311]: WARNING nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received unexpected event network-vif-unplugged-058da87e-19f4-49ec-9ddd-c9e793db0844 for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] No waiting events found dispatching network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:35 user nova-compute[74311]: WARNING nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received unexpected event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-deleted-f80e2f85-5f8c-456b-aa14-3eca6f495a92 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:35 user nova-compute[74311]: INFO nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Neutron deleted interface f80e2f85-5f8c-456b-aa14-3eca6f495a92; detaching it from the instance and deleting it from the info cache
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.network.neutron [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating instance_info_cache with network_info: [{"id": "43f2ca57-55c4-4353-8f52-e05381b6962a", "address": "fa:16:3e:45:c5:e1", "network": {"id": "cae021ee-7a99-4553-86aa-3cdd96f98587", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1747598096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43f2ca57-55", "ovs_interfaceid": "43f2ca57-55c4-4353-8f52-e05381b6962a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "281e2888-41a8-45d3-a5aa-d74493218291", "address": "fa:16:3e:83:d7:c9", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap281e2888-41", "ovs_interfaceid": "281e2888-41a8-45d3-a5aa-d74493218291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "baec8fe4-8243-407a-86fc-2aac48dbf893", "address": "fa:16:3e:0e:01:02", "network": {"id": "e6b0b2c6-14ca-46e2-bd89-271660012580", "bridge": "br-int", "label": "tempest-device-tagging-net1-200360895", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5cb23819b2a548eab36b4b8ca922313d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaec8fe4-82", "ovs_interfaceid": "baec8fe4-8243-407a-86fc-2aac48dbf893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-74d95897-f0c1-40cc-a920-04f3196b0abf req-ff272436-b75e-4f98-a5c7-d4632104402b service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Detach interface failed, port_id=f80e2f85-5f8c-456b-aa14-3eca6f495a92, reason: Instance 4011fd9a-7109-46b7-b77e-51c29e36a7d1 could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:35 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Took 4.91 seconds to deallocate network for instance.
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.network.neutron [req-b8a1cbfb-6806-4441-b95a-9efaf5ade4e0 req-abb9aac7-7b68-4416-b30e-451828ebc1db service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Updated VIF entry in instance network info cache for port 058da87e-19f4-49ec-9ddd-c9e793db0844. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG nova.network.neutron [req-b8a1cbfb-6806-4441-b95a-9efaf5ade4e0 req-abb9aac7-7b68-4416-b30e-451828ebc1db service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Updating instance_info_cache with network_info: [{"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b8a1cbfb-6806-4441-b95a-9efaf5ade4e0 req-abb9aac7-7b68-4416-b30e-451828ebc1db service nova] Releasing lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:24:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-57604f54-f5bc-41e8-ba5d-40c09c7e447b req-1e115531-253d-4d55-94bf-6589cf719899 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-changed-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-57604f54-f5bc-41e8-ba5d-40c09c7e447b req-1e115531-253d-4d55-94bf-6589cf719899 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Refreshing instance network info cache due to event network-changed-058da87e-19f4-49ec-9ddd-c9e793db0844. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57604f54-f5bc-41e8-ba5d-40c09c7e447b req-1e115531-253d-4d55-94bf-6589cf719899 service nova] Acquiring lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57604f54-f5bc-41e8-ba5d-40c09c7e447b req-1e115531-253d-4d55-94bf-6589cf719899 service nova] Acquired lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG nova.network.neutron [req-57604f54-f5bc-41e8-ba5d-40c09c7e447b req-1e115531-253d-4d55-94bf-6589cf719899 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Refreshing network info cache for port 058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-0a4954a8-6106-4033-81a2-39d03f199c9f req-0f4eaba2-10a1-460a-9771-6140d46fe853 service nova] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Received event network-vif-deleted-43f2ca57-55c4-4353-8f52-e05381b6962a {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-0a4954a8-6106-4033-81a2-39d03f199c9f req-0f4eaba2-10a1-460a-9771-6140d46fe853 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0a4954a8-6106-4033-81a2-39d03f199c9f req-0f4eaba2-10a1-460a-9771-6140d46fe853 service nova] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0a4954a8-6106-4033-81a2-39d03f199c9f req-0f4eaba2-10a1-460a-9771-6140d46fe853 service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0a4954a8-6106-4033-81a2-39d03f199c9f req-0f4eaba2-10a1-460a-9771-6140d46fe853 service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-0a4954a8-6106-4033-81a2-39d03f199c9f req-0f4eaba2-10a1-460a-9771-6140d46fe853 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] No waiting events found dispatching network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:37 user nova-compute[74311]: WARNING nova.compute.manager [req-0a4954a8-6106-4033-81a2-39d03f199c9f req-0f4eaba2-10a1-460a-9771-6140d46fe853 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received unexpected event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:24:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-0a4954a8-6106-4033-81a2-39d03f199c9f req-0f4eaba2-10a1-460a-9771-6140d46fe853 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0a4954a8-6106-4033-81a2-39d03f199c9f req-0f4eaba2-10a1-460a-9771-6140d46fe853 service nova] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0a4954a8-6106-4033-81a2-39d03f199c9f req-0f4eaba2-10a1-460a-9771-6140d46fe853 service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0a4954a8-6106-4033-81a2-39d03f199c9f req-0f4eaba2-10a1-460a-9771-6140d46fe853 service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-0a4954a8-6106-4033-81a2-39d03f199c9f req-0f4eaba2-10a1-460a-9771-6140d46fe853 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] No waiting events found dispatching network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:37 user nova-compute[74311]: WARNING nova.compute.manager [req-0a4954a8-6106-4033-81a2-39d03f199c9f req-0f4eaba2-10a1-460a-9771-6140d46fe853 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received unexpected event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:24:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG nova.network.neutron [req-57604f54-f5bc-41e8-ba5d-40c09c7e447b req-1e115531-253d-4d55-94bf-6589cf719899 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Updated VIF entry in instance network info cache for port 058da87e-19f4-49ec-9ddd-c9e793db0844. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:24:37 user nova-compute[74311]: DEBUG nova.network.neutron [req-57604f54-f5bc-41e8-ba5d-40c09c7e447b req-1e115531-253d-4d55-94bf-6589cf719899 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Updating instance_info_cache with network_info: [{"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57604f54-f5bc-41e8-ba5d-40c09c7e447b req-1e115531-253d-4d55-94bf-6589cf719899 service nova] Releasing lock "refresh_cache-2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:24:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-7cd1c019-8803-42e6-ac75-d697c7234d73 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:24:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBQIhHUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:24:40 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:24:40 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:24:40 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a3dab1-4a26-435d-947b-e277e220487f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:24:40 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98c548b-075a-408a-98f3-fc12fa41ce62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36] added
Oct 20 10:24:40 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[089f1ab1-7cd2-423b-9e54-fc1440fc8a5b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef12d428-03a7-487a-b915-d5a37db15a12]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBQIhHUV {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBQIhHUV" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[320152cd-2c4b-4318-9fc2-e1ef931c94e9]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lBQIhHUV'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1c45ff-9942-41c4-9a85-d07ffffedc1c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[24199c30-9311-4301-8eb0-548b8cb29083]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:24:40 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:24:40 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:24:40 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:24:40 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:24:40 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:24:40 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[63270649-43a3-4ebe-86bc-54a516352a23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36, portal: 172.16.0.220,3260]
Oct 20 10:24:40 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36, portal: 172.16.0.220,3260] successful.
Oct 20 10:24:40 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc49f5ea-d286-43ed-b12c-2efe0d96c7ad]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[38221bd0-dfc5-4b30-9bac-e9f8dc2202c5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:24:40 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:24:40 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:24:40 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:24:40 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:24:40 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:24:40 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:24:40 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:24:40 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef60d9f-06ee-484f-80da-4cf9c796c7d3]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:40 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:24:41 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:24:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBQIhHUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:24:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:24:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '26635376438363432', 'path': '/dev/sdc'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:24:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635376438363432', 'path': '/dev/sdc'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:24:41 user nova-compute[74311]: DEBUG nova.objects.instance [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'flavor' on Instance uuid cfb50bd6-42e6-4f8a-af8c-712e52644cb5 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:24:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:24:41 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:24:41 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:24:41 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:24:41 user nova-compute[74311]:   <serial>e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36</serial>
Oct 20 10:24:41 user nova-compute[74311]: </disk>
Oct 20 10:24:41 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:24:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:24:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:24:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No VIF found with MAC fa:16:3e:44:5f:40, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:24:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86623d74-f537-4f57-bef1-1a4ad28f8afb tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.766s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "141ba46f-2fab-46db-8512-862aeef49ac8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "141ba46f-2fab-46db-8512-862aeef49ac8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:46 user nova-compute[74311]: DEBUG nova.compute.manager [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:24:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:46 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:24:46 user nova-compute[74311]: INFO nova.compute.claims [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Claim successful on node user
Oct 20 10:24:47 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.662s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG nova.compute.manager [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG nova.compute.manager [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG nova.network.neutron [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:24:47 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:24:47 user nova-compute[74311]: DEBUG nova.compute.manager [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG nova.policy [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '497267775cc747b8b65b8bcb276806ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e99de7cef4b4569a497f77325515680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG nova.compute.manager [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:24:47 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Creating image(s)
Oct 20 10:24:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "/opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "/opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "/opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.204s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.199s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk 1073741824" returned: 0 in 0.061s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.284s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG nova.network.neutron [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Successfully created port: 5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Cannot resize image /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Ensure instance console log exists: /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG os_brick.utils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceea9970-fc43-491d-a211-56cc39670521]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[500b5f85-dbd4-4378-abae-84577eee2c86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f88616c-8158-4b9e-bb3a-1e3e9401d21a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9f193b-8a76-45ed-b1ad-f56cf22e9e4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG nova.network.neutron [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Successfully updated port: 5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG nova.compute.manager [req-3e7b5fa6-9b58-4699-a26a-8f934de474b8 req-f891240f-c221-440c-94ee-11c62f6549ba service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Received event network-changed-5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG nova.compute.manager [req-3e7b5fa6-9b58-4699-a26a-8f934de474b8 req-f891240f-c221-440c-94ee-11c62f6549ba service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Refreshing instance network info cache due to event network-changed-5bbc3284-3b73-488c-9ee7-5ccedff081a6. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3e7b5fa6-9b58-4699-a26a-8f934de474b8 req-f891240f-c221-440c-94ee-11c62f6549ba service nova] Acquiring lock "refresh_cache-141ba46f-2fab-46db-8512-862aeef49ac8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3e7b5fa6-9b58-4699-a26a-8f934de474b8 req-f891240f-c221-440c-94ee-11c62f6549ba service nova] Acquired lock "refresh_cache-141ba46f-2fab-46db-8512-862aeef49ac8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG nova.network.neutron [req-3e7b5fa6-9b58-4699-a26a-8f934de474b8 req-f891240f-c221-440c-94ee-11c62f6549ba service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Refreshing network info cache for port 5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:24:49 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[95df153f-8aef-409a-9d32-8039fa34d681]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "refresh_cache-141ba46f-2fab-46db-8512-862aeef49ac8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG os_brick.utils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Updating existing volume attachment record: 062eaa0d-34e4-4dfb-8ff7-28d314ac14ef {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG nova.network.neutron [req-3e7b5fa6-9b58-4699-a26a-8f934de474b8 req-f891240f-c221-440c-94ee-11c62f6549ba service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG nova.network.neutron [req-3e7b5fa6-9b58-4699-a26a-8f934de474b8 req-f891240f-c221-440c-94ee-11c62f6549ba service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3e7b5fa6-9b58-4699-a26a-8f934de474b8 req-f891240f-c221-440c-94ee-11c62f6549ba service nova] Releasing lock "refresh_cache-141ba46f-2fab-46db-8512-862aeef49ac8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquired lock "refresh_cache-141ba46f-2fab-46db-8512-862aeef49ac8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG nova.network.neutron [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:24:49 user nova-compute[74311]: DEBUG nova.network.neutron [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.network.neutron [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Updating instance_info_cache with network_info: [{"id": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "address": "fa:16:3e:de:c2:db", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bbc3284-3b", "ovs_interfaceid": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Releasing lock "refresh_cache-141ba46f-2fab-46db-8512-862aeef49ac8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.compute.manager [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Instance network_info: |[{"id": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "address": "fa:16:3e:de:c2:db", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bbc3284-3b", "ovs_interfaceid": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Start _get_guest_xml network_info=[{"id": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "address": "fa:16:3e:de:c2:db", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bbc3284-3b", "ovs_interfaceid": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:24:50 user nova-compute[74311]: INFO nova.compute.manager [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] [instance: 4011fd9a-7109-46b7-b77e-51c29e36a7d1] Took 14.22 seconds to detach 3 volumes for instance.
Oct 20 10:24:50 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:24:50 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-363424740',display_name='tempest-AttachVolumeNegativeTest-server-363424740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-363424740',id=29,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7Pvn1qB7hcB8m+FjRWDzJumGJLqeQ9LAJYTkAGedXHuze3eVREBaoBDguNvNJzjp8J+i1VaiJECU2VB6Mc/bI7WHFQm5zfu8H4K9bPL3CSZwDHmYQRKHXWIn35Mr0l7w==',key_name='tempest-keypair-478552146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e99de7cef4b4569a497f77325515680',ramdisk_id='',reservation_id='r-j8tvo7xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-543930091',owner_user_name='tempest-AttachVolumeNegativeTest-543930091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:24:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497267775cc747b8b65b8bcb276806ba',uuid=141ba46f-2fab-46db-8512-862aeef49ac8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "address": "fa:16:3e:de:c2:db", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bbc3284-3b", "ovs_interfaceid": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converting VIF {"id": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "address": "fa:16:3e:de:c2:db", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bbc3284-3b", "ovs_interfaceid": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:c2:db,bridge_name='br-int',has_traffic_filtering=True,id=5bbc3284-3b73-488c-9ee7-5ccedff081a6,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bbc3284-3b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.objects.instance [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'pci_devices' on Instance uuid 141ba46f-2fab-46db-8512-862aeef49ac8 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:24:50 user nova-compute[74311]:   <uuid>141ba46f-2fab-46db-8512-862aeef49ac8</uuid>
Oct 20 10:24:50 user nova-compute[74311]:   <name>instance-0000001d</name>
Oct 20 10:24:50 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:24:50 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:24:50 user nova-compute[74311]:   <metadata>
Oct 20 10:24:50 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:24:50 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:24:50 user nova-compute[74311]:       <nova:name>tempest-AttachVolumeNegativeTest-server-363424740</nova:name>
Oct 20 10:24:50 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:24:50</nova:creationTime>
Oct 20 10:24:50 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:24:50 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:24:50 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:24:50 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:24:50 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:24:50 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:24:50 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:24:50 user nova-compute[74311]:       <nova:owner>
Oct 20 10:24:50 user nova-compute[74311]:         <nova:user uuid="497267775cc747b8b65b8bcb276806ba">tempest-AttachVolumeNegativeTest-543930091-project-member</nova:user>
Oct 20 10:24:50 user nova-compute[74311]:         <nova:project uuid="4e99de7cef4b4569a497f77325515680">tempest-AttachVolumeNegativeTest-543930091</nova:project>
Oct 20 10:24:50 user nova-compute[74311]:       </nova:owner>
Oct 20 10:24:50 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:24:50 user nova-compute[74311]:       <nova:ports>
Oct 20 10:24:50 user nova-compute[74311]:         <nova:port uuid="5bbc3284-3b73-488c-9ee7-5ccedff081a6">
Oct 20 10:24:50 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 10:24:50 user nova-compute[74311]:         </nova:port>
Oct 20 10:24:50 user nova-compute[74311]:       </nova:ports>
Oct 20 10:24:50 user nova-compute[74311]:     </nova:instance>
Oct 20 10:24:50 user nova-compute[74311]:   </metadata>
Oct 20 10:24:50 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:24:50 user nova-compute[74311]:     <system>
Oct 20 10:24:50 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:24:50 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:24:50 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:24:50 user nova-compute[74311]:       <entry name="serial">141ba46f-2fab-46db-8512-862aeef49ac8</entry>
Oct 20 10:24:50 user nova-compute[74311]:       <entry name="uuid">141ba46f-2fab-46db-8512-862aeef49ac8</entry>
Oct 20 10:24:50 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:24:50 user nova-compute[74311]:     </system>
Oct 20 10:24:50 user nova-compute[74311]:   </sysinfo>
Oct 20 10:24:50 user nova-compute[74311]:   <os>
Oct 20 10:24:50 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:24:50 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:24:50 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:24:50 user nova-compute[74311]:   </os>
Oct 20 10:24:50 user nova-compute[74311]:   <features>
Oct 20 10:24:50 user nova-compute[74311]:     <acpi/>
Oct 20 10:24:50 user nova-compute[74311]:     <apic/>
Oct 20 10:24:50 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:24:50 user nova-compute[74311]:   </features>
Oct 20 10:24:50 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:24:50 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:24:50 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:24:50 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:24:50 user nova-compute[74311]:   </clock>
Oct 20 10:24:50 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:24:50 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:24:50 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:24:50 user nova-compute[74311]:   </cpu>
Oct 20 10:24:50 user nova-compute[74311]:   <devices>
Oct 20 10:24:50 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:24:50 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:24:50 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk"/>
Oct 20 10:24:50 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:24:50 user nova-compute[74311]:     </disk>
Oct 20 10:24:50 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:24:50 user nova-compute[74311]:       <mac address="fa:16:3e:de:c2:db"/>
Oct 20 10:24:50 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:24:50 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:24:50 user nova-compute[74311]:       <target dev="tap5bbc3284-3b"/>
Oct 20 10:24:50 user nova-compute[74311]:     </interface>
Oct 20 10:24:50 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:24:50 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/console.log" append="off"/>
Oct 20 10:24:50 user nova-compute[74311]:     </serial>
Oct 20 10:24:50 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:24:50 user nova-compute[74311]:     <video>
Oct 20 10:24:50 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:24:50 user nova-compute[74311]:     </video>
Oct 20 10:24:50 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:24:50 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:24:50 user nova-compute[74311]:     </rng>
Oct 20 10:24:50 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:24:50 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:24:50 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:24:50 user nova-compute[74311]:     </memballoon>
Oct 20 10:24:50 user nova-compute[74311]:   </devices>
Oct 20 10:24:50 user nova-compute[74311]: </domain>
Oct 20 10:24:50 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-363424740',display_name='tempest-AttachVolumeNegativeTest-server-363424740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-363424740',id=29,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7Pvn1qB7hcB8m+FjRWDzJumGJLqeQ9LAJYTkAGedXHuze3eVREBaoBDguNvNJzjp8J+i1VaiJECU2VB6Mc/bI7WHFQm5zfu8H4K9bPL3CSZwDHmYQRKHXWIn35Mr0l7w==',key_name='tempest-keypair-478552146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e99de7cef4b4569a497f77325515680',ramdisk_id='',reservation_id='r-j8tvo7xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-543930091',owner_user_name='tempest-AttachVolumeNegativeTest-543930091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:24:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497267775cc747b8b65b8bcb276806ba',uuid=141ba46f-2fab-46db-8512-862aeef49ac8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "address": "fa:16:3e:de:c2:db", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bbc3284-3b", "ovs_interfaceid": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converting VIF {"id": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "address": "fa:16:3e:de:c2:db", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bbc3284-3b", "ovs_interfaceid": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:c2:db,bridge_name='br-int',has_traffic_filtering=True,id=5bbc3284-3b73-488c-9ee7-5ccedff081a6,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bbc3284-3b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG os_vif [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:c2:db,bridge_name='br-int',has_traffic_filtering=True,id=5bbc3284-3b73-488c-9ee7-5ccedff081a6,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bbc3284-3b') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05a8b402-b2cd-527b-abfd-81fb3f91b99f', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bbc3284-3b, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bbc3284-3b, col_values=(('qos', UUID('dda0e9cd-d0d6-42ad-af05-38cda92a8195')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bbc3284-3b, col_values=(('external_ids', {'iface-id': '5bbc3284-3b73-488c-9ee7-5ccedff081a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:c2:db', 'vm-uuid': '141ba46f-2fab-46db-8512-862aeef49ac8'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:50 user nova-compute[74311]: INFO os_vif [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:c2:db,bridge_name='br-int',has_traffic_filtering=True,id=5bbc3284-3b73-488c-9ee7-5ccedff081a6,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bbc3284-3b')
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No VIF found with MAC fa:16:3e:de:c2:db, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Acquiring lock "84361c20-e801-4e16-9ca2-b9eff8620917" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "84361c20-e801-4e16-9ca2-b9eff8620917" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Acquiring lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:50 user nova-compute[74311]: INFO nova.compute.manager [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Terminating instance
Oct 20 10:24:50 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:24:50 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Deleted allocations for instance 4011fd9a-7109-46b7-b77e-51c29e36a7d1
Oct 20 10:24:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6419c09-3959-4020-bce7-a0f3e4b7c7fe tempest-TaggedBootDevicesTest_v242-565303546 tempest-TaggedBootDevicesTest_v242-565303546-project-member] Lock "4011fd9a-7109-46b7-b77e-51c29e36a7d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 24.472s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-a61e40d3-766a-456a-a42a-378ce3aeaf87 req-93863591-07a2-4659-a598-2bd52461db99 service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Received event network-vif-unplugged-373868c2-efc4-4844-a47a-cb8e93add3df {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a61e40d3-766a-456a-a42a-378ce3aeaf87 req-93863591-07a2-4659-a598-2bd52461db99 service nova] Acquiring lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a61e40d3-766a-456a-a42a-378ce3aeaf87 req-93863591-07a2-4659-a598-2bd52461db99 service nova] Lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a61e40d3-766a-456a-a42a-378ce3aeaf87 req-93863591-07a2-4659-a598-2bd52461db99 service nova] Lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-a61e40d3-766a-456a-a42a-378ce3aeaf87 req-93863591-07a2-4659-a598-2bd52461db99 service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] No waiting events found dispatching network-vif-unplugged-373868c2-efc4-4844-a47a-cb8e93add3df {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-a61e40d3-766a-456a-a42a-378ce3aeaf87 req-93863591-07a2-4659-a598-2bd52461db99 service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Received event network-vif-unplugged-373868c2-efc4-4844-a47a-cb8e93add3df for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:24:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-a61e40d3-766a-456a-a42a-378ce3aeaf87 req-93863591-07a2-4659-a598-2bd52461db99 service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Received event network-vif-plugged-373868c2-efc4-4844-a47a-cb8e93add3df {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a61e40d3-766a-456a-a42a-378ce3aeaf87 req-93863591-07a2-4659-a598-2bd52461db99 service nova] Acquiring lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a61e40d3-766a-456a-a42a-378ce3aeaf87 req-93863591-07a2-4659-a598-2bd52461db99 service nova] Lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a61e40d3-766a-456a-a42a-378ce3aeaf87 req-93863591-07a2-4659-a598-2bd52461db99 service nova] Lock "84361c20-e801-4e16-9ca2-b9eff8620917-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-a61e40d3-766a-456a-a42a-378ce3aeaf87 req-93863591-07a2-4659-a598-2bd52461db99 service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] No waiting events found dispatching network-vif-plugged-373868c2-efc4-4844-a47a-cb8e93add3df {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:51 user nova-compute[74311]: WARNING nova.compute.manager [req-a61e40d3-766a-456a-a42a-378ce3aeaf87 req-93863591-07a2-4659-a598-2bd52461db99 service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Received unexpected event network-vif-plugged-373868c2-efc4-4844-a47a-cb8e93add3df for instance with vm_state active and task_state deleting.
Oct 20 10:24:52 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Instance destroyed successfully.
Oct 20 10:24:52 user nova-compute[74311]: DEBUG nova.objects.instance [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lazy-loading 'resources' on Instance uuid 84361c20-e801-4e16-9ca2-b9eff8620917 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:22:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-586227952',display_name='tempest-VolumesActionsTest-instance-586227952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-586227952',id=25,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:22:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f97431e31c9c43589464cb6f54c98ec1',ramdisk_id='',reservation_id='r-7by2xvvz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-674463254',owner_user_name='tempest-VolumesActionsTest-674463254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:22:49Z,user_data=None,user_id='1b5f9d22dceb4dc0af82280861e3ae44',uuid=84361c20-e801-4e16-9ca2-b9eff8620917,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "373868c2-efc4-4844-a47a-cb8e93add3df", "address": "fa:16:3e:86:ab:91", "network": {"id": "166cf710-5a3f-46b7-b648-8bd3f0418422", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733058383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97431e31c9c43589464cb6f54c98ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373868c2-ef", "ovs_interfaceid": "373868c2-efc4-4844-a47a-cb8e93add3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Converting VIF {"id": "373868c2-efc4-4844-a47a-cb8e93add3df", "address": "fa:16:3e:86:ab:91", "network": {"id": "166cf710-5a3f-46b7-b648-8bd3f0418422", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1733058383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97431e31c9c43589464cb6f54c98ec1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap373868c2-ef", "ovs_interfaceid": "373868c2-efc4-4844-a47a-cb8e93add3df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:91,bridge_name='br-int',has_traffic_filtering=True,id=373868c2-efc4-4844-a47a-cb8e93add3df,network=Network(166cf710-5a3f-46b7-b648-8bd3f0418422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373868c2-ef') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG os_vif [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:91,bridge_name='br-int',has_traffic_filtering=True,id=373868c2-efc4-4844-a47a-cb8e93add3df,network=Network(166cf710-5a3f-46b7-b648-8bd3f0418422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373868c2-ef') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap373868c2-ef, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7873b72-0cba-4dc7-a971-b23d0c8654cc) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:52 user nova-compute[74311]: INFO os_vif [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ab:91,bridge_name='br-int',has_traffic_filtering=True,id=373868c2-efc4-4844-a47a-cb8e93add3df,network=Network(166cf710-5a3f-46b7-b648-8bd3f0418422),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap373868c2-ef')
Oct 20 10:24:52 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Deleting instance files /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917_del
Oct 20 10:24:52 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Deletion of /opt/stack/data/nova/instances/84361c20-e801-4e16-9ca2-b9eff8620917_del complete
Oct 20 10:24:52 user nova-compute[74311]: INFO nova.compute.manager [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Took 1.51 seconds to destroy the instance on the hypervisor.
Oct 20 10:24:52 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-76cf52bf-6da1-451f-a502-c5cc08310d4a req-c7f2f697-b0d1-4a97-a3ab-4b5ac5aa477c service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Received event network-vif-plugged-5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-76cf52bf-6da1-451f-a502-c5cc08310d4a req-c7f2f697-b0d1-4a97-a3ab-4b5ac5aa477c service nova] Acquiring lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-76cf52bf-6da1-451f-a502-c5cc08310d4a req-c7f2f697-b0d1-4a97-a3ab-4b5ac5aa477c service nova] Lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-76cf52bf-6da1-451f-a502-c5cc08310d4a req-c7f2f697-b0d1-4a97-a3ab-4b5ac5aa477c service nova] Lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-76cf52bf-6da1-451f-a502-c5cc08310d4a req-c7f2f697-b0d1-4a97-a3ab-4b5ac5aa477c service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] No waiting events found dispatching network-vif-plugged-5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:52 user nova-compute[74311]: WARNING nova.compute.manager [req-76cf52bf-6da1-451f-a502-c5cc08310d4a req-c7f2f697-b0d1-4a97-a3ab-4b5ac5aa477c service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Received unexpected event network-vif-plugged-5bbc3284-3b73-488c-9ee7-5ccedff081a6 for instance with vm_state building and task_state spawning.
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:24:52 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Took 0.46 seconds to deallocate network for instance.
Oct 20 10:24:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:53 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:24:53 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:24:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.569s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:53 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Deleted allocations for instance 84361c20-e801-4e16-9ca2-b9eff8620917
Oct 20 10:24:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f26791f6-74e2-42d2-896b-3a7628f174e3 tempest-VolumesActionsTest-674463254 tempest-VolumesActionsTest-674463254-project-member] Lock "84361c20-e801-4e16-9ca2-b9eff8620917" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.786s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:53 user nova-compute[74311]: DEBUG nova.compute.manager [req-2dc389b3-b524-4d65-bc58-1e905b2555e4 req-2995fe96-5200-4ad7-aaf1-efd7fcaf9921 service nova] [instance: 84361c20-e801-4e16-9ca2-b9eff8620917] Received event network-vif-deleted-373868c2-efc4-4844-a47a-cb8e93add3df {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:54 user nova-compute[74311]: DEBUG nova.compute.manager [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:24:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:24:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-b95f4981-031a-402d-af65-c78e7e5f7231 req-8bb1d706-0921-442c-b3f0-1e5680a4d89d service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Received event network-vif-plugged-5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:24:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b95f4981-031a-402d-af65-c78e7e5f7231 req-8bb1d706-0921-442c-b3f0-1e5680a4d89d service nova] Acquiring lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:24:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b95f4981-031a-402d-af65-c78e7e5f7231 req-8bb1d706-0921-442c-b3f0-1e5680a4d89d service nova] Lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:24:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b95f4981-031a-402d-af65-c78e7e5f7231 req-8bb1d706-0921-442c-b3f0-1e5680a4d89d service nova] Lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-b95f4981-031a-402d-af65-c78e7e5f7231 req-8bb1d706-0921-442c-b3f0-1e5680a4d89d service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] No waiting events found dispatching network-vif-plugged-5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:24:54 user nova-compute[74311]: WARNING nova.compute.manager [req-b95f4981-031a-402d-af65-c78e7e5f7231 req-8bb1d706-0921-442c-b3f0-1e5680a4d89d service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Received unexpected event network-vif-plugged-5bbc3284-3b73-488c-9ee7-5ccedff081a6 for instance with vm_state building and task_state spawning.
Oct 20 10:24:54 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Instance spawned successfully.
Oct 20 10:24:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:24:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:24:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:24:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:24:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:24:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:24:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:24:54 user nova-compute[74311]: INFO nova.compute.manager [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Took 7.08 seconds to spawn the instance on the hypervisor.
Oct 20 10:24:54 user nova-compute[74311]: DEBUG nova.compute.manager [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:24:54 user nova-compute[74311]: INFO nova.compute.manager [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Took 8.11 seconds to build instance.
Oct 20 10:24:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e506b1b-2979-4b2c-a2e7-e5ea276979d3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "141ba46f-2fab-46db-8512-862aeef49ac8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.218s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:24:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:24:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:02 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:25:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:25:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:25:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:25:02 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:25:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:02 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Updating instance_info_cache with network_info: [{"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:25:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:25:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:25:03 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:25:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:06 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:07 user nova-compute[74311]: INFO nova.compute.manager [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Detaching volume f375fade-d000-4d2e-ba16-066b56a75692
Oct 20 10:25:07 user nova-compute[74311]: INFO nova.virt.block_device [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Attempting to driver detach volume f375fade-d000-4d2e-ba16-066b56a75692 from mountpoint /dev/vdb
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Attempting to detach device vdb from instance 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:25:07 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:25:07 user nova-compute[74311]:   <source dev="/dev/sdh"/>
Oct 20 10:25:07 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:25:07 user nova-compute[74311]:   <serial>f375fade-d000-4d2e-ba16-066b56a75692</serial>
Oct 20 10:25:07 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:25:07 user nova-compute[74311]: </disk>
Oct 20 10:25:07 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:25:07 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Successfully detached device vdb from instance 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 from the persistent domain config.
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:25:07 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:25:07 user nova-compute[74311]:   <source dev="/dev/sdh"/>
Oct 20 10:25:07 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:25:07 user nova-compute[74311]:   <serial>f375fade-d000-4d2e-ba16-066b56a75692</serial>
Oct 20 10:25:07 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:25:07 user nova-compute[74311]: </disk>
Oct 20 10:25:07 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:25:07 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Creating image(s)
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Ensure instance console log exists: /opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Start _get_guest_xml network_info=[{"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '062eaa0d-34e4-4dfb-8ff7-28d314ac14ef', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBwJTzCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '730bd2ce-cb53-411a-8b74-dafba0d5e2bb', 'attached_at': '', 'detached_at': '', 'volume_id': 'd65f3863-0f82-406c-bfc2-07dc2d1afec8', 'serial': 'd65f3863-0f82-406c-bfc2-07dc2d1afec8'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:25:07 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:25:07 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBwJTzCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:25:07 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:25:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:25:07 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:25:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:25:07 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[569b5583-a017-4b81-9e62-79e952ce313d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:25:07 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1848ac57-61eb-48fa-beec-ae798def4eaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8] added
Oct 20 10:25:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[159b8fde-9bdb-42bd-a10d-d82de3a2b64e]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.051s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd738909-ce27-4c35-b9c8-3effbcc7732c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBwJTzCc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBwJTzCc" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5daccfc9-b666-4b5d-a27b-9919760ab651]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xBwJTzCc'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7101cf-51fd-487d-860b-ba0cd59f9319]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[da74f883-be7e-450a-ae56-6f863083d96a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:25:07 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:25:07 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:25:07 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:25:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:25:07 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:25:07 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:25:07 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:25:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:25:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c501364-53b4-498d-bed5-00ca84500770]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8, portal: 172.16.0.220,3260]
Oct 20 10:25:08 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8, portal: 172.16.0.220,3260] successful.
Oct 20 10:25:08 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3d467b-4195-458b-8cac-0a675cbd2f9d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb513524-ca3c-4dc5-bb5a-a4eaed4d29c5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:25:08 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:25:08 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:25:08 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:25:08 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:25:08 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:25:08 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:25:08 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:25:08 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:25:08 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:25:08 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fde74c-ba4d-429a-b1e0-67a1f69fda9a]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBwJTzCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23337316533363937', 'path': '/dev/sdd'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337316533363937', 'path': '/dev/sdd'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-141140732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-141140732',id=28,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090bd6a8a14d4a308e67be7a12e47ae6',ramdisk_id='',reservation_id='r-swhff48u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:24:28Z,user_data=None,user_id='0c6b76de1f054ca0973f2f9ba2eafaed',uuid=730bd2ce-cb53-411a-8b74-dafba0d5e2bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converting VIF {"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:c0:77,bridge_name='br-int',has_traffic_filtering=True,id=24df162f-75d9-4c7b-9b02-843587088e7c,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24df162f-75') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'pci_devices' on Instance uuid 730bd2ce-cb53-411a-8b74-dafba0d5e2bb {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:25:09 user nova-compute[74311]:   <uuid>730bd2ce-cb53-411a-8b74-dafba0d5e2bb</uuid>
Oct 20 10:25:09 user nova-compute[74311]:   <name>instance-0000001c</name>
Oct 20 10:25:09 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:25:09 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:25:09 user nova-compute[74311]:   <metadata>
Oct 20 10:25:09 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:25:09 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:25:09 user nova-compute[74311]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-141140732</nova:name>
Oct 20 10:25:09 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:25:07</nova:creationTime>
Oct 20 10:25:09 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:25:09 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:25:09 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:25:09 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:25:09 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:25:09 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:25:09 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:25:09 user nova-compute[74311]:       <nova:owner>
Oct 20 10:25:09 user nova-compute[74311]:         <nova:user uuid="0c6b76de1f054ca0973f2f9ba2eafaed">tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member</nova:user>
Oct 20 10:25:09 user nova-compute[74311]:         <nova:project uuid="090bd6a8a14d4a308e67be7a12e47ae6">tempest-ServerBootFromVolumeStableRescueTest-2019341345</nova:project>
Oct 20 10:25:09 user nova-compute[74311]:       </nova:owner>
Oct 20 10:25:09 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:25:09 user nova-compute[74311]:       <nova:ports>
Oct 20 10:25:09 user nova-compute[74311]:         <nova:port uuid="24df162f-75d9-4c7b-9b02-843587088e7c">
Oct 20 10:25:09 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 10:25:09 user nova-compute[74311]:         </nova:port>
Oct 20 10:25:09 user nova-compute[74311]:       </nova:ports>
Oct 20 10:25:09 user nova-compute[74311]:     </nova:instance>
Oct 20 10:25:09 user nova-compute[74311]:   </metadata>
Oct 20 10:25:09 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:25:09 user nova-compute[74311]:     <system>
Oct 20 10:25:09 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:25:09 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:25:09 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:25:09 user nova-compute[74311]:       <entry name="serial">730bd2ce-cb53-411a-8b74-dafba0d5e2bb</entry>
Oct 20 10:25:09 user nova-compute[74311]:       <entry name="uuid">730bd2ce-cb53-411a-8b74-dafba0d5e2bb</entry>
Oct 20 10:25:09 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:25:09 user nova-compute[74311]:     </system>
Oct 20 10:25:09 user nova-compute[74311]:   </sysinfo>
Oct 20 10:25:09 user nova-compute[74311]:   <os>
Oct 20 10:25:09 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:25:09 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:25:09 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:25:09 user nova-compute[74311]:   </os>
Oct 20 10:25:09 user nova-compute[74311]:   <features>
Oct 20 10:25:09 user nova-compute[74311]:     <acpi/>
Oct 20 10:25:09 user nova-compute[74311]:     <apic/>
Oct 20 10:25:09 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:25:09 user nova-compute[74311]:   </features>
Oct 20 10:25:09 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:25:09 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:25:09 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:25:09 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:25:09 user nova-compute[74311]:   </clock>
Oct 20 10:25:09 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:25:09 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:25:09 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:25:09 user nova-compute[74311]:   </cpu>
Oct 20 10:25:09 user nova-compute[74311]:   <devices>
Oct 20 10:25:09 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:25:09 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:25:09 user nova-compute[74311]:       <source dev="/dev/sdd"/>
Oct 20 10:25:09 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:25:09 user nova-compute[74311]:       <serial>d65f3863-0f82-406c-bfc2-07dc2d1afec8</serial>
Oct 20 10:25:09 user nova-compute[74311]:     </disk>
Oct 20 10:25:09 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:25:09 user nova-compute[74311]:       <mac address="fa:16:3e:32:c0:77"/>
Oct 20 10:25:09 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:25:09 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:25:09 user nova-compute[74311]:       <target dev="tap24df162f-75"/>
Oct 20 10:25:09 user nova-compute[74311]:     </interface>
Oct 20 10:25:09 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:25:09 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb/console.log" append="off"/>
Oct 20 10:25:09 user nova-compute[74311]:     </serial>
Oct 20 10:25:09 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:25:09 user nova-compute[74311]:     <video>
Oct 20 10:25:09 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:25:09 user nova-compute[74311]:     </video>
Oct 20 10:25:09 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:25:09 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:25:09 user nova-compute[74311]:     </rng>
Oct 20 10:25:09 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:25:09 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:25:09 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:25:09 user nova-compute[74311]:     </memballoon>
Oct 20 10:25:09 user nova-compute[74311]:   </devices>
Oct 20 10:25:09 user nova-compute[74311]: </domain>
Oct 20 10:25:09 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-141140732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-141140732',id=28,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090bd6a8a14d4a308e67be7a12e47ae6',ramdisk_id='',reservation_id='r-swhff48u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:24:28Z,user_data=None,user_id='0c6b76de1f054ca0973f2f9ba2eafaed',uuid=730bd2ce-cb53-411a-8b74-dafba0d5e2bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converting VIF {"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:c0:77,bridge_name='br-int',has_traffic_filtering=True,id=24df162f-75d9-4c7b-9b02-843587088e7c,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24df162f-75') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG os_vif [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:c0:77,bridge_name='br-int',has_traffic_filtering=True,id=24df162f-75d9-4c7b-9b02-843587088e7c,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24df162f-75') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e11c9925-a757-5de3-9fdb-34c937d8f314', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24df162f-75, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24df162f-75, col_values=(('qos', UUID('acf0e500-978b-4c25-a329-56fe9155785f')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24df162f-75, col_values=(('external_ids', {'iface-id': '24df162f-75d9-4c7b-9b02-843587088e7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:c0:77', 'vm-uuid': '730bd2ce-cb53-411a-8b74-dafba0d5e2bb'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:09 user nova-compute[74311]: INFO os_vif [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:c0:77,bridge_name='br-int',has_traffic_filtering=True,id=24df162f-75d9-4c7b-9b02-843587088e7c,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24df162f-75')
Oct 20 10:25:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] No VIF found with MAC fa:16:3e:32:c0:77, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-76ed502b-079c-4864-bfc2-0de793b5040e req-c66ff7a6-c1dc-487c-b2ef-a91312fddc4d service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-76ed502b-079c-4864-bfc2-0de793b5040e req-c66ff7a6-c1dc-487c-b2ef-a91312fddc4d service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-76ed502b-079c-4864-bfc2-0de793b5040e req-c66ff7a6-c1dc-487c-b2ef-a91312fddc4d service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-76ed502b-079c-4864-bfc2-0de793b5040e req-c66ff7a6-c1dc-487c-b2ef-a91312fddc4d service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-76ed502b-079c-4864-bfc2-0de793b5040e req-c66ff7a6-c1dc-487c-b2ef-a91312fddc4d service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:25:10 user nova-compute[74311]: WARNING nova.compute.manager [req-76ed502b-079c-4864-bfc2-0de793b5040e req-c66ff7a6-c1dc-487c-b2ef-a91312fddc4d service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received unexpected event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with vm_state building and task_state spawning.
Oct 20 10:25:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:25:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:25:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:25:12 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:25:12 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:25:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7234MB free_disk=24.998706817626953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:12 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Instance spawned successfully.
Oct 20 10:25:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:25:12 user nova-compute[74311]: INFO nova.compute.manager [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Took 5.25 seconds to spawn the instance on the hypervisor.
Oct 20 10:25:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-ff0c4f1b-3cb7-4625-873b-c148c9b03a48 req-38cd13c7-b996-401e-914e-cee3b4d324cc service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ff0c4f1b-3cb7-4625-873b-c148c9b03a48 req-38cd13c7-b996-401e-914e-cee3b4d324cc service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ff0c4f1b-3cb7-4625-873b-c148c9b03a48 req-38cd13c7-b996-401e-914e-cee3b4d324cc service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ff0c4f1b-3cb7-4625-873b-c148c9b03a48 req-38cd13c7-b996-401e-914e-cee3b4d324cc service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-ff0c4f1b-3cb7-4625-873b-c148c9b03a48 req-38cd13c7-b996-401e-914e-cee3b4d324cc service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:25:12 user nova-compute[74311]: WARNING nova.compute.manager [req-ff0c4f1b-3cb7-4625-873b-c148c9b03a48 req-38cd13c7-b996-401e-914e-cee3b4d324cc service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received unexpected event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with vm_state building and task_state spawning.
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:25:13 user nova-compute[74311]: INFO nova.compute.manager [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Took 46.60 seconds to build instance.
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 922b36b5-0575-4717-a876-dda27469ebb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfb50bd6-42e6-4f8a-af8c-712e52644cb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 5d80f7e2-d18d-4d6f-b10d-73802d04aea2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 3b70780c-e968-4fce-a887-121d4b00218a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 730bd2ce-cb53-411a-8b74-dafba0d5e2bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 141ba46f-2fab-46db-8512-862aeef49ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7666048e-e045-4e7f-9c75-b022b3cea337 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.720s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:25:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:14 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:25:14 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:25:14 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:25:14 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:25:14 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:25:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:21 user nova-compute[74311]: INFO nova.compute.manager [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Terminating instance
Oct 20 10:25:21 user nova-compute[74311]: DEBUG nova.compute.manager [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG nova.compute.manager [req-fd9a1362-8a67-47a3-9aa1-2168042af4c1 req-7e9ad967-6e6d-47b3-89f2-34aeed57354c service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Received event network-vif-unplugged-06adef33-e2c4-4f11-95a4-bf02825e98e9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fd9a1362-8a67-47a3-9aa1-2168042af4c1 req-7e9ad967-6e6d-47b3-89f2-34aeed57354c service nova] Acquiring lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fd9a1362-8a67-47a3-9aa1-2168042af4c1 req-7e9ad967-6e6d-47b3-89f2-34aeed57354c service nova] Lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fd9a1362-8a67-47a3-9aa1-2168042af4c1 req-7e9ad967-6e6d-47b3-89f2-34aeed57354c service nova] Lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG nova.compute.manager [req-fd9a1362-8a67-47a3-9aa1-2168042af4c1 req-7e9ad967-6e6d-47b3-89f2-34aeed57354c service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] No waiting events found dispatching network-vif-unplugged-06adef33-e2c4-4f11-95a4-bf02825e98e9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG nova.compute.manager [req-fd9a1362-8a67-47a3-9aa1-2168042af4c1 req-7e9ad967-6e6d-47b3-89f2-34aeed57354c service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Received event network-vif-unplugged-06adef33-e2c4-4f11-95a4-bf02825e98e9 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:21 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Instance destroyed successfully.
Oct 20 10:25:21 user nova-compute[74311]: DEBUG nova.objects.instance [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lazy-loading 'resources' on Instance uuid 5d80f7e2-d18d-4d6f-b10d-73802d04aea2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:23:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1367546423',display_name='tempest-VolumesActionsTest-instance-1367546423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1367546423',id=26,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:23:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bed6d454e3a3423682cd4a6b21c685df',ramdisk_id='',reservation_id='r-5ds61iwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-711255224',owner_user_name='tempest-VolumesActionsTest-711255224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:23:36Z,user_data=None,user_id='56f4022992534cb0b81e393ccbac8d52',uuid=5d80f7e2-d18d-4d6f-b10d-73802d04aea2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "address": "fa:16:3e:5a:e9:4a", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06adef33-e2", "ovs_interfaceid": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Converting VIF {"id": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "address": "fa:16:3e:5a:e9:4a", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06adef33-e2", "ovs_interfaceid": "06adef33-e2c4-4f11-95a4-bf02825e98e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e9:4a,bridge_name='br-int',has_traffic_filtering=True,id=06adef33-e2c4-4f11-95a4-bf02825e98e9,network=Network(534777ae-0aa3-4431-9cf5-9154ace6d1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06adef33-e2') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG os_vif [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e9:4a,bridge_name='br-int',has_traffic_filtering=True,id=06adef33-e2c4-4f11-95a4-bf02825e98e9,network=Network(534777ae-0aa3-4431-9cf5-9154ace6d1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06adef33-e2') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06adef33-e2, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=582fb298-089f-4302-b833-0410eb5a2a09) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:21 user nova-compute[74311]: INFO os_vif [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e9:4a,bridge_name='br-int',has_traffic_filtering=True,id=06adef33-e2c4-4f11-95a4-bf02825e98e9,network=Network(534777ae-0aa3-4431-9cf5-9154ace6d1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06adef33-e2')
Oct 20 10:25:21 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Deleting instance files /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2_del
Oct 20 10:25:21 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Deletion of /opt/stack/data/nova/instances/5d80f7e2-d18d-4d6f-b10d-73802d04aea2_del complete
Oct 20 10:25:21 user nova-compute[74311]: INFO nova.compute.manager [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Took 0.82 seconds to destroy the instance on the hypervisor.
Oct 20 10:25:21 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:25:21 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:25:22 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:25:22 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Took 0.66 seconds to deallocate network for instance.
Oct 20 10:25:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-78902a2e-67a9-4d10-a661-a55a439eb15c req-d100cff2-b702-4039-812b-901af5cdf314 service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Received event network-vif-deleted-06adef33-e2c4-4f11-95a4-bf02825e98e9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:25:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:23 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:25:23 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:25:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:23 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Deleted allocations for instance 5d80f7e2-d18d-4d6f-b10d-73802d04aea2
Oct 20 10:25:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8bdf8839-2e9a-4331-b591-c409146d221e tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.239s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-5717ace3-989c-4b13-a79b-c496974494e3 req-ec5cceec-951d-4df2-81b8-c2452fea002f service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Received event network-vif-plugged-06adef33-e2c4-4f11-95a4-bf02825e98e9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:25:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5717ace3-989c-4b13-a79b-c496974494e3 req-ec5cceec-951d-4df2-81b8-c2452fea002f service nova] Acquiring lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5717ace3-989c-4b13-a79b-c496974494e3 req-ec5cceec-951d-4df2-81b8-c2452fea002f service nova] Lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5717ace3-989c-4b13-a79b-c496974494e3 req-ec5cceec-951d-4df2-81b8-c2452fea002f service nova] Lock "5d80f7e2-d18d-4d6f-b10d-73802d04aea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-5717ace3-989c-4b13-a79b-c496974494e3 req-ec5cceec-951d-4df2-81b8-c2452fea002f service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] No waiting events found dispatching network-vif-plugged-06adef33-e2c4-4f11-95a4-bf02825e98e9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:25:23 user nova-compute[74311]: WARNING nova.compute.manager [req-5717ace3-989c-4b13-a79b-c496974494e3 req-ec5cceec-951d-4df2-81b8-c2452fea002f service nova] [instance: 5d80f7e2-d18d-4d6f-b10d-73802d04aea2] Received unexpected event network-vif-plugged-06adef33-e2c4-4f11-95a4-bf02825e98e9 for instance with vm_state deleted and task_state None.
Oct 20 10:25:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:27 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 is timed out.
Oct 20 10:25:27 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Successfully detached device vdb from instance 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 from the live domain config.
Oct 20 10:25:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CGTJPFYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:25:27 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[814ffaa2-e2cf-4e86-b54b-4fdbe17e02df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:25:27 user nova-compute[74311]: No targets found.
Oct 20 10:25:27 user nova-compute[74311]: iSNS:
Oct 20 10:25:27 user nova-compute[74311]: No targets found.
Oct 20 10:25:27 user nova-compute[74311]: STATIC:
Oct 20 10:25:27 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:25:27 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:25:27 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:25:27 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728
Oct 20 10:25:27 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:25:27 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:25:27 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36
Oct 20 10:25:27 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:25:27 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:25:27 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8
Oct 20 10:25:27 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:25:27 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:25:27 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692
Oct 20 10:25:27 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:25:27 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:25:27 user nova-compute[74311]: FIRMWARE:
Oct 20 10:25:27 user nova-compute[74311]: No targets found.
Oct 20 10:25:27 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:25:27 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:25:27 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aca147-2819-47fb-8923-4992c943273c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[656b7d6d-11cd-405b-8f8d-cec8a5215ba5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:25:27 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:25:27 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:25:27 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:25:27 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:25:27 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:25:27 user nova-compute[74311]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 (non-flash)
Oct 20 10:25:27 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:25:27 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:25:27 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:25:27 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1884f3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692'): ({'sdh'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Removing single pathed devices sdh {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aff18a-318c-4721-8b7a-304ab5bb7f83]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aedf20-ab23-42ce-ad50-2b680a1d3ff8]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Flushing IO for device /dev/sdh {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca43fd6-473c-4440-b54e-65b653f95270]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e777877-407e-4111-9f23-9126cae89368]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] SCSI volumes sdh have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b764cd30-5d2b-4254-af5b-8453ecf5122f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec59c74-b583-4337-88b9-2e57a5b5c6a2]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692, portal: 172.16.0.220,3260]
Oct 20 10:25:27 user nova-compute[74311]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692, portal: 172.16.0.220,3260] successful.
Oct 20 10:25:27 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f375fade-d000-4d2e-ba16-066b56a75692 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbc8520-b06e-484d-828f-e70272eb4ebd]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] <== disconnect_volume: return (316ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:25:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:25:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:28 user nova-compute[74311]: DEBUG nova.objects.instance [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lazy-loading 'flavor' on Instance uuid 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:25:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2a91a31a-e549-4dc6-9d6a-6beadb910da3 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.708s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:53 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'flavor' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:25:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:25:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquired lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:25:53 user nova-compute[74311]: DEBUG nova.network.neutron [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:25:53 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'info_cache' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:25:53 user nova-compute[74311]: DEBUG nova.objects.base [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Object Instance<6a964d89-1f48-405b-bf64-31b9eef9ece3> lazy-loaded attributes: flavor,info_cache {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Updating instance_info_cache with network_info: [{"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Releasing lock "refresh_cache-6a964d89-1f48-405b-bf64-31b9eef9ece3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:25:54 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Instance destroyed successfully.
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'resources' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.objects.base [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Object Instance<6a964d89-1f48-405b-bf64-31b9eef9ece3> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1673768130',display_name='tempest-AttachVolumeTestJSON-server-1673768130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1673768130',id=18,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJYcmNlzLpysvhxPxGUSP0j7sh5O9o25thL4eCR81ZsGW+B6UHXUeUQVHkIIazQJidMRU0G/6rN9EQv2+Mt89HRMjWiUYCfGHIzOVJ/WhTEW9pqoD8o/FnFRAAvE/JYDw==',key_name='tempest-keypair-2078286093',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f725dba626242d6ada4ccceab72c55c',ramdisk_id='',reservation_id='r-dtf2wxoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1992975846',owner_user_name='tempest-AttachVolumeTestJSON-1992975846-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3599c6c5ec984a3599dbdd732ffd0977',uuid=6a964d89-1f48-405b-bf64-31b9eef9ece3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converting VIF {"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG os_vif [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98eb8ce2-6b, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ab9ec4d-777f-43b6-99f7-4d312a6e6a4c) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:25:54 user nova-compute[74311]: INFO os_vif [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b')
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Start _get_guest_xml network_info=[{"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.objects.base [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Object Instance<6a964d89-1f48-405b-bf64-31b9eef9ece3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:25:54 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:25:54 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.objects.base [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Object Instance<6a964d89-1f48-405b-bf64-31b9eef9ece3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1673768130',display_name='tempest-AttachVolumeTestJSON-server-1673768130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1673768130',id=18,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJYcmNlzLpysvhxPxGUSP0j7sh5O9o25thL4eCR81ZsGW+B6UHXUeUQVHkIIazQJidMRU0G/6rN9EQv2+Mt89HRMjWiUYCfGHIzOVJ/WhTEW9pqoD8o/FnFRAAvE/JYDw==',key_name='tempest-keypair-2078286093',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5f725dba626242d6ada4ccceab72c55c',ramdisk_id='',reservation_id='r-dtf2wxoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1992975846',owner_user_name='tempest-AttachVolumeTestJSON-1992975846-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3599c6c5ec984a3599dbdd732ffd0977',uuid=6a964d89-1f48-405b-bf64-31b9eef9ece3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converting VIF {"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.objects.base [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Object Instance<6a964d89-1f48-405b-bf64-31b9eef9ece3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:25:54 user nova-compute[74311]:   <uuid>6a964d89-1f48-405b-bf64-31b9eef9ece3</uuid>
Oct 20 10:25:54 user nova-compute[74311]:   <name>instance-00000012</name>
Oct 20 10:25:54 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:25:54 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:25:54 user nova-compute[74311]:   <metadata>
Oct 20 10:25:54 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:25:54 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:25:54 user nova-compute[74311]:       <nova:name>tempest-AttachVolumeTestJSON-server-1673768130</nova:name>
Oct 20 10:25:54 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:25:54</nova:creationTime>
Oct 20 10:25:54 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:25:54 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:25:54 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:25:54 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:25:54 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:25:54 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:25:54 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:25:54 user nova-compute[74311]:       <nova:owner>
Oct 20 10:25:54 user nova-compute[74311]:         <nova:user uuid="3599c6c5ec984a3599dbdd732ffd0977">tempest-AttachVolumeTestJSON-1992975846-project-member</nova:user>
Oct 20 10:25:54 user nova-compute[74311]:         <nova:project uuid="5f725dba626242d6ada4ccceab72c55c">tempest-AttachVolumeTestJSON-1992975846</nova:project>
Oct 20 10:25:54 user nova-compute[74311]:       </nova:owner>
Oct 20 10:25:54 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:25:54 user nova-compute[74311]:       <nova:ports>
Oct 20 10:25:54 user nova-compute[74311]:         <nova:port uuid="98eb8ce2-6b43-43ac-99f6-e908d0688d20">
Oct 20 10:25:54 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 10:25:54 user nova-compute[74311]:         </nova:port>
Oct 20 10:25:54 user nova-compute[74311]:       </nova:ports>
Oct 20 10:25:54 user nova-compute[74311]:     </nova:instance>
Oct 20 10:25:54 user nova-compute[74311]:   </metadata>
Oct 20 10:25:54 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:25:54 user nova-compute[74311]:     <system>
Oct 20 10:25:54 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:25:54 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:25:54 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:25:54 user nova-compute[74311]:       <entry name="serial">6a964d89-1f48-405b-bf64-31b9eef9ece3</entry>
Oct 20 10:25:54 user nova-compute[74311]:       <entry name="uuid">6a964d89-1f48-405b-bf64-31b9eef9ece3</entry>
Oct 20 10:25:54 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:25:54 user nova-compute[74311]:     </system>
Oct 20 10:25:54 user nova-compute[74311]:   </sysinfo>
Oct 20 10:25:54 user nova-compute[74311]:   <os>
Oct 20 10:25:54 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:25:54 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:25:54 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:25:54 user nova-compute[74311]:   </os>
Oct 20 10:25:54 user nova-compute[74311]:   <features>
Oct 20 10:25:54 user nova-compute[74311]:     <acpi/>
Oct 20 10:25:54 user nova-compute[74311]:     <apic/>
Oct 20 10:25:54 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:25:54 user nova-compute[74311]:   </features>
Oct 20 10:25:54 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:25:54 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:25:54 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:25:54 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:25:54 user nova-compute[74311]:   </clock>
Oct 20 10:25:54 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:25:54 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:25:54 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:25:54 user nova-compute[74311]:   </cpu>
Oct 20 10:25:54 user nova-compute[74311]:   <devices>
Oct 20 10:25:54 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:25:54 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:25:54 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk"/>
Oct 20 10:25:54 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:25:54 user nova-compute[74311]:     </disk>
Oct 20 10:25:54 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:25:54 user nova-compute[74311]:       <mac address="fa:16:3e:6e:64:47"/>
Oct 20 10:25:54 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:25:54 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:25:54 user nova-compute[74311]:       <target dev="tap98eb8ce2-6b"/>
Oct 20 10:25:54 user nova-compute[74311]:     </interface>
Oct 20 10:25:54 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:25:54 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/console.log" append="off"/>
Oct 20 10:25:54 user nova-compute[74311]:     </serial>
Oct 20 10:25:54 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:25:54 user nova-compute[74311]:     <video>
Oct 20 10:25:54 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:25:54 user nova-compute[74311]:     </video>
Oct 20 10:25:54 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:25:54 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:25:54 user nova-compute[74311]:     </rng>
Oct 20 10:25:54 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:25:54 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:25:54 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:25:54 user nova-compute[74311]:     </memballoon>
Oct 20 10:25:54 user nova-compute[74311]:   </devices>
Oct 20 10:25:54 user nova-compute[74311]: </domain>
Oct 20 10:25:54 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:54 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG nova.objects.base [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Object Instance<6a964d89-1f48-405b-bf64-31b9eef9ece3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Cannot resize image /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'migration_context' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG nova.objects.base [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Object Instance<6a964d89-1f48-405b-bf64-31b9eef9ece3> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1673768130',display_name='tempest-AttachVolumeTestJSON-server-1673768130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1673768130',id=18,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJYcmNlzLpysvhxPxGUSP0j7sh5O9o25thL4eCR81ZsGW+B6UHXUeUQVHkIIazQJidMRU0G/6rN9EQv2+Mt89HRMjWiUYCfGHIzOVJ/WhTEW9pqoD8o/FnFRAAvE/JYDw==',key_name='tempest-keypair-2078286093',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5f725dba626242d6ada4ccceab72c55c',ramdisk_id='',reservation_id='r-dtf2wxoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1992975846',owner_user_name='tempest-AttachVolumeTestJSON-1992975846-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3599c6c5ec984a3599dbdd732ffd0977',uuid=6a964d89-1f48-405b-bf64-31b9eef9ece3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converting VIF {"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG os_vif [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f2e914d-200e-57a1-807d-49598e3fc93d', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98eb8ce2-6b, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98eb8ce2-6b, col_values=(('qos', UUID('2b685c1c-2712-4062-905e-4d848b6695c1')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98eb8ce2-6b, col_values=(('external_ids', {'iface-id': '98eb8ce2-6b43-43ac-99f6-e908d0688d20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:64:47', 'vm-uuid': '6a964d89-1f48-405b-bf64-31b9eef9ece3'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:55 user nova-compute[74311]: INFO os_vif [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b')
Oct 20 10:25:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG nova.compute.manager [req-17ce7b8d-ae03-4648-a8d3-bd9509393545 req-49c5c304-d638-4a16-95a1-45d3d4b8459e service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-17ce7b8d-ae03-4648-a8d3-bd9509393545 req-49c5c304-d638-4a16-95a1-45d3d4b8459e service nova] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-17ce7b8d-ae03-4648-a8d3-bd9509393545 req-49c5c304-d638-4a16-95a1-45d3d4b8459e service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-17ce7b8d-ae03-4648-a8d3-bd9509393545 req-49c5c304-d638-4a16-95a1-45d3d4b8459e service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG nova.compute.manager [req-17ce7b8d-ae03-4648-a8d3-bd9509393545 req-49c5c304-d638-4a16-95a1-45d3d4b8459e service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] No waiting events found dispatching network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:25:57 user nova-compute[74311]: WARNING nova.compute.manager [req-17ce7b8d-ae03-4648-a8d3-bd9509393545 req-49c5c304-d638-4a16-95a1-45d3d4b8459e service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received unexpected event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 for instance with vm_state stopped and task_state powering-on.
Oct 20 10:25:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:57 user nova-compute[74311]: INFO nova.compute.manager [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Terminating instance
Oct 20 10:25:57 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-29d3ee3d-405f-43a8-a00f-8743a1d8ee57 req-9ccc8c0f-6836-47f7-a689-55c4e200452c service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-vif-unplugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-29d3ee3d-405f-43a8-a00f-8743a1d8ee57 req-9ccc8c0f-6836-47f7-a689-55c4e200452c service nova] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-29d3ee3d-405f-43a8-a00f-8743a1d8ee57 req-9ccc8c0f-6836-47f7-a689-55c4e200452c service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-29d3ee3d-405f-43a8-a00f-8743a1d8ee57 req-9ccc8c0f-6836-47f7-a689-55c4e200452c service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-29d3ee3d-405f-43a8-a00f-8743a1d8ee57 req-9ccc8c0f-6836-47f7-a689-55c4e200452c service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] No waiting events found dispatching network-vif-unplugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-29d3ee3d-405f-43a8-a00f-8743a1d8ee57 req-9ccc8c0f-6836-47f7-a689-55c4e200452c service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-vif-unplugged-058da87e-19f4-49ec-9ddd-c9e793db0844 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:58 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Instance destroyed successfully.
Oct 20 10:25:58 user nova-compute[74311]: DEBUG nova.objects.instance [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lazy-loading 'resources' on Instance uuid 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-475240772',display_name='tempest-ServerStableDeviceRescueTest-server-475240772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-475240772',id=21,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSaHAPJXPwHtr2z75hfGwvgYy3fJDl5BHYwTboRDjafFsh+foIsirIZZlOfDFQCIr1XyckI18S7vdaeeKQn22XSAYFAeShpR9yHRJWrgjTk9bykSFraTWi88/itm+f41A==',key_name='tempest-keypair-735267954',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:22:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9724497a866463aa572a186693520b8',ramdisk_id='',reservation_id='r-7efu0f60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1321548002',owner_user_name='tempest-ServerStableDeviceRescueTest-1321548002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:24:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eacf2bfd21e24516b6613c5e62f9c815',uuid=2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Converting VIF {"id": "058da87e-19f4-49ec-9ddd-c9e793db0844", "address": "fa:16:3e:ea:eb:6a", "network": {"id": "faf442c8-81aa-425e-a35c-f3cbe7afa1bb", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-12730455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9724497a866463aa572a186693520b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap058da87e-19", "ovs_interfaceid": "058da87e-19f4-49ec-9ddd-c9e793db0844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:eb:6a,bridge_name='br-int',has_traffic_filtering=True,id=058da87e-19f4-49ec-9ddd-c9e793db0844,network=Network(faf442c8-81aa-425e-a35c-f3cbe7afa1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap058da87e-19') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG os_vif [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:eb:6a,bridge_name='br-int',has_traffic_filtering=True,id=058da87e-19f4-49ec-9ddd-c9e793db0844,network=Network(faf442c8-81aa-425e-a35c-f3cbe7afa1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap058da87e-19') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap058da87e-19, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63daa443-51e5-4977-aaf1-1674f196ec44) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:25:58 user nova-compute[74311]: INFO os_vif [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:eb:6a,bridge_name='br-int',has_traffic_filtering=True,id=058da87e-19f4-49ec-9ddd-c9e793db0844,network=Network(faf442c8-81aa-425e-a35c-f3cbe7afa1bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap058da87e-19')
Oct 20 10:25:58 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Deleting instance files /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9_del
Oct 20 10:25:58 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Deletion of /opt/stack/data/nova/instances/2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9_del complete
Oct 20 10:25:58 user nova-compute[74311]: INFO nova.compute.manager [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 20 10:25:58 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:25:58 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:25:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:25:59 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Instance rebooted successfully.
Oct 20 10:25:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-7ed25204-4a28-47c7-955d-a19e29568fa0 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:25:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:25:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:25:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:25:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:25:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] No waiting events found dispatching network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:25:59 user nova-compute[74311]: WARNING nova.compute.manager [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received unexpected event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 for instance with vm_state active and task_state None.
Oct 20 10:25:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Received event network-changed-097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:25:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Refreshing instance network info cache due to event network-changed-097b3196-1731-46ef-a752-fcc882c73dfd. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:25:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] Acquiring lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:25:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] Acquired lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:25:59 user nova-compute[74311]: DEBUG nova.network.neutron [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Refreshing network info cache for port 097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-b0d2e1cc-7f65-4fbe-b1b3-08cbb4a44785 req-29f39912-2019-4b16-b39a-8e6b0b47a43b service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b0d2e1cc-7f65-4fbe-b1b3-08cbb4a44785 req-29f39912-2019-4b16-b39a-8e6b0b47a43b service nova] Acquiring lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b0d2e1cc-7f65-4fbe-b1b3-08cbb4a44785 req-29f39912-2019-4b16-b39a-8e6b0b47a43b service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b0d2e1cc-7f65-4fbe-b1b3-08cbb4a44785 req-29f39912-2019-4b16-b39a-8e6b0b47a43b service nova] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-b0d2e1cc-7f65-4fbe-b1b3-08cbb4a44785 req-29f39912-2019-4b16-b39a-8e6b0b47a43b service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] No waiting events found dispatching network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:00 user nova-compute[74311]: WARNING nova.compute.manager [req-b0d2e1cc-7f65-4fbe-b1b3-08cbb4a44785 req-29f39912-2019-4b16-b39a-8e6b0b47a43b service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received unexpected event network-vif-plugged-058da87e-19f4-49ec-9ddd-c9e793db0844 for instance with vm_state active and task_state deleting.
Oct 20 10:26:00 user nova-compute[74311]: DEBUG nova.network.neutron [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Updated VIF entry in instance network info cache for port 097b3196-1731-46ef-a752-fcc882c73dfd. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG nova.network.neutron [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Updating instance_info_cache with network_info: [{"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:00 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Took 1.82 seconds to deallocate network for instance.
Oct 20 10:26:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] Releasing lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received event network-changed-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Refreshing instance network info cache due to event network-changed-e240d2ee-098d-4047-97e1-e81090552740. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] Acquiring lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] Acquired lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG nova.network.neutron [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Refreshing network info cache for port e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Stashing vm_state: active {{(pid=74311) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:01 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:26:01 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:26:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.282s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:01 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:26:01 user nova-compute[74311]: INFO nova.compute.claims [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Claim successful on node user
Oct 20 10:26:01 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Deleted allocations for instance 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9
Oct 20 10:26:01 user nova-compute[74311]: DEBUG nova.network.neutron [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Updated VIF entry in instance network info cache for port e240d2ee-098d-4047-97e1-e81090552740. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:26:01 user nova-compute[74311]: DEBUG nova.network.neutron [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Updating instance_info_cache with network_info: [{"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:01 user nova-compute[74311]: INFO nova.compute.resource_tracker [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Updating resource usage from migration df3bfebc-7cf4-4b6e-a10b-c2a25cb67c06
Oct 20 10:26:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e16252a4-4fe3-41eb-a6f9-9d33eb56c889 req-c6558b90-88e4-475b-91bf-82cd3bc28e7b service nova] Releasing lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:26:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f7f996ec-2d6e-4096-9581-fb3e28341c45 tempest-ServerStableDeviceRescueTest-1321548002 tempest-ServerStableDeviceRescueTest-1321548002-project-member] Lock "2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.827s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:01 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:26:01 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:26:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.711s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:01 user nova-compute[74311]: INFO nova.compute.manager [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Migrating
Oct 20 10:26:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:26:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquired lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:26:01 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:26:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-1e2ee48d-5585-41be-b142-1dd171561954 req-37681c53-3035-41b5-8502-30b3a46d64e2 service nova] [instance: 2b8dfd8a-9f17-4c90-8aa2-ecda3ef13be9] Received event network-vif-deleted-058da87e-19f4-49ec-9ddd-c9e793db0844 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Updating instance_info_cache with network_info: [{"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Releasing lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Starting migrate_disk_and_power_off {{(pid=74311) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Updating instance_info_cache with network_info: [{"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:03 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Instance destroyed successfully.
Oct 20 10:26:03 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1216890647',display_name='tempest-ServerActionsTestOtherA-server-1216890647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1216890647',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrV3Ete25j/fWp9se4mxMWH8BlUBzypkEKDQ+cEJ4VP8hCjsvoAfM2JugNca5+qdBC1FO7G9hMianDZcBDCqTf2/GGIFqvMCvoR42Lgy+aDjy2Ay+qKFAL51raC0WY1Gw==',key_name='tempest-keypair-317846828',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:24:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-0vwgd7k7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:26:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=3b70780c-e968-4fce-a887-121d4b00218a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1485600985-network", "vif_mac": "fa:16:3e:36:f6:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1485600985-network", "vif_mac": "fa:16:3e:36:f6:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=e240d2ee-098d-4047-97e1-e81090552740,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240d2ee-09') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_vif [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=e240d2ee-098d-4047-97e1-e81090552740,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240d2ee-09') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape240d2ee-09, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11e08a4d-9bfa-4a4a-a8f7-4c5f836da7cb) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:26:03 user nova-compute[74311]: INFO os_vif [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=e240d2ee-098d-4047-97e1-e81090552740,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240d2ee-09')
Oct 20 10:26:03 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlIvXJBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:26:03 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9988e632-cef1-41fd-b9bc-bf25a7e48641]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:26:03 user nova-compute[74311]: No targets found.
Oct 20 10:26:03 user nova-compute[74311]: iSNS:
Oct 20 10:26:03 user nova-compute[74311]: No targets found.
Oct 20 10:26:03 user nova-compute[74311]: STATIC:
Oct 20 10:26:03 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:26:03 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:26:03 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:26:03 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728
Oct 20 10:26:03 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:26:03 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:26:03 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36
Oct 20 10:26:03 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:26:03 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:26:03 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8
Oct 20 10:26:03 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:26:03 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:26:03 user nova-compute[74311]: FIRMWARE:
Oct 20 10:26:03 user nova-compute[74311]: No targets found.
Oct 20 10:26:03 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:26:03 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:26:03 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db24d22-1fd1-4d50-a3ad-3b5c8ddee94b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3124d12-d531-48b8-8236-d77e9af5a3fc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:26:03 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:26:03 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:26:03 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:26:03 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:26:03 user nova-compute[74311]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:26:03 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:26:03 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:26:03 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1884f2950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[462853ac-0d84-4760-a1e4-a10bce59a643]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4e1570-a244-43a7-827f-75fa4371dcd2]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac1dc51-b5ff-4c6b-89ec-98f53346bab8]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.069s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ba75bc-dce9-44a5-8fe9-052e2a7d45dd]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[489f5334-dcc9-4d6c-b8ff-501c774e13ab]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[50090cad-c314-4da0-b04b-04dadca56668]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260]
Oct 20 10:26:03 user nova-compute[74311]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260] successful.
Oct 20 10:26:03 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cef2c59-9f07-4c62-8cc0-ae4b8ff63ac7]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] <== disconnect_volume: return (398ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:03 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:26:04 user nova-compute[74311]: DEBUG nova.compute.manager [req-30402ca3-cb05-4df5-9801-90e4fc553ec5 req-8eb6c7e2-af79-4982-9651-eab9e00dfbb8 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received event network-vif-unplugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-30402ca3-cb05-4df5-9801-90e4fc553ec5 req-8eb6c7e2-af79-4982-9651-eab9e00dfbb8 service nova] Acquiring lock "3b70780c-e968-4fce-a887-121d4b00218a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-30402ca3-cb05-4df5-9801-90e4fc553ec5 req-8eb6c7e2-af79-4982-9651-eab9e00dfbb8 service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-30402ca3-cb05-4df5-9801-90e4fc553ec5 req-8eb6c7e2-af79-4982-9651-eab9e00dfbb8 service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:04 user nova-compute[74311]: DEBUG nova.compute.manager [req-30402ca3-cb05-4df5-9801-90e4fc553ec5 req-8eb6c7e2-af79-4982-9651-eab9e00dfbb8 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] No waiting events found dispatching network-vif-unplugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:04 user nova-compute[74311]: WARNING nova.compute.manager [req-30402ca3-cb05-4df5-9801-90e4fc553ec5 req-8eb6c7e2-af79-4982-9651-eab9e00dfbb8 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received unexpected event network-vif-unplugged-e240d2ee-098d-4047-97e1-e81090552740 for instance with vm_state active and task_state resize_migrating.
Oct 20 10:26:04 user nova-compute[74311]: DEBUG nova.compute.manager [req-30402ca3-cb05-4df5-9801-90e4fc553ec5 req-8eb6c7e2-af79-4982-9651-eab9e00dfbb8 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received event network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-30402ca3-cb05-4df5-9801-90e4fc553ec5 req-8eb6c7e2-af79-4982-9651-eab9e00dfbb8 service nova] Acquiring lock "3b70780c-e968-4fce-a887-121d4b00218a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-30402ca3-cb05-4df5-9801-90e4fc553ec5 req-8eb6c7e2-af79-4982-9651-eab9e00dfbb8 service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-30402ca3-cb05-4df5-9801-90e4fc553ec5 req-8eb6c7e2-af79-4982-9651-eab9e00dfbb8 service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:04 user nova-compute[74311]: DEBUG nova.compute.manager [req-30402ca3-cb05-4df5-9801-90e4fc553ec5 req-8eb6c7e2-af79-4982-9651-eab9e00dfbb8 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] No waiting events found dispatching network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:04 user nova-compute[74311]: WARNING nova.compute.manager [req-30402ca3-cb05-4df5-9801-90e4fc553ec5 req-8eb6c7e2-af79-4982-9651-eab9e00dfbb8 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received unexpected event network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 for instance with vm_state active and task_state resize_migrating.
Oct 20 10:26:04 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Port e240d2ee-098d-4047-97e1-e81090552740 binding to destination host user is already ACTIVE {{(pid=74311) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 10:26:05 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:26:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "3b70780c-e968-4fce-a887-121d4b00218a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:26:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquired lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:26:05 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:26:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:05 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Updating instance_info_cache with network_info: [{"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Releasing lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG os_brick.utils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7635ac11-b492-471b-84ad-693101194702]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcb4126-1721-43c2-b051-a1db1b9c6ad7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee795440-13c1-496b-963d-71f93f9399c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d39b95e-06b9-4b74-af64-9a3385f79b5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:26:06 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:26:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[888e1146-741a-496c-b98b-56545915da8c]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:26:06 user nova-compute[74311]: DEBUG os_brick.utils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:26:08 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:26:08 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:26:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:08 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:26:10 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:26:10 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:26:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:10 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:26:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:26:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:11 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "acd91e17-e847-403f-84f4-8ab962ff06db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "acd91e17-e847-403f-84f4-8ab962ff06db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:12 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:26:12 user nova-compute[74311]: INFO nova.compute.claims [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Claim successful on node user
Oct 20 10:26:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.784s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG nova.compute.manager [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG nova.compute.manager [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG nova.network.neutron [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:26:13 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:26:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG nova.compute.manager [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:26:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.policy [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56f4022992534cb0b81e393ccbac8d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed6d454e3a3423682cd4a6b21c685df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:26:14 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:26:14 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7498MB free_disk=25.135150909423828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.manager [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:26:14 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Creating image(s)
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "/opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "/opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "/opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Applying migration context for instance 3b70780c-e968-4fce-a887-121d4b00218a as it has an incoming, in-progress migration df3bfebc-7cf4-4b6e-a10b-c2a25cb67c06. Migration status is post-migrating {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 10:26:14 user nova-compute[74311]: INFO nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Updating resource usage from migration df3bfebc-7cf4-4b6e-a10b-c2a25cb67c06
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 922b36b5-0575-4717-a876-dda27469ebb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfb50bd6-42e6-4f8a-af8c-712e52644cb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 730bd2ce-cb53-411a-8b74-dafba0d5e2bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 141ba46f-2fab-46db-8512-862aeef49ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Migration df3bfebc-7cf4-4b6e-a10b-c2a25cb67c06 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 3b70780c-e968-4fce-a887-121d4b00218a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance acd91e17-e847-403f-84f4-8ab962ff06db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.228s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/disk 1073741824" returned: 0 in 0.074s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG nova.network.neutron [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Successfully created port: 20688c54-86dc-4d82-a97a-f5c77423d649 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Cannot resize image /opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Ensure instance console log exists: /opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.026s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG nova.network.neutron [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Successfully updated port: 20688c54-86dc-4d82-a97a-f5c77423d649 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "refresh_cache-acd91e17-e847-403f-84f4-8ab962ff06db" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquired lock "refresh_cache-acd91e17-e847-403f-84f4-8ab962ff06db" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG nova.network.neutron [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG nova.compute.manager [req-b79a81d3-d658-4160-b902-f848a40ec47f req-f3151691-202d-45f6-884e-b4526479a39a service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Received event network-changed-20688c54-86dc-4d82-a97a-f5c77423d649 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG nova.compute.manager [req-b79a81d3-d658-4160-b902-f848a40ec47f req-f3151691-202d-45f6-884e-b4526479a39a service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Refreshing instance network info cache due to event network-changed-20688c54-86dc-4d82-a97a-f5c77423d649. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b79a81d3-d658-4160-b902-f848a40ec47f req-f3151691-202d-45f6-884e-b4526479a39a service nova] Acquiring lock "refresh_cache-acd91e17-e847-403f-84f4-8ab962ff06db" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:26:15 user nova-compute[74311]: DEBUG nova.network.neutron [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.network.neutron [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Updating instance_info_cache with network_info: [{"id": "20688c54-86dc-4d82-a97a-f5c77423d649", "address": "fa:16:3e:3d:43:cf", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20688c54-86", "ovs_interfaceid": "20688c54-86dc-4d82-a97a-f5c77423d649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Releasing lock "refresh_cache-acd91e17-e847-403f-84f4-8ab962ff06db" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.compute.manager [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Instance network_info: |[{"id": "20688c54-86dc-4d82-a97a-f5c77423d649", "address": "fa:16:3e:3d:43:cf", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20688c54-86", "ovs_interfaceid": "20688c54-86dc-4d82-a97a-f5c77423d649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b79a81d3-d658-4160-b902-f848a40ec47f req-f3151691-202d-45f6-884e-b4526479a39a service nova] Acquired lock "refresh_cache-acd91e17-e847-403f-84f4-8ab962ff06db" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.network.neutron [req-b79a81d3-d658-4160-b902-f848a40ec47f req-f3151691-202d-45f6-884e-b4526479a39a service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Refreshing network info cache for port 20688c54-86dc-4d82-a97a-f5c77423d649 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Start _get_guest_xml network_info=[{"id": "20688c54-86dc-4d82-a97a-f5c77423d649", "address": "fa:16:3e:3d:43:cf", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20688c54-86", "ovs_interfaceid": "20688c54-86dc-4d82-a97a-f5c77423d649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:26:16 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:26:16 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1929983182',display_name='tempest-VolumesActionsTest-instance-1929983182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1929983182',id=30,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed6d454e3a3423682cd4a6b21c685df',ramdisk_id='',reservation_id='r-i0uz6hqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-711255224',owner_user_name='tempest-VolumesActionsTest-711255224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:26:14Z,user_data=None,user_id='56f4022992534cb0b81e393ccbac8d52',uuid=acd91e17-e847-403f-84f4-8ab962ff06db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20688c54-86dc-4d82-a97a-f5c77423d649", "address": "fa:16:3e:3d:43:cf", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20688c54-86", "ovs_interfaceid": "20688c54-86dc-4d82-a97a-f5c77423d649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Converting VIF {"id": "20688c54-86dc-4d82-a97a-f5c77423d649", "address": "fa:16:3e:3d:43:cf", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20688c54-86", "ovs_interfaceid": "20688c54-86dc-4d82-a97a-f5c77423d649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:43:cf,bridge_name='br-int',has_traffic_filtering=True,id=20688c54-86dc-4d82-a97a-f5c77423d649,network=Network(534777ae-0aa3-4431-9cf5-9154ace6d1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20688c54-86') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.objects.instance [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lazy-loading 'pci_devices' on Instance uuid acd91e17-e847-403f-84f4-8ab962ff06db {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:26:16 user nova-compute[74311]:   <uuid>acd91e17-e847-403f-84f4-8ab962ff06db</uuid>
Oct 20 10:26:16 user nova-compute[74311]:   <name>instance-0000001e</name>
Oct 20 10:26:16 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:26:16 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:26:16 user nova-compute[74311]:   <metadata>
Oct 20 10:26:16 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:26:16 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:26:16 user nova-compute[74311]:       <nova:name>tempest-VolumesActionsTest-instance-1929983182</nova:name>
Oct 20 10:26:16 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:26:16</nova:creationTime>
Oct 20 10:26:16 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:26:16 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:26:16 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:26:16 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:26:16 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:26:16 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:26:16 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:26:16 user nova-compute[74311]:       <nova:owner>
Oct 20 10:26:16 user nova-compute[74311]:         <nova:user uuid="56f4022992534cb0b81e393ccbac8d52">tempest-VolumesActionsTest-711255224-project-member</nova:user>
Oct 20 10:26:16 user nova-compute[74311]:         <nova:project uuid="bed6d454e3a3423682cd4a6b21c685df">tempest-VolumesActionsTest-711255224</nova:project>
Oct 20 10:26:16 user nova-compute[74311]:       </nova:owner>
Oct 20 10:26:16 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:26:16 user nova-compute[74311]:       <nova:ports>
Oct 20 10:26:16 user nova-compute[74311]:         <nova:port uuid="20688c54-86dc-4d82-a97a-f5c77423d649">
Oct 20 10:26:16 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 10:26:16 user nova-compute[74311]:         </nova:port>
Oct 20 10:26:16 user nova-compute[74311]:       </nova:ports>
Oct 20 10:26:16 user nova-compute[74311]:     </nova:instance>
Oct 20 10:26:16 user nova-compute[74311]:   </metadata>
Oct 20 10:26:16 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:26:16 user nova-compute[74311]:     <system>
Oct 20 10:26:16 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:26:16 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:26:16 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:26:16 user nova-compute[74311]:       <entry name="serial">acd91e17-e847-403f-84f4-8ab962ff06db</entry>
Oct 20 10:26:16 user nova-compute[74311]:       <entry name="uuid">acd91e17-e847-403f-84f4-8ab962ff06db</entry>
Oct 20 10:26:16 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:26:16 user nova-compute[74311]:     </system>
Oct 20 10:26:16 user nova-compute[74311]:   </sysinfo>
Oct 20 10:26:16 user nova-compute[74311]:   <os>
Oct 20 10:26:16 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:26:16 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:26:16 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:26:16 user nova-compute[74311]:   </os>
Oct 20 10:26:16 user nova-compute[74311]:   <features>
Oct 20 10:26:16 user nova-compute[74311]:     <acpi/>
Oct 20 10:26:16 user nova-compute[74311]:     <apic/>
Oct 20 10:26:16 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:26:16 user nova-compute[74311]:   </features>
Oct 20 10:26:16 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:26:16 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:26:16 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:26:16 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:26:16 user nova-compute[74311]:   </clock>
Oct 20 10:26:16 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:26:16 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:26:16 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:26:16 user nova-compute[74311]:   </cpu>
Oct 20 10:26:16 user nova-compute[74311]:   <devices>
Oct 20 10:26:16 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:26:16 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:26:16 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/disk"/>
Oct 20 10:26:16 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:26:16 user nova-compute[74311]:     </disk>
Oct 20 10:26:16 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:26:16 user nova-compute[74311]:       <mac address="fa:16:3e:3d:43:cf"/>
Oct 20 10:26:16 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:26:16 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:26:16 user nova-compute[74311]:       <target dev="tap20688c54-86"/>
Oct 20 10:26:16 user nova-compute[74311]:     </interface>
Oct 20 10:26:16 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:26:16 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/console.log" append="off"/>
Oct 20 10:26:16 user nova-compute[74311]:     </serial>
Oct 20 10:26:16 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:26:16 user nova-compute[74311]:     <video>
Oct 20 10:26:16 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:26:16 user nova-compute[74311]:     </video>
Oct 20 10:26:16 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:26:16 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:26:16 user nova-compute[74311]:     </rng>
Oct 20 10:26:16 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:26:16 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:26:16 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:26:16 user nova-compute[74311]:     </memballoon>
Oct 20 10:26:16 user nova-compute[74311]:   </devices>
Oct 20 10:26:16 user nova-compute[74311]: </domain>
Oct 20 10:26:16 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1929983182',display_name='tempest-VolumesActionsTest-instance-1929983182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1929983182',id=30,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bed6d454e3a3423682cd4a6b21c685df',ramdisk_id='',reservation_id='r-i0uz6hqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-711255224',owner_user_name='tempest-VolumesActionsTest-711255224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:26:14Z,user_data=None,user_id='56f4022992534cb0b81e393ccbac8d52',uuid=acd91e17-e847-403f-84f4-8ab962ff06db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20688c54-86dc-4d82-a97a-f5c77423d649", "address": "fa:16:3e:3d:43:cf", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20688c54-86", "ovs_interfaceid": "20688c54-86dc-4d82-a97a-f5c77423d649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Converting VIF {"id": "20688c54-86dc-4d82-a97a-f5c77423d649", "address": "fa:16:3e:3d:43:cf", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20688c54-86", "ovs_interfaceid": "20688c54-86dc-4d82-a97a-f5c77423d649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:43:cf,bridge_name='br-int',has_traffic_filtering=True,id=20688c54-86dc-4d82-a97a-f5c77423d649,network=Network(534777ae-0aa3-4431-9cf5-9154ace6d1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20688c54-86') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG os_vif [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:43:cf,bridge_name='br-int',has_traffic_filtering=True,id=20688c54-86dc-4d82-a97a-f5c77423d649,network=Network(534777ae-0aa3-4431-9cf5-9154ace6d1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20688c54-86') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c40d136d-91fa-59c2-9930-478eb4efb4b2', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20688c54-86, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20688c54-86, col_values=(('qos', UUID('2fbe0ead-a438-42d8-a63a-05b6f84c5002')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20688c54-86, col_values=(('external_ids', {'iface-id': '20688c54-86dc-4d82-a97a-f5c77423d649', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:43:cf', 'vm-uuid': 'acd91e17-e847-403f-84f4-8ab962ff06db'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:16 user nova-compute[74311]: INFO os_vif [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:43:cf,bridge_name='br-int',has_traffic_filtering=True,id=20688c54-86dc-4d82-a97a-f5c77423d649,network=Network(534777ae-0aa3-4431-9cf5-9154ace6d1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20688c54-86')
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] No VIF found with MAC fa:16:3e:3d:43:cf, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.network.neutron [req-b79a81d3-d658-4160-b902-f848a40ec47f req-f3151691-202d-45f6-884e-b4526479a39a service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Updated VIF entry in instance network info cache for port 20688c54-86dc-4d82-a97a-f5c77423d649. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG nova.network.neutron [req-b79a81d3-d658-4160-b902-f848a40ec47f req-f3151691-202d-45f6-884e-b4526479a39a service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Updating instance_info_cache with network_info: [{"id": "20688c54-86dc-4d82-a97a-f5c77423d649", "address": "fa:16:3e:3d:43:cf", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20688c54-86", "ovs_interfaceid": "20688c54-86dc-4d82-a97a-f5c77423d649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b79a81d3-d658-4160-b902-f848a40ec47f req-f3151691-202d-45f6-884e-b4526479a39a service nova] Releasing lock "refresh_cache-acd91e17-e847-403f-84f4-8ab962ff06db" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:26:17 user nova-compute[74311]: INFO nova.compute.manager [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Rescuing
Oct 20 10:26:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "refresh_cache-730bd2ce-cb53-411a-8b74-dafba0d5e2bb" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:26:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquired lock "refresh_cache-730bd2ce-cb53-411a-8b74-dafba0d5e2bb" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:26:17 user nova-compute[74311]: DEBUG nova.network.neutron [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:26:17 user nova-compute[74311]: DEBUG nova.network.neutron [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Updating instance_info_cache with network_info: [{"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Releasing lock "refresh_cache-730bd2ce-cb53-411a-8b74-dafba0d5e2bb" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:26:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG nova.compute.manager [req-7efad474-8daa-463b-a5c5-51f07f2d1659 req-712fd5b5-4460-48b2-9bd5-921f1160b991 service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Received event network-vif-plugged-20688c54-86dc-4d82-a97a-f5c77423d649 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7efad474-8daa-463b-a5c5-51f07f2d1659 req-712fd5b5-4460-48b2-9bd5-921f1160b991 service nova] Acquiring lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7efad474-8daa-463b-a5c5-51f07f2d1659 req-712fd5b5-4460-48b2-9bd5-921f1160b991 service nova] Lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7efad474-8daa-463b-a5c5-51f07f2d1659 req-712fd5b5-4460-48b2-9bd5-921f1160b991 service nova] Lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG nova.compute.manager [req-7efad474-8daa-463b-a5c5-51f07f2d1659 req-712fd5b5-4460-48b2-9bd5-921f1160b991 service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] No waiting events found dispatching network-vif-plugged-20688c54-86dc-4d82-a97a-f5c77423d649 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:18 user nova-compute[74311]: WARNING nova.compute.manager [req-7efad474-8daa-463b-a5c5-51f07f2d1659 req-712fd5b5-4460-48b2-9bd5-921f1160b991 service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Received unexpected event network-vif-plugged-20688c54-86dc-4d82-a97a-f5c77423d649 for instance with vm_state building and task_state spawning.
Oct 20 10:26:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:18 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Instance destroyed successfully.
Oct 20 10:26:18 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Attempting a stable device rescue
Oct 20 10:26:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74311) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Instance directory exists: not creating {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 10:26:18 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Creating image(s)
Oct 20 10:26:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "/opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "/opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "/opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG nova.objects.instance [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'trusted_certs' on Instance uuid 730bd2ce-cb53-411a-8b74-dafba0d5e2bb {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec.part --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec.part --force-share --output=json" returned: 0 in 0.198s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.images [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] d8803cf9-d8e8-43c4-8f5f-4a4c4b910754 was qcow2, converting to raw {{(pid=74311) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec.part /opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec.converted {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Received event network-vif-plugged-20688c54-86dc-4d82-a97a-f5c77423d649 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] Acquiring lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] Lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] Lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] No waiting events found dispatching network-vif-plugged-20688c54-86dc-4d82-a97a-f5c77423d649 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:20 user nova-compute[74311]: WARNING nova.compute.manager [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Received unexpected event network-vif-plugged-20688c54-86dc-4d82-a97a-f5c77423d649 for instance with vm_state building and task_state spawning.
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-unplugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-unplugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:20 user nova-compute[74311]: WARNING nova.compute.manager [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received unexpected event network-vif-unplugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with vm_state active and task_state rescuing.
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:20 user nova-compute[74311]: WARNING nova.compute.manager [req-13824d40-706a-4fd0-88c4-4da5a2676fc1 req-511bf5b9-2205-42de-a6f9-572d8462c912 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received unexpected event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with vm_state active and task_state rescuing.
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec.part /opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec.converted" returned: 0 in 0.292s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec.converted --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.804s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec --force-share --output=json" returned: 0 in 0.199s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec,backing_fmt=raw /opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb/disk.rescue {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec,backing_fmt=raw /opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb/disk.rescue" returned: 0 in 0.058s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.objects.instance [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'migration_context' on Instance uuid 730bd2ce-cb53-411a-8b74-dafba0d5e2bb {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.objects.base [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Object Instance<730bd2ce-cb53-411a-8b74-dafba0d5e2bb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Start _get_guest_xml network_info=[{"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "vif_mac": "fa:16:3e:32:c0:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd8803cf9-d8e8-43c4-8f5f-4a4c4b910754', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '062eaa0d-34e4-4dfb-8ff7-28d314ac14ef', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBwJTzCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '730bd2ce-cb53-411a-8b74-dafba0d5e2bb', 'attached_at': '', 'detached_at': '', 'volume_id': 'd65f3863-0f82-406c-bfc2-07dc2d1afec8', 'serial': 'd65f3863-0f82-406c-bfc2-07dc2d1afec8'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.objects.instance [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'resources' on Instance uuid 730bd2ce-cb53-411a-8b74-dafba0d5e2bb {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:26:20 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Instance spawned successfully.
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.objects.base [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Object Instance<730bd2ce-cb53-411a-8b74-dafba0d5e2bb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.objects.instance [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'numa_topology' on Instance uuid 730bd2ce-cb53-411a-8b74-dafba0d5e2bb {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.objects.base [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Object Instance<730bd2ce-cb53-411a-8b74-dafba0d5e2bb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:26:20 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:26:20 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.objects.instance [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'vcpu_model' on Instance uuid 730bd2ce-cb53-411a-8b74-dafba0d5e2bb {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.objects.base [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Object Instance<730bd2ce-cb53-411a-8b74-dafba0d5e2bb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBwJTzCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:26:20 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:26:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:26:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:26:21 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:26:21 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:26:21 user nova-compute[74311]: INFO nova.compute.manager [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Took 6.54 seconds to spawn the instance on the hypervisor.
Oct 20 10:26:21 user nova-compute[74311]: DEBUG nova.compute.manager [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51d962a-37b8-426b-8860-8a7befe06aa8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xBwJTzCc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 10:26:21 user nova-compute[74311]: node.name = iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8
Oct 20 10:26:21 user nova-compute[74311]: node.tpgt = -1
Oct 20 10:26:21 user nova-compute[74311]: node.startup = automatic
Oct 20 10:26:21 user nova-compute[74311]: node.leading_login = No
Oct 20 10:26:21 user nova-compute[74311]: iface.iscsi_ifacename = default
Oct 20 10:26:21 user nova-compute[74311]: iface.net_ifacename = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.ipaddress = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.prefix_len = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.hwaddress = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.transport_name = tcp
Oct 20 10:26:21 user nova-compute[74311]: iface.initiatorname = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.state = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.vlan_id = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.vlan_priority = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.vlan_state = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.iface_num = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.mtu = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.port = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.bootproto = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.subnet_mask = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.gateway = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.dhcp_alt_client_id = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.dhcp_dns = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.dhcp_learn_iqn = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.dhcp_vendor_id_state = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.dhcp_vendor_id = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.dhcp_slp_da = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.fragmentation = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.gratuitous_arp = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.incoming_forwarding = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.tos_state = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.tos = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.ttl = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.delayed_ack = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.tcp_nagle = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.tcp_wsf_state = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.tcp_wsf = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.tcp_timer_scale = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.tcp_timestamp = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.redirect = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.def_task_mgmt_timeout = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.header_digest = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.data_digest = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.immediate_data = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.initial_r2t = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.data_seq_inorder = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.data_pdu_inorder = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.erl = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.max_receive_data_len = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.first_burst_len = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.max_outstanding_r2t = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.max_burst_len = 0
Oct 20 10:26:21 user nova-compute[74311]: iface.chap_auth = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.bidi_chap = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.strict_login_compliance = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.discovery_auth = <empty>
Oct 20 10:26:21 user nova-compute[74311]: iface.discovery_logout = <empty>
Oct 20 10:26:21 user nova-compute[74311]: node.discovery_address = <empty>
Oct 20 10:26:21 user nova-compute[74311]: node.discovery_port = 0
Oct 20 10:26:21 user nova-compute[74311]: node.discovery_type = static
Oct 20 10:26:21 user nova-compute[74311]: node.session.initial_cmdsn = 0
Oct 20 10:26:21 user nova-compute[74311]: node.session.initial_login_retry_max = 8
Oct 20 10:26:21 user nova-compute[74311]: node.session.xmit_thread_priority = -20
Oct 20 10:26:21 user nova-compute[74311]: node.session.cmds_max = 128
Oct 20 10:26:21 user nova-compute[74311]: node.session.queue_depth = 32
Oct 20 10:26:21 user nova-compute[74311]: node.session.nr_sessions = 1
Oct 20 10:26:21 user nova-compute[74311]: node.session.auth.authmethod = CHAP
Oct 20 10:26:21 user nova-compute[74311]: node.session.auth.username = xBwJTzCc
Oct 20 10:26:21 user nova-compute[74311]: node.session.auth.password = ***
Oct 20 10:26:21 user nova-compute[74311]: node.session.auth.username_in = <empty>
Oct 20 10:26:21 user nova-compute[74311]: node.session.auth.password_in = <empty>
Oct 20 10:26:21 user nova-compute[74311]: node.session.auth.chap_algs = MD5
Oct 20 10:26:21 user nova-compute[74311]: node.session.timeo.replacement_timeout = 120
Oct 20 10:26:21 user nova-compute[74311]: node.session.err_timeo.abort_timeout = 15
Oct 20 10:26:21 user nova-compute[74311]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 10:26:21 user nova-compute[74311]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 10:26:21 user nova-compute[74311]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 10:26:21 user nova-compute[74311]: node.session.iscsi.FastAbort = Yes
Oct 20 10:26:21 user nova-compute[74311]: node.session.iscsi.InitialR2T = No
Oct 20 10:26:21 user nova-compute[74311]: node.session.iscsi.ImmediateData = Yes
Oct 20 10:26:21 user nova-compute[74311]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 10:26:21 user nova-compute[74311]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 10:26:21 user nova-compute[74311]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 10:26:21 user nova-compute[74311]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 10:26:21 user nova-compute[74311]: node.session.iscsi.MaxConnections = 1
Oct 20 10:26:21 user nova-compute[74311]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 10:26:21 user nova-compute[74311]: node.session.iscsi.ERL = 0
Oct 20 10:26:21 user nova-compute[74311]: node.session.scan = manual
Oct 20 10:26:21 user nova-compute[74311]: node.session.reopen_max = 0
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].address = 172.16.0.220
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].port = 3260
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].startup = manual
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].tcp.window_size = 524288
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].tcp.type_of_service = 0
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].timeo.logout_timeout = 15
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].timeo.login_timeout = 15
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].timeo.auth_timeout = 45
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].iscsi.DataDigest = None
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].iscsi.IFMarker = No
Oct 20 10:26:21 user nova-compute[74311]: node.conn[0].iscsi.OFMarker = No
Oct 20 10:26:21 user nova-compute[74311]: # END RECORD
Oct 20 10:26:21 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1f16f6-ff04-4655-85c8-1c15f587a5ee]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b9948c-18cf-411d-b759-f1ccf3d8a24d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBwJTzCc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xBwJTzCc" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46b8607-fb7d-409a-a1ce-307241a009ad]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xBwJTzCc'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:21 user nova-compute[74311]: INFO nova.compute.manager [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Took 8.23 seconds to build instance.
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.071s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b8d88f-e9f2-4cc7-8eac-e5826ff18c0b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-944b5ad9-2421-4b19-8da8-e9bae4034bba tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "acd91e17-e847-403f-84f4-8ab962ff06db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.379s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c82b88-67ef-4547-8db6-ef4ca4ed022e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:26:21 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:26:21 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:26:21 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:26:21 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:26:21 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:26:21 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.224s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] HCTL ('35', '0', '0', 0) found on session 29 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[980c7309-4403-44b4-a03b-c41d5f093873]: (4, ('0 0 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Searching for a device in session 29 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBwJTzCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.256s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] <== connect_volume: return (258ms) {'type': 'block', 'scsi_wwn': '23337316533363937', 'path': '/dev/sdd'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337316533363937', 'path': '/dev/sdd'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-141140732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-141140732',id=28,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090bd6a8a14d4a308e67be7a12e47ae6',ramdisk_id='',reservation_id='r-swhff48u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:25:13Z,user_data=None,user_id='0c6b76de1f054ca0973f2f9ba2eafaed',uuid=730bd2ce-cb53-411a-8b74-dafba0d5e2bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "vif_mac": "fa:16:3e:32:c0:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converting VIF {"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "vif_mac": "fa:16:3e:32:c0:77"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:c0:77,bridge_name='br-int',has_traffic_filtering=True,id=24df162f-75d9-4c7b-9b02-843587088e7c,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24df162f-75') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG nova.objects.instance [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'pci_devices' on Instance uuid 730bd2ce-cb53-411a-8b74-dafba0d5e2bb {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG nova.objects.base [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Object Instance<730bd2ce-cb53-411a-8b74-dafba0d5e2bb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:26:21 user nova-compute[74311]:   <uuid>730bd2ce-cb53-411a-8b74-dafba0d5e2bb</uuid>
Oct 20 10:26:21 user nova-compute[74311]:   <name>instance-0000001c</name>
Oct 20 10:26:21 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:26:21 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:26:21 user nova-compute[74311]:   <metadata>
Oct 20 10:26:21 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:26:21 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:26:21 user nova-compute[74311]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-141140732</nova:name>
Oct 20 10:26:21 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:26:20</nova:creationTime>
Oct 20 10:26:21 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:26:21 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:26:21 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:26:21 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:26:21 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:26:21 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:26:21 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:26:21 user nova-compute[74311]:       <nova:owner>
Oct 20 10:26:21 user nova-compute[74311]:         <nova:user uuid="0c6b76de1f054ca0973f2f9ba2eafaed">tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member</nova:user>
Oct 20 10:26:21 user nova-compute[74311]:         <nova:project uuid="090bd6a8a14d4a308e67be7a12e47ae6">tempest-ServerBootFromVolumeStableRescueTest-2019341345</nova:project>
Oct 20 10:26:21 user nova-compute[74311]:       </nova:owner>
Oct 20 10:26:21 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:26:21 user nova-compute[74311]:       <nova:ports>
Oct 20 10:26:21 user nova-compute[74311]:         <nova:port uuid="24df162f-75d9-4c7b-9b02-843587088e7c">
Oct 20 10:26:21 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 10:26:21 user nova-compute[74311]:         </nova:port>
Oct 20 10:26:21 user nova-compute[74311]:       </nova:ports>
Oct 20 10:26:21 user nova-compute[74311]:     </nova:instance>
Oct 20 10:26:21 user nova-compute[74311]:   </metadata>
Oct 20 10:26:21 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:26:21 user nova-compute[74311]:     <system>
Oct 20 10:26:21 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:26:21 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:26:21 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:26:21 user nova-compute[74311]:       <entry name="serial">730bd2ce-cb53-411a-8b74-dafba0d5e2bb</entry>
Oct 20 10:26:21 user nova-compute[74311]:       <entry name="uuid">730bd2ce-cb53-411a-8b74-dafba0d5e2bb</entry>
Oct 20 10:26:21 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:26:21 user nova-compute[74311]:     </system>
Oct 20 10:26:21 user nova-compute[74311]:   </sysinfo>
Oct 20 10:26:21 user nova-compute[74311]:   <os>
Oct 20 10:26:21 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:26:21 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:26:21 user nova-compute[74311]:   </os>
Oct 20 10:26:21 user nova-compute[74311]:   <features>
Oct 20 10:26:21 user nova-compute[74311]:     <acpi/>
Oct 20 10:26:21 user nova-compute[74311]:     <apic/>
Oct 20 10:26:21 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:26:21 user nova-compute[74311]:   </features>
Oct 20 10:26:21 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:26:21 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:26:21 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:26:21 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:26:21 user nova-compute[74311]:   </clock>
Oct 20 10:26:21 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:26:21 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:26:21 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:26:21 user nova-compute[74311]:   </cpu>
Oct 20 10:26:21 user nova-compute[74311]:   <devices>
Oct 20 10:26:21 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:26:21 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:26:21 user nova-compute[74311]:       <source dev="/dev/sdd"/>
Oct 20 10:26:21 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:26:21 user nova-compute[74311]:       <serial>d65f3863-0f82-406c-bfc2-07dc2d1afec8</serial>
Oct 20 10:26:21 user nova-compute[74311]:     </disk>
Oct 20 10:26:21 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:26:21 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:26:21 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb/disk.rescue"/>
Oct 20 10:26:21 user nova-compute[74311]:       <target dev="vdb" bus="virtio"/>
Oct 20 10:26:21 user nova-compute[74311]:       <boot order="1"/>
Oct 20 10:26:21 user nova-compute[74311]:     </disk>
Oct 20 10:26:21 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:26:21 user nova-compute[74311]:       <mac address="fa:16:3e:32:c0:77"/>
Oct 20 10:26:21 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:26:21 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:26:21 user nova-compute[74311]:       <target dev="tap24df162f-75"/>
Oct 20 10:26:21 user nova-compute[74311]:     </interface>
Oct 20 10:26:21 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:26:21 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb/console.log" append="off"/>
Oct 20 10:26:21 user nova-compute[74311]:     </serial>
Oct 20 10:26:21 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:26:21 user nova-compute[74311]:     <video>
Oct 20 10:26:21 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:26:21 user nova-compute[74311]:     </video>
Oct 20 10:26:21 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:26:21 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:26:21 user nova-compute[74311]:     </rng>
Oct 20 10:26:21 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:26:21 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:26:21 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:26:21 user nova-compute[74311]:     </memballoon>
Oct 20 10:26:21 user nova-compute[74311]:   </devices>
Oct 20 10:26:21 user nova-compute[74311]: </domain>
Oct 20 10:26:21 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:26:21 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Instance destroyed successfully.
Oct 20 10:26:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:26:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] No VIF found with MAC fa:16:3e:32:c0:77, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:26:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-b26e3133-5f19-4d87-af00-c756784e2301 req-d143b789-274c-476a-9fd9-f4d36157518e service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b26e3133-5f19-4d87-af00-c756784e2301 req-d143b789-274c-476a-9fd9-f4d36157518e service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b26e3133-5f19-4d87-af00-c756784e2301 req-d143b789-274c-476a-9fd9-f4d36157518e service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b26e3133-5f19-4d87-af00-c756784e2301 req-d143b789-274c-476a-9fd9-f4d36157518e service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-b26e3133-5f19-4d87-af00-c756784e2301 req-d143b789-274c-476a-9fd9-f4d36157518e service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:23 user nova-compute[74311]: WARNING nova.compute.manager [req-b26e3133-5f19-4d87-af00-c756784e2301 req-d143b789-274c-476a-9fd9-f4d36157518e service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received unexpected event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with vm_state active and task_state rescuing.
Oct 20 10:26:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "79b6152a-3eec-4412-a063-6e82e767a27b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "79b6152a-3eec-4412-a063-6e82e767a27b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:24 user nova-compute[74311]: DEBUG nova.compute.manager [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:26:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:24 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:26:24 user nova-compute[74311]: INFO nova.compute.claims [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Claim successful on node user
Oct 20 10:26:25 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.646s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG nova.network.neutron [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:26:25 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:26:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG nova.policy [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0134a62628fe4dd29bfd61a987d099d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9820bd4a09494eaf858e88301f6c5827', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:26:25 user nova-compute[74311]: INFO nova.virt.block_device [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Booting with volume 9d865eed-f501-4a9b-a4f2-8fd737339548 at /dev/vda
Oct 20 10:26:25 user nova-compute[74311]: DEBUG os_brick.utils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50cb654-4c43-4fd0-b560-0c0d3b9658ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bdd11a-12c6-4a18-a6da-c9ad4bebceeb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52f9094-e7c5-4715-8ddb-b46bd79a63a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f696ad-421d-4afd-97b4-c3a4c0698e6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-4e0d444e-afbf-480a-b3a9-4be463ebc87e req-38ba8dff-5942-4304-8f31-24b1b908e9de service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4e0d444e-afbf-480a-b3a9-4be463ebc87e req-38ba8dff-5942-4304-8f31-24b1b908e9de service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4e0d444e-afbf-480a-b3a9-4be463ebc87e req-38ba8dff-5942-4304-8f31-24b1b908e9de service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4e0d444e-afbf-480a-b3a9-4be463ebc87e req-38ba8dff-5942-4304-8f31-24b1b908e9de service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-4e0d444e-afbf-480a-b3a9-4be463ebc87e req-38ba8dff-5942-4304-8f31-24b1b908e9de service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:25 user nova-compute[74311]: WARNING nova.compute.manager [req-4e0d444e-afbf-480a-b3a9-4be463ebc87e req-38ba8dff-5942-4304-8f31-24b1b908e9de service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received unexpected event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with vm_state active and task_state rescuing.
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:26:25 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:26:25 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7161f0a8-0a5c-40b2-a987-71c64fc2115b]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG os_brick.utils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:26:25 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Updating existing volume attachment record: f54d1b9e-a5d4-4578-8dac-560724e1e6dd {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:26:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-58ade957-00b8-4a9d-8dba-fad0d5cb8070 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:26:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:26 user nova-compute[74311]: DEBUG nova.network.neutron [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Successfully created port: 672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:26:26 user nova-compute[74311]: DEBUG nova.network.neutron [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Successfully updated port: 672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:26:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "refresh_cache-79b6152a-3eec-4412-a063-6e82e767a27b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:26:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquired lock "refresh_cache-79b6152a-3eec-4412-a063-6e82e767a27b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:26:26 user nova-compute[74311]: DEBUG nova.network.neutron [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:26:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-5cfcd42b-e796-43b8-9b12-ca8873febf2b req-7b0c121a-d0cb-47db-8930-c328341464ed service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received event network-changed-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-5cfcd42b-e796-43b8-9b12-ca8873febf2b req-7b0c121a-d0cb-47db-8930-c328341464ed service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Refreshing instance network info cache due to event network-changed-672b83f5-751d-4964-b6e0-32d120958173. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:26:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5cfcd42b-e796-43b8-9b12-ca8873febf2b req-7b0c121a-d0cb-47db-8930-c328341464ed service nova] Acquiring lock "refresh_cache-79b6152a-3eec-4412-a063-6e82e767a27b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:26:26 user nova-compute[74311]: DEBUG nova.network.neutron [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:26:27 user nova-compute[74311]: DEBUG nova.network.neutron [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Updating instance_info_cache with network_info: [{"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Releasing lock "refresh_cache-79b6152a-3eec-4412-a063-6e82e767a27b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:26:27 user nova-compute[74311]: DEBUG nova.compute.manager [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Instance network_info: |[{"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:26:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5cfcd42b-e796-43b8-9b12-ca8873febf2b req-7b0c121a-d0cb-47db-8930-c328341464ed service nova] Acquired lock "refresh_cache-79b6152a-3eec-4412-a063-6e82e767a27b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:26:27 user nova-compute[74311]: DEBUG nova.network.neutron [req-5cfcd42b-e796-43b8-9b12-ca8873febf2b req-7b0c121a-d0cb-47db-8930-c328341464ed service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Refreshing network info cache for port 672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:26:27 user nova-compute[74311]: DEBUG nova.network.neutron [req-5cfcd42b-e796-43b8-9b12-ca8873febf2b req-7b0c121a-d0cb-47db-8930-c328341464ed service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Updated VIF entry in instance network info cache for port 672b83f5-751d-4964-b6e0-32d120958173. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:26:27 user nova-compute[74311]: DEBUG nova.network.neutron [req-5cfcd42b-e796-43b8-9b12-ca8873febf2b req-7b0c121a-d0cb-47db-8930-c328341464ed service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Updating instance_info_cache with network_info: [{"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5cfcd42b-e796-43b8-9b12-ca8873febf2b req-7b0c121a-d0cb-47db-8930-c328341464ed service nova] Releasing lock "refresh_cache-79b6152a-3eec-4412-a063-6e82e767a27b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:26:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Starting finish_migration {{(pid=74311) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Instance directory exists: not creating {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 10:26:30 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Creating image(s)
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Ensure instance console log exists: /opt/stack/data/nova/instances/3b70780c-e968-4fce-a887-121d4b00218a/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Start _get_guest_xml network_info=[{"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1485600985-network", "vif_mac": "fa:16:3e:36:f6:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '82c8857c-d497-4b96-bafa-2ef04c2d42b5', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlIvXJBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3b70780c-e968-4fce-a887-121d4b00218a', 'attached_at': '2023-10-20T10:26:30.000000', 'detached_at': '', 'volume_id': '78d2e0a3-6f17-494b-bb62-eee5bbb10728', 'serial': '78d2e0a3-6f17-494b-bb62-eee5bbb10728'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:26:30 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:26:30 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlIvXJBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:26:30 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:26:30 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:26:30 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[229dc06f-fbb5-45e6-9f80-f5a91a1986d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:26:30 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[034b403e-b559-4fff-861f-398518aea164]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728] added
Oct 20 10:26:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[91134f2e-8ab9-41fe-9659-953a7a06b35d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9344a1ce-acb1-4370-b49d-1c6cec4f3ed9]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MlIvXJBs {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MlIvXJBs" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[344702bb-361d-4b5f-8b19-6c229501c85c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MlIvXJBs'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4b0d82-a4fd-4f28-8176-593ecf401a5c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8280ffb-01b9-4791-8fdd-e19651e41cd0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:26:30 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:26:30 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:26:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:26:30 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:26:30 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:26:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49ef5fa-7bb9-4f17-9ae8-7a9ab6c6c422]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260]
Oct 20 10:26:30 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260] successful.
Oct 20 10:26:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90f8153-c7ea-44c1-bc17-e1831b89b095]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffa2e29-c928-4ee7-aa80-8d125ee6ba54]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:26:30 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:26:30 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:26:30 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:26:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:26:30 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:26:30 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:26:30 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:26:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acda337-38bf-4d27-9b48-2db38a0b4246]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlIvXJBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23165313864306564', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165313864306564', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1216890647',display_name='tempest-ServerActionsTestOtherA-server-1216890647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1216890647',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrV3Ete25j/fWp9se4mxMWH8BlUBzypkEKDQ+cEJ4VP8hCjsvoAfM2JugNca5+qdBC1FO7G9hMianDZcBDCqTf2/GGIFqvMCvoR42Lgy+aDjy2Ay+qKFAL51raC0WY1Gw==',key_name='tempest-keypair-317846828',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:24:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-0vwgd7k7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:26:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=3b70780c-e968-4fce-a887-121d4b00218a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1485600985-network", "vif_mac": "fa:16:3e:36:f6:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1485600985-network", "vif_mac": "fa:16:3e:36:f6:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=e240d2ee-098d-4047-97e1-e81090552740,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240d2ee-09') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:26:31 user nova-compute[74311]:   <uuid>3b70780c-e968-4fce-a887-121d4b00218a</uuid>
Oct 20 10:26:31 user nova-compute[74311]:   <name>instance-0000001b</name>
Oct 20 10:26:31 user nova-compute[74311]:   <memory>2097152</memory>
Oct 20 10:26:31 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:26:31 user nova-compute[74311]:   <metadata>
Oct 20 10:26:31 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:26:31 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:26:31 user nova-compute[74311]:       <nova:name>tempest-ServerActionsTestOtherA-server-1216890647</nova:name>
Oct 20 10:26:31 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:26:30</nova:creationTime>
Oct 20 10:26:31 user nova-compute[74311]:       <nova:flavor name="m1.small">
Oct 20 10:26:31 user nova-compute[74311]:         <nova:memory>2048</nova:memory>
Oct 20 10:26:31 user nova-compute[74311]:         <nova:disk>20</nova:disk>
Oct 20 10:26:31 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:26:31 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:26:31 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:26:31 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:26:31 user nova-compute[74311]:       <nova:owner>
Oct 20 10:26:31 user nova-compute[74311]:         <nova:user uuid="5eb8db6bee87451f95e4bfdc61854bc5">tempest-ServerActionsTestOtherA-2000022938-project-member</nova:user>
Oct 20 10:26:31 user nova-compute[74311]:         <nova:project uuid="2f61456f02bc4688b8cd9d66a2b1868d">tempest-ServerActionsTestOtherA-2000022938</nova:project>
Oct 20 10:26:31 user nova-compute[74311]:       </nova:owner>
Oct 20 10:26:31 user nova-compute[74311]:       <nova:ports>
Oct 20 10:26:31 user nova-compute[74311]:         <nova:port uuid="e240d2ee-098d-4047-97e1-e81090552740">
Oct 20 10:26:31 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 10:26:31 user nova-compute[74311]:         </nova:port>
Oct 20 10:26:31 user nova-compute[74311]:       </nova:ports>
Oct 20 10:26:31 user nova-compute[74311]:     </nova:instance>
Oct 20 10:26:31 user nova-compute[74311]:   </metadata>
Oct 20 10:26:31 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:26:31 user nova-compute[74311]:     <system>
Oct 20 10:26:31 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:26:31 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:26:31 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:26:31 user nova-compute[74311]:       <entry name="serial">3b70780c-e968-4fce-a887-121d4b00218a</entry>
Oct 20 10:26:31 user nova-compute[74311]:       <entry name="uuid">3b70780c-e968-4fce-a887-121d4b00218a</entry>
Oct 20 10:26:31 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:26:31 user nova-compute[74311]:     </system>
Oct 20 10:26:31 user nova-compute[74311]:   </sysinfo>
Oct 20 10:26:31 user nova-compute[74311]:   <os>
Oct 20 10:26:31 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:26:31 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:26:31 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:26:31 user nova-compute[74311]:   </os>
Oct 20 10:26:31 user nova-compute[74311]:   <features>
Oct 20 10:26:31 user nova-compute[74311]:     <acpi/>
Oct 20 10:26:31 user nova-compute[74311]:     <apic/>
Oct 20 10:26:31 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:26:31 user nova-compute[74311]:   </features>
Oct 20 10:26:31 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:26:31 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:26:31 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:26:31 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:26:31 user nova-compute[74311]:   </clock>
Oct 20 10:26:31 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:26:31 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:26:31 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:26:31 user nova-compute[74311]:   </cpu>
Oct 20 10:26:31 user nova-compute[74311]:   <devices>
Oct 20 10:26:31 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:26:31 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:26:31 user nova-compute[74311]:       <source dev="/dev/sdb"/>
Oct 20 10:26:31 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:26:31 user nova-compute[74311]:       <serial>78d2e0a3-6f17-494b-bb62-eee5bbb10728</serial>
Oct 20 10:26:31 user nova-compute[74311]:     </disk>
Oct 20 10:26:31 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:26:31 user nova-compute[74311]:       <mac address="fa:16:3e:36:f6:51"/>
Oct 20 10:26:31 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:26:31 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:26:31 user nova-compute[74311]:       <target dev="tape240d2ee-09"/>
Oct 20 10:26:31 user nova-compute[74311]:     </interface>
Oct 20 10:26:31 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:26:31 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/3b70780c-e968-4fce-a887-121d4b00218a/console.log" append="off"/>
Oct 20 10:26:31 user nova-compute[74311]:     </serial>
Oct 20 10:26:31 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:26:31 user nova-compute[74311]:     <video>
Oct 20 10:26:31 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:26:31 user nova-compute[74311]:     </video>
Oct 20 10:26:31 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:26:31 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:26:31 user nova-compute[74311]:     </rng>
Oct 20 10:26:31 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:26:31 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:26:31 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:26:31 user nova-compute[74311]:     </memballoon>
Oct 20 10:26:31 user nova-compute[74311]:   </devices>
Oct 20 10:26:31 user nova-compute[74311]: </domain>
Oct 20 10:26:31 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1216890647',display_name='tempest-ServerActionsTestOtherA-server-1216890647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1216890647',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrV3Ete25j/fWp9se4mxMWH8BlUBzypkEKDQ+cEJ4VP8hCjsvoAfM2JugNca5+qdBC1FO7G9hMianDZcBDCqTf2/GGIFqvMCvoR42Lgy+aDjy2Ay+qKFAL51raC0WY1Gw==',key_name='tempest-keypair-317846828',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:24:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-0vwgd7k7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:26:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=3b70780c-e968-4fce-a887-121d4b00218a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1485600985-network", "vif_mac": "fa:16:3e:36:f6:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1485600985-network", "vif_mac": "fa:16:3e:36:f6:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=e240d2ee-098d-4047-97e1-e81090552740,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240d2ee-09') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG os_vif [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=e240d2ee-098d-4047-97e1-e81090552740,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240d2ee-09') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c5cb85d-38a9-5f85-8277-b852260e601a', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape240d2ee-09, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape240d2ee-09, col_values=(('qos', UUID('1f65ec3e-1ef8-4b25-9bb2-c2fcf3b4930e')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape240d2ee-09, col_values=(('external_ids', {'iface-id': 'e240d2ee-098d-4047-97e1-e81090552740', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:f6:51', 'vm-uuid': '3b70780c-e968-4fce-a887-121d4b00218a'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:31 user nova-compute[74311]: INFO os_vif [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=e240d2ee-098d-4047-97e1-e81090552740,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240d2ee-09')
Oct 20 10:26:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:26:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] No VIF found with MAC fa:16:3e:36:f6:51, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:26:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-ee0e30ef-7b74-4baa-9c0c-68fa92891cb5 req-245e3a4c-19c6-430d-92ef-4e1678feac78 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received event network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee0e30ef-7b74-4baa-9c0c-68fa92891cb5 req-245e3a4c-19c6-430d-92ef-4e1678feac78 service nova] Acquiring lock "3b70780c-e968-4fce-a887-121d4b00218a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee0e30ef-7b74-4baa-9c0c-68fa92891cb5 req-245e3a4c-19c6-430d-92ef-4e1678feac78 service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee0e30ef-7b74-4baa-9c0c-68fa92891cb5 req-245e3a4c-19c6-430d-92ef-4e1678feac78 service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-ee0e30ef-7b74-4baa-9c0c-68fa92891cb5 req-245e3a4c-19c6-430d-92ef-4e1678feac78 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] No waiting events found dispatching network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:34 user nova-compute[74311]: WARNING nova.compute.manager [req-ee0e30ef-7b74-4baa-9c0c-68fa92891cb5 req-245e3a4c-19c6-430d-92ef-4e1678feac78 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received unexpected event network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 for instance with vm_state active and task_state resize_finish.
Oct 20 10:26:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:34 user nova-compute[74311]: DEBUG nova.compute.manager [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:26:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:34 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:26:34 user nova-compute[74311]: INFO nova.compute.claims [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Claim successful on node user
Oct 20 10:26:35 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:26:35 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:26:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.726s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:35 user nova-compute[74311]: DEBUG nova.compute.manager [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:26:35 user nova-compute[74311]: DEBUG nova.compute.manager [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:26:35 user nova-compute[74311]: DEBUG nova.network.neutron [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:26:35 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:26:35 user nova-compute[74311]: DEBUG nova.compute.manager [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:26:35 user nova-compute[74311]: DEBUG nova.policy [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '302a265253b14a19be48546953baaebf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b7c2a684a3466eba4799473c725066', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:26:35 user nova-compute[74311]: DEBUG nova.compute.manager [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:26:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:26:35 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Creating image(s)
Oct 20 10:26:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "/opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "/opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:26:36 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Instance running successfully.
Oct 20 10:26:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Failed to set time: agent not configured {{(pid=74311) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b4b13af9-3162-4fb2-b68c-88e0b5069364 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] finish_migration finished successfully. {{(pid=74311) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG nova.compute.manager [req-300ac371-8f6c-4492-9a46-c3f0b59ac10e req-9ecfdf8b-68d8-4da2-a6b1-d99ddf30512c service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received event network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-300ac371-8f6c-4492-9a46-c3f0b59ac10e req-9ecfdf8b-68d8-4da2-a6b1-d99ddf30512c service nova] Acquiring lock "3b70780c-e968-4fce-a887-121d4b00218a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-300ac371-8f6c-4492-9a46-c3f0b59ac10e req-9ecfdf8b-68d8-4da2-a6b1-d99ddf30512c service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-300ac371-8f6c-4492-9a46-c3f0b59ac10e req-9ecfdf8b-68d8-4da2-a6b1-d99ddf30512c service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG nova.compute.manager [req-300ac371-8f6c-4492-9a46-c3f0b59ac10e req-9ecfdf8b-68d8-4da2-a6b1-d99ddf30512c service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] No waiting events found dispatching network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:36 user nova-compute[74311]: WARNING nova.compute.manager [req-300ac371-8f6c-4492-9a46-c3f0b59ac10e req-9ecfdf8b-68d8-4da2-a6b1-d99ddf30512c service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received unexpected event network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 for instance with vm_state active and task_state resize_finish.
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.208s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk 1073741824" returned: 0 in 0.070s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.246s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG nova.network.neutron [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Successfully created port: 3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Cannot resize image /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Ensure instance console log exists: /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.network.neutron [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Successfully updated port: 3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.compute.manager [req-56bee03a-fcd9-4279-b82f-1392d73bfea3 req-a2cfcc63-ebdc-46d1-a613-dfde0d2045a5 service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Received event network-changed-5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.compute.manager [req-56bee03a-fcd9-4279-b82f-1392d73bfea3 req-a2cfcc63-ebdc-46d1-a613-dfde0d2045a5 service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Refreshing instance network info cache due to event network-changed-5bbc3284-3b73-488c-9ee7-5ccedff081a6. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-56bee03a-fcd9-4279-b82f-1392d73bfea3 req-a2cfcc63-ebdc-46d1-a613-dfde0d2045a5 service nova] Acquiring lock "refresh_cache-141ba46f-2fab-46db-8512-862aeef49ac8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-56bee03a-fcd9-4279-b82f-1392d73bfea3 req-a2cfcc63-ebdc-46d1-a613-dfde0d2045a5 service nova] Acquired lock "refresh_cache-141ba46f-2fab-46db-8512-862aeef49ac8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.network.neutron [req-56bee03a-fcd9-4279-b82f-1392d73bfea3 req-a2cfcc63-ebdc-46d1-a613-dfde0d2045a5 service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Refreshing network info cache for port 5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquired lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.network.neutron [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.network.neutron [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.network.neutron [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updating instance_info_cache with network_info: [{"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Releasing lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Instance network_info: |[{"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Start _get_guest_xml network_info=[{"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:26:38 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:26:38 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1295854338',display_name='tempest-ServerRescueNegativeTestJSON-server-1295854338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1295854338',id=32,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyu5kH6h3CMySukZ4xYw3WRv8PPFiosuSGC1QUW+H0JC2aBbjS8QlGQc+KOukJmdnZqV8LAzxGqK3l3vxdKR4Exoa6KSvU7gjrjaAd92zAtyVLhJNetUMdmWcoXhIfgjA==',key_name='tempest-keypair-793510087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07b7c2a684a3466eba4799473c725066',ramdisk_id='',reservation_id='r-7gmb5360',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-320006607',owner_user_name='tempest-ServerRescueNegativeTestJSON-320006607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:26:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302a265253b14a19be48546953baaebf',uuid=ce052ea1-5937-43d6-9ff9-694ff15b7f3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converting VIF {"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=3e3e5d7a-8868-4b3f-b874-62faba374f3b,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3e5d7a-88') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.objects.instance [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'pci_devices' on Instance uuid ce052ea1-5937-43d6-9ff9-694ff15b7f3e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:26:38 user nova-compute[74311]:   <uuid>ce052ea1-5937-43d6-9ff9-694ff15b7f3e</uuid>
Oct 20 10:26:38 user nova-compute[74311]:   <name>instance-00000020</name>
Oct 20 10:26:38 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:26:38 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:26:38 user nova-compute[74311]:   <metadata>
Oct 20 10:26:38 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:26:38 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:26:38 user nova-compute[74311]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1295854338</nova:name>
Oct 20 10:26:38 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:26:38</nova:creationTime>
Oct 20 10:26:38 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:26:38 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:26:38 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:26:38 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:26:38 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:26:38 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:26:38 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:26:38 user nova-compute[74311]:       <nova:owner>
Oct 20 10:26:38 user nova-compute[74311]:         <nova:user uuid="302a265253b14a19be48546953baaebf">tempest-ServerRescueNegativeTestJSON-320006607-project-member</nova:user>
Oct 20 10:26:38 user nova-compute[74311]:         <nova:project uuid="07b7c2a684a3466eba4799473c725066">tempest-ServerRescueNegativeTestJSON-320006607</nova:project>
Oct 20 10:26:38 user nova-compute[74311]:       </nova:owner>
Oct 20 10:26:38 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:26:38 user nova-compute[74311]:       <nova:ports>
Oct 20 10:26:38 user nova-compute[74311]:         <nova:port uuid="3e3e5d7a-8868-4b3f-b874-62faba374f3b">
Oct 20 10:26:38 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 10:26:38 user nova-compute[74311]:         </nova:port>
Oct 20 10:26:38 user nova-compute[74311]:       </nova:ports>
Oct 20 10:26:38 user nova-compute[74311]:     </nova:instance>
Oct 20 10:26:38 user nova-compute[74311]:   </metadata>
Oct 20 10:26:38 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:26:38 user nova-compute[74311]:     <system>
Oct 20 10:26:38 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:26:38 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:26:38 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:26:38 user nova-compute[74311]:       <entry name="serial">ce052ea1-5937-43d6-9ff9-694ff15b7f3e</entry>
Oct 20 10:26:38 user nova-compute[74311]:       <entry name="uuid">ce052ea1-5937-43d6-9ff9-694ff15b7f3e</entry>
Oct 20 10:26:38 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:26:38 user nova-compute[74311]:     </system>
Oct 20 10:26:38 user nova-compute[74311]:   </sysinfo>
Oct 20 10:26:38 user nova-compute[74311]:   <os>
Oct 20 10:26:38 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:26:38 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:26:38 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:26:38 user nova-compute[74311]:   </os>
Oct 20 10:26:38 user nova-compute[74311]:   <features>
Oct 20 10:26:38 user nova-compute[74311]:     <acpi/>
Oct 20 10:26:38 user nova-compute[74311]:     <apic/>
Oct 20 10:26:38 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:26:38 user nova-compute[74311]:   </features>
Oct 20 10:26:38 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:26:38 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:26:38 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:26:38 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:26:38 user nova-compute[74311]:   </clock>
Oct 20 10:26:38 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:26:38 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:26:38 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:26:38 user nova-compute[74311]:   </cpu>
Oct 20 10:26:38 user nova-compute[74311]:   <devices>
Oct 20 10:26:38 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:26:38 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:26:38 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk"/>
Oct 20 10:26:38 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:26:38 user nova-compute[74311]:     </disk>
Oct 20 10:26:38 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:26:38 user nova-compute[74311]:       <mac address="fa:16:3e:ce:fd:01"/>
Oct 20 10:26:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:26:38 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:26:38 user nova-compute[74311]:       <target dev="tap3e3e5d7a-88"/>
Oct 20 10:26:38 user nova-compute[74311]:     </interface>
Oct 20 10:26:38 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:26:38 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/console.log" append="off"/>
Oct 20 10:26:38 user nova-compute[74311]:     </serial>
Oct 20 10:26:38 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:26:38 user nova-compute[74311]:     <video>
Oct 20 10:26:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:26:38 user nova-compute[74311]:     </video>
Oct 20 10:26:38 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:26:38 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:26:38 user nova-compute[74311]:     </rng>
Oct 20 10:26:38 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:26:38 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:26:38 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:26:38 user nova-compute[74311]:     </memballoon>
Oct 20 10:26:38 user nova-compute[74311]:   </devices>
Oct 20 10:26:38 user nova-compute[74311]: </domain>
Oct 20 10:26:38 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1295854338',display_name='tempest-ServerRescueNegativeTestJSON-server-1295854338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1295854338',id=32,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyu5kH6h3CMySukZ4xYw3WRv8PPFiosuSGC1QUW+H0JC2aBbjS8QlGQc+KOukJmdnZqV8LAzxGqK3l3vxdKR4Exoa6KSvU7gjrjaAd92zAtyVLhJNetUMdmWcoXhIfgjA==',key_name='tempest-keypair-793510087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07b7c2a684a3466eba4799473c725066',ramdisk_id='',reservation_id='r-7gmb5360',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-320006607',owner_user_name='tempest-ServerRescueNegativeTestJSON-320006607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:26:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302a265253b14a19be48546953baaebf',uuid=ce052ea1-5937-43d6-9ff9-694ff15b7f3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converting VIF {"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=3e3e5d7a-8868-4b3f-b874-62faba374f3b,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3e5d7a-88') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG os_vif [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=3e3e5d7a-8868-4b3f-b874-62faba374f3b,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3e5d7a-88') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a83a8e6e-3736-52fa-84db-c87b4fba4640', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e3e5d7a-88, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e3e5d7a-88, col_values=(('qos', UUID('4bef9c3d-14d7-4336-90be-bb9827ae12c7')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e3e5d7a-88, col_values=(('external_ids', {'iface-id': '3e3e5d7a-8868-4b3f-b874-62faba374f3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:fd:01', 'vm-uuid': 'ce052ea1-5937-43d6-9ff9-694ff15b7f3e'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:26:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:38 user nova-compute[74311]: INFO os_vif [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=3e3e5d7a-8868-4b3f-b874-62faba374f3b,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3e5d7a-88')
Oct 20 10:26:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:26:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No VIF found with MAC fa:16:3e:ce:fd:01, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:26:39 user nova-compute[74311]: DEBUG nova.network.neutron [req-56bee03a-fcd9-4279-b82f-1392d73bfea3 req-a2cfcc63-ebdc-46d1-a613-dfde0d2045a5 service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Updated VIF entry in instance network info cache for port 5bbc3284-3b73-488c-9ee7-5ccedff081a6. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:26:39 user nova-compute[74311]: DEBUG nova.network.neutron [req-56bee03a-fcd9-4279-b82f-1392d73bfea3 req-a2cfcc63-ebdc-46d1-a613-dfde0d2045a5 service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Updating instance_info_cache with network_info: [{"id": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "address": "fa:16:3e:de:c2:db", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bbc3284-3b", "ovs_interfaceid": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-56bee03a-fcd9-4279-b82f-1392d73bfea3 req-a2cfcc63-ebdc-46d1-a613-dfde0d2045a5 service nova] Releasing lock "refresh_cache-141ba46f-2fab-46db-8512-862aeef49ac8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:26:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "141ba46f-2fab-46db-8512-862aeef49ac8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "141ba46f-2fab-46db-8512-862aeef49ac8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:39 user nova-compute[74311]: INFO nova.compute.manager [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Terminating instance
Oct 20 10:26:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-8312bd8a-9383-48f4-bcc4-29a31cb2120c req-272a20fe-5b10-4b91-a8ce-2908c5fe5e23 service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Received event network-vif-unplugged-5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8312bd8a-9383-48f4-bcc4-29a31cb2120c req-272a20fe-5b10-4b91-a8ce-2908c5fe5e23 service nova] Acquiring lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8312bd8a-9383-48f4-bcc4-29a31cb2120c req-272a20fe-5b10-4b91-a8ce-2908c5fe5e23 service nova] Lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8312bd8a-9383-48f4-bcc4-29a31cb2120c req-272a20fe-5b10-4b91-a8ce-2908c5fe5e23 service nova] Lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-8312bd8a-9383-48f4-bcc4-29a31cb2120c req-272a20fe-5b10-4b91-a8ce-2908c5fe5e23 service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] No waiting events found dispatching network-vif-unplugged-5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-8312bd8a-9383-48f4-bcc4-29a31cb2120c req-272a20fe-5b10-4b91-a8ce-2908c5fe5e23 service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Received event network-vif-unplugged-5bbc3284-3b73-488c-9ee7-5ccedff081a6 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-39650f8c-e069-4c80-a52d-c28acfafd900 req-39fb0796-b6e8-4d7a-80d8-a65a6961f400 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-changed-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-39650f8c-e069-4c80-a52d-c28acfafd900 req-39fb0796-b6e8-4d7a-80d8-a65a6961f400 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Refreshing instance network info cache due to event network-changed-3e3e5d7a-8868-4b3f-b874-62faba374f3b. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39650f8c-e069-4c80-a52d-c28acfafd900 req-39fb0796-b6e8-4d7a-80d8-a65a6961f400 service nova] Acquiring lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39650f8c-e069-4c80-a52d-c28acfafd900 req-39fb0796-b6e8-4d7a-80d8-a65a6961f400 service nova] Acquired lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG nova.network.neutron [req-39650f8c-e069-4c80-a52d-c28acfafd900 req-39fb0796-b6e8-4d7a-80d8-a65a6961f400 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Refreshing network info cache for port 3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG nova.network.neutron [req-39650f8c-e069-4c80-a52d-c28acfafd900 req-39fb0796-b6e8-4d7a-80d8-a65a6961f400 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updated VIF entry in instance network info cache for port 3e3e5d7a-8868-4b3f-b874-62faba374f3b. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG nova.network.neutron [req-39650f8c-e069-4c80-a52d-c28acfafd900 req-39fb0796-b6e8-4d7a-80d8-a65a6961f400 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updating instance_info_cache with network_info: [{"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-39650f8c-e069-4c80-a52d-c28acfafd900 req-39fb0796-b6e8-4d7a-80d8-a65a6961f400 service nova] Releasing lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-6550c246-3e9b-4e42-988c-03724f6a6cd4 req-490d4089-6918-4903-a57d-1d85b49c4a9e service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6550c246-3e9b-4e42-988c-03724f6a6cd4 req-490d4089-6918-4903-a57d-1d85b49c4a9e service nova] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6550c246-3e9b-4e42-988c-03724f6a6cd4 req-490d4089-6918-4903-a57d-1d85b49c4a9e service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6550c246-3e9b-4e42-988c-03724f6a6cd4 req-490d4089-6918-4903-a57d-1d85b49c4a9e service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-6550c246-3e9b-4e42-988c-03724f6a6cd4 req-490d4089-6918-4903-a57d-1d85b49c4a9e service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] No waiting events found dispatching network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:41 user nova-compute[74311]: WARNING nova.compute.manager [req-6550c246-3e9b-4e42-988c-03724f6a6cd4 req-490d4089-6918-4903-a57d-1d85b49c4a9e service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received unexpected event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b for instance with vm_state building and task_state spawning.
Oct 20 10:26:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:41 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Instance destroyed successfully.
Oct 20 10:26:41 user nova-compute[74311]: DEBUG nova.objects.instance [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'resources' on Instance uuid 141ba46f-2fab-46db-8512-862aeef49ac8 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-363424740',display_name='tempest-AttachVolumeNegativeTest-server-363424740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-363424740',id=29,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7Pvn1qB7hcB8m+FjRWDzJumGJLqeQ9LAJYTkAGedXHuze3eVREBaoBDguNvNJzjp8J+i1VaiJECU2VB6Mc/bI7WHFQm5zfu8H4K9bPL3CSZwDHmYQRKHXWIn35Mr0l7w==',key_name='tempest-keypair-478552146',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:24:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e99de7cef4b4569a497f77325515680',ramdisk_id='',reservation_id='r-j8tvo7xz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-543930091',owner_user_name='tempest-AttachVolumeNegativeTest-543930091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:24:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497267775cc747b8b65b8bcb276806ba',uuid=141ba46f-2fab-46db-8512-862aeef49ac8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "address": "fa:16:3e:de:c2:db", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bbc3284-3b", "ovs_interfaceid": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converting VIF {"id": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "address": "fa:16:3e:de:c2:db", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bbc3284-3b", "ovs_interfaceid": "5bbc3284-3b73-488c-9ee7-5ccedff081a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:c2:db,bridge_name='br-int',has_traffic_filtering=True,id=5bbc3284-3b73-488c-9ee7-5ccedff081a6,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bbc3284-3b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG os_vif [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:c2:db,bridge_name='br-int',has_traffic_filtering=True,id=5bbc3284-3b73-488c-9ee7-5ccedff081a6,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bbc3284-3b') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bbc3284-3b, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dda0e9cd-d0d6-42ad-af05-38cda92a8195) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:26:41 user nova-compute[74311]: INFO os_vif [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:c2:db,bridge_name='br-int',has_traffic_filtering=True,id=5bbc3284-3b73-488c-9ee7-5ccedff081a6,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bbc3284-3b')
Oct 20 10:26:41 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Deleting instance files /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8_del
Oct 20 10:26:41 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Deletion of /opt/stack/data/nova/instances/141ba46f-2fab-46db-8512-862aeef49ac8_del complete
Oct 20 10:26:41 user nova-compute[74311]: INFO nova.compute.manager [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Took 1.70 seconds to destroy the instance on the hypervisor.
Oct 20 10:26:41 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:26:41 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:26:42 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:42 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Took 0.81 seconds to deallocate network for instance.
Oct 20 10:26:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-e114dbfa-4597-4fa0-8ac7-ee6381ed3282 req-e4c04b4f-1e49-4f98-95c9-b6eefd64264e service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Received event network-vif-plugged-5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e114dbfa-4597-4fa0-8ac7-ee6381ed3282 req-e4c04b4f-1e49-4f98-95c9-b6eefd64264e service nova] Acquiring lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e114dbfa-4597-4fa0-8ac7-ee6381ed3282 req-e4c04b4f-1e49-4f98-95c9-b6eefd64264e service nova] Lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e114dbfa-4597-4fa0-8ac7-ee6381ed3282 req-e4c04b4f-1e49-4f98-95c9-b6eefd64264e service nova] Lock "141ba46f-2fab-46db-8512-862aeef49ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-e114dbfa-4597-4fa0-8ac7-ee6381ed3282 req-e4c04b4f-1e49-4f98-95c9-b6eefd64264e service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] No waiting events found dispatching network-vif-plugged-5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:42 user nova-compute[74311]: WARNING nova.compute.manager [req-e114dbfa-4597-4fa0-8ac7-ee6381ed3282 req-e4c04b4f-1e49-4f98-95c9-b6eefd64264e service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Received unexpected event network-vif-plugged-5bbc3284-3b73-488c-9ee7-5ccedff081a6 for instance with vm_state active and task_state deleting.
Oct 20 10:26:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-e114dbfa-4597-4fa0-8ac7-ee6381ed3282 req-e4c04b4f-1e49-4f98-95c9-b6eefd64264e service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Received event network-vif-deleted-5bbc3284-3b73-488c-9ee7-5ccedff081a6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:42 user nova-compute[74311]: INFO nova.compute.manager [req-e114dbfa-4597-4fa0-8ac7-ee6381ed3282 req-e4c04b4f-1e49-4f98-95c9-b6eefd64264e service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Neutron deleted interface 5bbc3284-3b73-488c-9ee7-5ccedff081a6; detaching it from the instance and deleting it from the info cache
Oct 20 10:26:42 user nova-compute[74311]: DEBUG nova.network.neutron [req-e114dbfa-4597-4fa0-8ac7-ee6381ed3282 req-e4c04b4f-1e49-4f98-95c9-b6eefd64264e service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:26:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-e114dbfa-4597-4fa0-8ac7-ee6381ed3282 req-e4c04b4f-1e49-4f98-95c9-b6eefd64264e service nova] [instance: 141ba46f-2fab-46db-8512-862aeef49ac8] Detach interface failed, port_id=5bbc3284-3b73-488c-9ee7-5ccedff081a6, reason: Instance 141ba46f-2fab-46db-8512-862aeef49ac8 could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:26:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.652s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-c8d05107-8773-4b7c-b4ec-67ef5efb48d3 req-8b6f4b29-0633-4b40-bb6a-b426822c98b5 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c8d05107-8773-4b7c-b4ec-67ef5efb48d3 req-8b6f4b29-0633-4b40-bb6a-b426822c98b5 service nova] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c8d05107-8773-4b7c-b4ec-67ef5efb48d3 req-8b6f4b29-0633-4b40-bb6a-b426822c98b5 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c8d05107-8773-4b7c-b4ec-67ef5efb48d3 req-8b6f4b29-0633-4b40-bb6a-b426822c98b5 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-c8d05107-8773-4b7c-b4ec-67ef5efb48d3 req-8b6f4b29-0633-4b40-bb6a-b426822c98b5 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] No waiting events found dispatching network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:43 user nova-compute[74311]: WARNING nova.compute.manager [req-c8d05107-8773-4b7c-b4ec-67ef5efb48d3 req-8b6f4b29-0633-4b40-bb6a-b426822c98b5 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received unexpected event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b for instance with vm_state building and task_state spawning.
Oct 20 10:26:43 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Deleted allocations for instance 141ba46f-2fab-46db-8512-862aeef49ac8
Oct 20 10:26:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b2e54b6b-6d10-40a5-bfd4-f12f516fc08f tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "141ba46f-2fab-46db-8512-862aeef49ac8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.416s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG nova.compute.manager [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:26:43 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Instance spawned successfully.
Oct 20 10:26:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:43 user nova-compute[74311]: INFO nova.compute.manager [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Took 7.81 seconds to spawn the instance on the hypervisor.
Oct 20 10:26:43 user nova-compute[74311]: DEBUG nova.compute.manager [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:26:43 user nova-compute[74311]: INFO nova.compute.manager [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Took 8.95 seconds to build instance.
Oct 20 10:26:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-84702c5f-e391-494c-9395-2fc6b4847378 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.067s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.compute.manager [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:26:46 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Creating image(s)
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Ensure instance console log exists: /opt/stack/data/nova/instances/79b6152a-3eec-4412-a063-6e82e767a27b/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Start _get_guest_xml network_info=[{"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'f54d1b9e-a5d4-4578-8dac-560724e1e6dd', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGnQdEte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '79b6152a-3eec-4412-a063-6e82e767a27b', 'attached_at': '', 'detached_at': '', 'volume_id': '9d865eed-f501-4a9b-a4f2-8fd737339548', 'serial': '9d865eed-f501-4a9b-a4f2-8fd737339548'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:26:46 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:26:46 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGnQdEte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:26:46 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:26:46 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:26:46 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[754be6f7-f335-4fed-90c8-91fb02d52e14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:26:46 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[799381d3-9ae2-4932-82d7-84ec90eb3eae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548] added
Oct 20 10:26:46 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f581ed-c876-427b-9457-9e56054842ca]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b886956c-6148-4510-8953-72437020705d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGnQdEte {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGnQdEte" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3066355-b3e6-46ef-8e4e-653c5d720824]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NGnQdEte'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[466261d2-45b2-4f29-823e-694a5c84bad2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd3a5eb-4ba6-4680-9061-55ed721f55c3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:26:46 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:26:46 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:26:46 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:26:46 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:26:46 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:26:46 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:26:46 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:26:46 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6b4f9c-e259-425d-8405-d9c3a727ab86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260]
Oct 20 10:26:46 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260] successful.
Oct 20 10:26:46 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaf19b6-3589-42d6-a646-71565dc6cee6]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8747dc51-419f-4819-8ad7-af63434a7305]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:26:46 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:26:46 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:26:46 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:26:46 user nova-compute[74311]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:26:46 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:26:46 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:26:46 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:26:46 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:26:46 user nova-compute[74311]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:26:46 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17ccbd1-1077-4717-9c64-bae8b7008f05]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:26:46 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGnQdEte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23337336535373764', 'path': '/dev/sde'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337336535373764', 'path': '/dev/sde'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1993782106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1993782106',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzWhCvMVV6Y1XH/5Ox4S/1XTdcuZMP+vIAuIbp6IPW5DjnB21INUyKyNNxDYjm1qgk+5N7ar0+Y70BR6OMQrtuOTQnI1wGTcSxNpOQfz4xGTk69kpB66KvLuwztnTuwZg==',key_name='tempest-keypair-431497461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9820bd4a09494eaf858e88301f6c5827',ramdisk_id='',reservation_id='r-81m98auw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-804114643',owner_user_name='tempest-ServerActionsV293TestJSON-804114643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:26:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0134a62628fe4dd29bfd61a987d099d3',uuid=79b6152a-3eec-4412-a063-6e82e767a27b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Converting VIF {"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:fe:ae,bridge_name='br-int',has_traffic_filtering=True,id=672b83f5-751d-4964-b6e0-32d120958173,network=Network(630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap672b83f5-75') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG nova.objects.instance [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lazy-loading 'pci_devices' on Instance uuid 79b6152a-3eec-4412-a063-6e82e767a27b {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:26:47 user nova-compute[74311]:   <uuid>79b6152a-3eec-4412-a063-6e82e767a27b</uuid>
Oct 20 10:26:47 user nova-compute[74311]:   <name>instance-0000001f</name>
Oct 20 10:26:47 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:26:47 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:26:47 user nova-compute[74311]:   <metadata>
Oct 20 10:26:47 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:26:47 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:26:47 user nova-compute[74311]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1993782106</nova:name>
Oct 20 10:26:47 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:26:46</nova:creationTime>
Oct 20 10:26:47 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:26:47 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:26:47 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:26:47 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:26:47 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:26:47 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:26:47 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:26:47 user nova-compute[74311]:       <nova:owner>
Oct 20 10:26:47 user nova-compute[74311]:         <nova:user uuid="0134a62628fe4dd29bfd61a987d099d3">tempest-ServerActionsV293TestJSON-804114643-project-member</nova:user>
Oct 20 10:26:47 user nova-compute[74311]:         <nova:project uuid="9820bd4a09494eaf858e88301f6c5827">tempest-ServerActionsV293TestJSON-804114643</nova:project>
Oct 20 10:26:47 user nova-compute[74311]:       </nova:owner>
Oct 20 10:26:47 user nova-compute[74311]:       <nova:ports>
Oct 20 10:26:47 user nova-compute[74311]:         <nova:port uuid="672b83f5-751d-4964-b6e0-32d120958173">
Oct 20 10:26:47 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 10:26:47 user nova-compute[74311]:         </nova:port>
Oct 20 10:26:47 user nova-compute[74311]:       </nova:ports>
Oct 20 10:26:47 user nova-compute[74311]:     </nova:instance>
Oct 20 10:26:47 user nova-compute[74311]:   </metadata>
Oct 20 10:26:47 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:26:47 user nova-compute[74311]:     <system>
Oct 20 10:26:47 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:26:47 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:26:47 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:26:47 user nova-compute[74311]:       <entry name="serial">79b6152a-3eec-4412-a063-6e82e767a27b</entry>
Oct 20 10:26:47 user nova-compute[74311]:       <entry name="uuid">79b6152a-3eec-4412-a063-6e82e767a27b</entry>
Oct 20 10:26:47 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:26:47 user nova-compute[74311]:     </system>
Oct 20 10:26:47 user nova-compute[74311]:   </sysinfo>
Oct 20 10:26:47 user nova-compute[74311]:   <os>
Oct 20 10:26:47 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:26:47 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:26:47 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:26:47 user nova-compute[74311]:   </os>
Oct 20 10:26:47 user nova-compute[74311]:   <features>
Oct 20 10:26:47 user nova-compute[74311]:     <acpi/>
Oct 20 10:26:47 user nova-compute[74311]:     <apic/>
Oct 20 10:26:47 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:26:47 user nova-compute[74311]:   </features>
Oct 20 10:26:47 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:26:47 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:26:47 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:26:47 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:26:47 user nova-compute[74311]:   </clock>
Oct 20 10:26:47 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:26:47 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:26:47 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:26:47 user nova-compute[74311]:   </cpu>
Oct 20 10:26:47 user nova-compute[74311]:   <devices>
Oct 20 10:26:47 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:26:47 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:26:47 user nova-compute[74311]:       <source dev="/dev/sde"/>
Oct 20 10:26:47 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:26:47 user nova-compute[74311]:       <serial>9d865eed-f501-4a9b-a4f2-8fd737339548</serial>
Oct 20 10:26:47 user nova-compute[74311]:     </disk>
Oct 20 10:26:47 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:26:47 user nova-compute[74311]:       <mac address="fa:16:3e:cc:fe:ae"/>
Oct 20 10:26:47 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:26:47 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:26:47 user nova-compute[74311]:       <target dev="tap672b83f5-75"/>
Oct 20 10:26:47 user nova-compute[74311]:     </interface>
Oct 20 10:26:47 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:26:47 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/79b6152a-3eec-4412-a063-6e82e767a27b/console.log" append="off"/>
Oct 20 10:26:47 user nova-compute[74311]:     </serial>
Oct 20 10:26:47 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:26:47 user nova-compute[74311]:     <video>
Oct 20 10:26:47 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:26:47 user nova-compute[74311]:     </video>
Oct 20 10:26:47 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:26:47 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:26:47 user nova-compute[74311]:     </rng>
Oct 20 10:26:47 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:26:47 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:26:47 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:26:47 user nova-compute[74311]:     </memballoon>
Oct 20 10:26:47 user nova-compute[74311]:   </devices>
Oct 20 10:26:47 user nova-compute[74311]: </domain>
Oct 20 10:26:47 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1993782106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1993782106',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzWhCvMVV6Y1XH/5Ox4S/1XTdcuZMP+vIAuIbp6IPW5DjnB21INUyKyNNxDYjm1qgk+5N7ar0+Y70BR6OMQrtuOTQnI1wGTcSxNpOQfz4xGTk69kpB66KvLuwztnTuwZg==',key_name='tempest-keypair-431497461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9820bd4a09494eaf858e88301f6c5827',ramdisk_id='',reservation_id='r-81m98auw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-804114643',owner_user_name='tempest-ServerActionsV293TestJSON-804114643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:26:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0134a62628fe4dd29bfd61a987d099d3',uuid=79b6152a-3eec-4412-a063-6e82e767a27b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Converting VIF {"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:fe:ae,bridge_name='br-int',has_traffic_filtering=True,id=672b83f5-751d-4964-b6e0-32d120958173,network=Network(630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap672b83f5-75') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG os_vif [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:fe:ae,bridge_name='br-int',has_traffic_filtering=True,id=672b83f5-751d-4964-b6e0-32d120958173,network=Network(630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap672b83f5-75') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6ea7100-db44-5751-b617-00776e332ad4', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap672b83f5-75, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap672b83f5-75, col_values=(('qos', UUID('367bb98d-1291-41e9-b54f-7eae53b504e7')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap672b83f5-75, col_values=(('external_ids', {'iface-id': '672b83f5-751d-4964-b6e0-32d120958173', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:fe:ae', 'vm-uuid': '79b6152a-3eec-4412-a063-6e82e767a27b'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:47 user nova-compute[74311]: INFO os_vif [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:fe:ae,bridge_name='br-int',has_traffic_filtering=True,id=672b83f5-751d-4964-b6e0-32d120958173,network=Network(630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap672b83f5-75')
Oct 20 10:26:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:26:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] No VIF found with MAC fa:16:3e:cc:fe:ae, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:26:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:49 user nova-compute[74311]: DEBUG nova.compute.manager [req-4f67aeb9-72a8-468a-ad15-f0ef814f0511 req-12be19dd-d7f1-4ac8-9472-54b956c29984 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received event network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4f67aeb9-72a8-468a-ad15-f0ef814f0511 req-12be19dd-d7f1-4ac8-9472-54b956c29984 service nova] Acquiring lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4f67aeb9-72a8-468a-ad15-f0ef814f0511 req-12be19dd-d7f1-4ac8-9472-54b956c29984 service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4f67aeb9-72a8-468a-ad15-f0ef814f0511 req-12be19dd-d7f1-4ac8-9472-54b956c29984 service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:49 user nova-compute[74311]: DEBUG nova.compute.manager [req-4f67aeb9-72a8-468a-ad15-f0ef814f0511 req-12be19dd-d7f1-4ac8-9472-54b956c29984 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] No waiting events found dispatching network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:49 user nova-compute[74311]: WARNING nova.compute.manager [req-4f67aeb9-72a8-468a-ad15-f0ef814f0511 req-12be19dd-d7f1-4ac8-9472-54b956c29984 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received unexpected event network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 for instance with vm_state building and task_state spawning.
Oct 20 10:26:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:26:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:26:51 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Instance spawned successfully.
Oct 20 10:26:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:26:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-654e3288-c023-4eca-abd8-bbbc8784e272 req-292089c9-25a4-44ff-8903-bcc56630da59 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received event network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:26:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-654e3288-c023-4eca-abd8-bbbc8784e272 req-292089c9-25a4-44ff-8903-bcc56630da59 service nova] Acquiring lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:26:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-654e3288-c023-4eca-abd8-bbbc8784e272 req-292089c9-25a4-44ff-8903-bcc56630da59 service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:26:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-654e3288-c023-4eca-abd8-bbbc8784e272 req-292089c9-25a4-44ff-8903-bcc56630da59 service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-654e3288-c023-4eca-abd8-bbbc8784e272 req-292089c9-25a4-44ff-8903-bcc56630da59 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] No waiting events found dispatching network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:26:51 user nova-compute[74311]: WARNING nova.compute.manager [req-654e3288-c023-4eca-abd8-bbbc8784e272 req-292089c9-25a4-44ff-8903-bcc56630da59 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received unexpected event network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 for instance with vm_state building and task_state spawning.
Oct 20 10:26:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:26:51 user nova-compute[74311]: INFO nova.compute.manager [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Took 5.52 seconds to spawn the instance on the hypervisor.
Oct 20 10:26:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:26:51 user nova-compute[74311]: INFO nova.compute.manager [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Took 26.96 seconds to build instance.
Oct 20 10:26:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-86ddaf17-6278-4bd3-adc4-a68e078e117e tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "79b6152a-3eec-4412-a063-6e82e767a27b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.103s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:26:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:26:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:02 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:27:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:27:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Didn't find any instances for network info cache update. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 10:27:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:07 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:27:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:08 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:27:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:09 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:27:10 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:27:10 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:27:11 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:27:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:12 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:27:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:12 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:27:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:27:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:27:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:27:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:27:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:27:17 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:27:17 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=6943MB free_disk=24.996376037597656GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Applying migration context for instance 3b70780c-e968-4fce-a887-121d4b00218a as it has an incoming, in-progress migration df3bfebc-7cf4-4b6e-a10b-c2a25cb67c06. Migration status is finished {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 10:27:17 user nova-compute[74311]: INFO nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Updating resource usage from migration df3bfebc-7cf4-4b6e-a10b-c2a25cb67c06
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 6a964d89-1f48-405b-bf64-31b9eef9ece3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 922b36b5-0575-4717-a876-dda27469ebb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfb50bd6-42e6-4f8a-af8c-712e52644cb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 730bd2ce-cb53-411a-8b74-dafba0d5e2bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Migration df3bfebc-7cf4-4b6e-a10b-c2a25cb67c06 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 3b70780c-e968-4fce-a887-121d4b00218a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance acd91e17-e847-403f-84f4-8ab962ff06db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 79b6152a-3eec-4412-a063-6e82e767a27b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.674s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:18 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:27:18 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:27:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:29 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:27:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:29 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:27:29 user nova-compute[74311]: INFO nova.compute.claims [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Claim successful on node user
Oct 20 10:27:30 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:27:30 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:27:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG nova.policy [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b695ede156f4dd7b3e20e23b09b8afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c01bcaa34104f29ab8566e793779055', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:27:30 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Creating image(s)
Oct 20 10:27:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "/opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "/opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "/opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.182s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk 1073741824" returned: 0 in 0.062s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.206s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Successfully created port: 378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Cannot resize image /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Ensure instance console log exists: /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:31 user nova-compute[74311]: INFO nova.compute.manager [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Detaching volume e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36
Oct 20 10:27:31 user nova-compute[74311]: INFO nova.virt.block_device [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Attempting to driver detach volume e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 from mountpoint /dev/vdb
Oct 20 10:27:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Attempting to detach device vdb from instance cfb50bd6-42e6-4f8a-af8c-712e52644cb5 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:27:31 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:27:31 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:27:31 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:27:31 user nova-compute[74311]:   <serial>e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36</serial>
Oct 20 10:27:31 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:27:31 user nova-compute[74311]: </disk>
Oct 20 10:27:31 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:27:31 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Successfully detached device vdb from instance cfb50bd6-42e6-4f8a-af8c-712e52644cb5 from the persistent domain config.
Oct 20 10:27:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cfb50bd6-42e6-4f8a-af8c-712e52644cb5 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:27:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:27:31 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:27:31 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:27:31 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:27:31 user nova-compute[74311]:   <serial>e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36</serial>
Oct 20 10:27:31 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:27:31 user nova-compute[74311]: </disk>
Oct 20 10:27:31 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Successfully updated port: 378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "refresh_cache-28ec7283-8a34-4eb4-b458-ed9fe6723ec2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquired lock "refresh_cache-28ec7283-8a34-4eb4-b458-ed9fe6723ec2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-4809f386-f1f1-4d17-a210-e653b44d6d4f req-0fac8add-9ab2-4a55-b484-04383b73a23a service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Received event network-changed-378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-4809f386-f1f1-4d17-a210-e653b44d6d4f req-0fac8add-9ab2-4a55-b484-04383b73a23a service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Refreshing instance network info cache due to event network-changed-378b4ae2-4ea8-498d-9ef0-6c3e96817646. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4809f386-f1f1-4d17-a210-e653b44d6d4f req-0fac8add-9ab2-4a55-b484-04383b73a23a service nova] Acquiring lock "refresh_cache-28ec7283-8a34-4eb4-b458-ed9fe6723ec2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cfb50bd6-42e6-4f8a-af8c-712e52644cb5 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Updating instance_info_cache with network_info: [{"id": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "address": "fa:16:3e:5a:e5:8e", "network": {"id": "73186602-4613-449b-b892-2aed0cad9aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-347025189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c01bcaa34104f29ab8566e793779055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378b4ae2-4e", "ovs_interfaceid": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Releasing lock "refresh_cache-28ec7283-8a34-4eb4-b458-ed9fe6723ec2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Instance network_info: |[{"id": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "address": "fa:16:3e:5a:e5:8e", "network": {"id": "73186602-4613-449b-b892-2aed0cad9aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-347025189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c01bcaa34104f29ab8566e793779055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378b4ae2-4e", "ovs_interfaceid": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4809f386-f1f1-4d17-a210-e653b44d6d4f req-0fac8add-9ab2-4a55-b484-04383b73a23a service nova] Acquired lock "refresh_cache-28ec7283-8a34-4eb4-b458-ed9fe6723ec2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.network.neutron [req-4809f386-f1f1-4d17-a210-e653b44d6d4f req-0fac8add-9ab2-4a55-b484-04383b73a23a service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Refreshing network info cache for port 378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Start _get_guest_xml network_info=[{"id": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "address": "fa:16:3e:5a:e5:8e", "network": {"id": "73186602-4613-449b-b892-2aed0cad9aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-347025189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c01bcaa34104f29ab8566e793779055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378b4ae2-4e", "ovs_interfaceid": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:27:32 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:27:32 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:27:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-661499792',display_name='tempest-TestServerVolumeAttachmentScenario-server-661499792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-661499792',id=33,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd3sBOCPWK8bLw4k3o1N5LeRfSPlOSImgEHr/h8AxyqwOYZTDkzp5JFK7lYTjdBesPSZqQycSqxm18ywLdER8vSNaM7Eyq33NBMQZo8CQoeA3Ol2UgT5axxnClFL/Bf9w==',key_name='tempest-keypair-152994944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c01bcaa34104f29ab8566e793779055',ramdisk_id='',reservation_id='r-0v5nj00p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2124604318',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2124604318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:27:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b695ede156f4dd7b3e20e23b09b8afe',uuid=28ec7283-8a34-4eb4-b458-ed9fe6723ec2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "address": "fa:16:3e:5a:e5:8e", "network": {"id": "73186602-4613-449b-b892-2aed0cad9aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-347025189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c01bcaa34104f29ab8566e793779055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378b4ae2-4e", "ovs_interfaceid": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Converting VIF {"id": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "address": "fa:16:3e:5a:e5:8e", "network": {"id": "73186602-4613-449b-b892-2aed0cad9aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-347025189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c01bcaa34104f29ab8566e793779055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378b4ae2-4e", "ovs_interfaceid": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e5:8e,bridge_name='br-int',has_traffic_filtering=True,id=378b4ae2-4ea8-498d-9ef0-6c3e96817646,network=Network(73186602-4613-449b-b892-2aed0cad9aef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap378b4ae2-4e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.objects.instance [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lazy-loading 'pci_devices' on Instance uuid 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:27:32 user nova-compute[74311]:   <uuid>28ec7283-8a34-4eb4-b458-ed9fe6723ec2</uuid>
Oct 20 10:27:32 user nova-compute[74311]:   <name>instance-00000021</name>
Oct 20 10:27:32 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:27:32 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:27:32 user nova-compute[74311]:   <metadata>
Oct 20 10:27:32 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:27:32 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:27:32 user nova-compute[74311]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-661499792</nova:name>
Oct 20 10:27:32 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:27:32</nova:creationTime>
Oct 20 10:27:32 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:27:32 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:27:32 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:27:32 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:27:32 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:27:32 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:27:32 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:27:32 user nova-compute[74311]:       <nova:owner>
Oct 20 10:27:32 user nova-compute[74311]:         <nova:user uuid="0b695ede156f4dd7b3e20e23b09b8afe">tempest-TestServerVolumeAttachmentScenario-2124604318-project-member</nova:user>
Oct 20 10:27:32 user nova-compute[74311]:         <nova:project uuid="9c01bcaa34104f29ab8566e793779055">tempest-TestServerVolumeAttachmentScenario-2124604318</nova:project>
Oct 20 10:27:32 user nova-compute[74311]:       </nova:owner>
Oct 20 10:27:32 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:27:32 user nova-compute[74311]:       <nova:ports>
Oct 20 10:27:32 user nova-compute[74311]:         <nova:port uuid="378b4ae2-4ea8-498d-9ef0-6c3e96817646">
Oct 20 10:27:32 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 10:27:32 user nova-compute[74311]:         </nova:port>
Oct 20 10:27:32 user nova-compute[74311]:       </nova:ports>
Oct 20 10:27:32 user nova-compute[74311]:     </nova:instance>
Oct 20 10:27:32 user nova-compute[74311]:   </metadata>
Oct 20 10:27:32 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:27:32 user nova-compute[74311]:     <system>
Oct 20 10:27:32 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:27:32 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:27:32 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:27:32 user nova-compute[74311]:       <entry name="serial">28ec7283-8a34-4eb4-b458-ed9fe6723ec2</entry>
Oct 20 10:27:32 user nova-compute[74311]:       <entry name="uuid">28ec7283-8a34-4eb4-b458-ed9fe6723ec2</entry>
Oct 20 10:27:32 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:27:32 user nova-compute[74311]:     </system>
Oct 20 10:27:32 user nova-compute[74311]:   </sysinfo>
Oct 20 10:27:32 user nova-compute[74311]:   <os>
Oct 20 10:27:32 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:27:32 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:27:32 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:27:32 user nova-compute[74311]:   </os>
Oct 20 10:27:32 user nova-compute[74311]:   <features>
Oct 20 10:27:32 user nova-compute[74311]:     <acpi/>
Oct 20 10:27:32 user nova-compute[74311]:     <apic/>
Oct 20 10:27:32 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:27:32 user nova-compute[74311]:   </features>
Oct 20 10:27:32 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:27:32 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:27:32 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:27:32 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:27:32 user nova-compute[74311]:   </clock>
Oct 20 10:27:32 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:27:32 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:27:32 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:27:32 user nova-compute[74311]:   </cpu>
Oct 20 10:27:32 user nova-compute[74311]:   <devices>
Oct 20 10:27:32 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:27:32 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:27:32 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk"/>
Oct 20 10:27:32 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:27:32 user nova-compute[74311]:     </disk>
Oct 20 10:27:32 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:27:32 user nova-compute[74311]:       <mac address="fa:16:3e:5a:e5:8e"/>
Oct 20 10:27:32 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:27:32 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:27:32 user nova-compute[74311]:       <target dev="tap378b4ae2-4e"/>
Oct 20 10:27:32 user nova-compute[74311]:     </interface>
Oct 20 10:27:32 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:27:32 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/console.log" append="off"/>
Oct 20 10:27:32 user nova-compute[74311]:     </serial>
Oct 20 10:27:32 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:27:32 user nova-compute[74311]:     <video>
Oct 20 10:27:32 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:27:32 user nova-compute[74311]:     </video>
Oct 20 10:27:32 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:27:32 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:27:32 user nova-compute[74311]:     </rng>
Oct 20 10:27:32 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:27:32 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:27:32 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:27:32 user nova-compute[74311]:     </memballoon>
Oct 20 10:27:32 user nova-compute[74311]:   </devices>
Oct 20 10:27:32 user nova-compute[74311]: </domain>
Oct 20 10:27:32 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:27:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-661499792',display_name='tempest-TestServerVolumeAttachmentScenario-server-661499792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-661499792',id=33,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd3sBOCPWK8bLw4k3o1N5LeRfSPlOSImgEHr/h8AxyqwOYZTDkzp5JFK7lYTjdBesPSZqQycSqxm18ywLdER8vSNaM7Eyq33NBMQZo8CQoeA3Ol2UgT5axxnClFL/Bf9w==',key_name='tempest-keypair-152994944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c01bcaa34104f29ab8566e793779055',ramdisk_id='',reservation_id='r-0v5nj00p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2124604318',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2124604318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:27:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b695ede156f4dd7b3e20e23b09b8afe',uuid=28ec7283-8a34-4eb4-b458-ed9fe6723ec2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "address": "fa:16:3e:5a:e5:8e", "network": {"id": "73186602-4613-449b-b892-2aed0cad9aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-347025189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c01bcaa34104f29ab8566e793779055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378b4ae2-4e", "ovs_interfaceid": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Converting VIF {"id": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "address": "fa:16:3e:5a:e5:8e", "network": {"id": "73186602-4613-449b-b892-2aed0cad9aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-347025189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c01bcaa34104f29ab8566e793779055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378b4ae2-4e", "ovs_interfaceid": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e5:8e,bridge_name='br-int',has_traffic_filtering=True,id=378b4ae2-4ea8-498d-9ef0-6c3e96817646,network=Network(73186602-4613-449b-b892-2aed0cad9aef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap378b4ae2-4e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG os_vif [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e5:8e,bridge_name='br-int',has_traffic_filtering=True,id=378b4ae2-4ea8-498d-9ef0-6c3e96817646,network=Network(73186602-4613-449b-b892-2aed0cad9aef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap378b4ae2-4e') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c42ebe0d-4a89-5262-b115-f957bd15b748', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap378b4ae2-4e, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap378b4ae2-4e, col_values=(('qos', UUID('cc424497-05ff-4f82-a6c7-fde6d8dd1b14')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap378b4ae2-4e, col_values=(('external_ids', {'iface-id': '378b4ae2-4ea8-498d-9ef0-6c3e96817646', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:e5:8e', 'vm-uuid': '28ec7283-8a34-4eb4-b458-ed9fe6723ec2'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:32 user nova-compute[74311]: INFO os_vif [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:e5:8e,bridge_name='br-int',has_traffic_filtering=True,id=378b4ae2-4ea8-498d-9ef0-6c3e96817646,network=Network(73186602-4613-449b-b892-2aed0cad9aef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap378b4ae2-4e')
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] No VIF found with MAC fa:16:3e:5a:e5:8e, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.network.neutron [req-4809f386-f1f1-4d17-a210-e653b44d6d4f req-0fac8add-9ab2-4a55-b484-04383b73a23a service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Updated VIF entry in instance network info cache for port 378b4ae2-4ea8-498d-9ef0-6c3e96817646. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG nova.network.neutron [req-4809f386-f1f1-4d17-a210-e653b44d6d4f req-0fac8add-9ab2-4a55-b484-04383b73a23a service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Updating instance_info_cache with network_info: [{"id": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "address": "fa:16:3e:5a:e5:8e", "network": {"id": "73186602-4613-449b-b892-2aed0cad9aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-347025189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c01bcaa34104f29ab8566e793779055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378b4ae2-4e", "ovs_interfaceid": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:27:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4809f386-f1f1-4d17-a210-e653b44d6d4f req-0fac8add-9ab2-4a55-b484-04383b73a23a service nova] Releasing lock "refresh_cache-28ec7283-8a34-4eb4-b458-ed9fe6723ec2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:27:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-2dbe91b4-eb77-49c5-a86b-60e97ba0d644 req-fe72f76e-e32f-460c-826f-768754aef3d9 service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Received event network-vif-plugged-378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:27:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2dbe91b4-eb77-49c5-a86b-60e97ba0d644 req-fe72f76e-e32f-460c-826f-768754aef3d9 service nova] Acquiring lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2dbe91b4-eb77-49c5-a86b-60e97ba0d644 req-fe72f76e-e32f-460c-826f-768754aef3d9 service nova] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2dbe91b4-eb77-49c5-a86b-60e97ba0d644 req-fe72f76e-e32f-460c-826f-768754aef3d9 service nova] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-2dbe91b4-eb77-49c5-a86b-60e97ba0d644 req-fe72f76e-e32f-460c-826f-768754aef3d9 service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] No waiting events found dispatching network-vif-plugged-378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:27:34 user nova-compute[74311]: WARNING nova.compute.manager [req-2dbe91b4-eb77-49c5-a86b-60e97ba0d644 req-fe72f76e-e32f-460c-826f-768754aef3d9 service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Received unexpected event network-vif-plugged-378b4ae2-4ea8-498d-9ef0-6c3e96817646 for instance with vm_state building and task_state spawning.
Oct 20 10:27:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:36 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:27:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:27:36 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Instance spawned successfully.
Oct 20 10:27:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:27:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:27:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:27:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:27:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:27:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:27:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:27:36 user nova-compute[74311]: INFO nova.compute.manager [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Took 5.42 seconds to spawn the instance on the hypervisor.
Oct 20 10:27:36 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:27:36 user nova-compute[74311]: INFO nova.compute.manager [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Took 6.36 seconds to build instance.
Oct 20 10:27:36 user nova-compute[74311]: DEBUG nova.compute.manager [req-7d29450b-339e-408b-a4bd-aefa320ddca5 req-d9f94ac9-05fc-4834-8be4-3db22dddc70b service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Received event network-vif-plugged-378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:27:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7d29450b-339e-408b-a4bd-aefa320ddca5 req-d9f94ac9-05fc-4834-8be4-3db22dddc70b service nova] Acquiring lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7d29450b-339e-408b-a4bd-aefa320ddca5 req-d9f94ac9-05fc-4834-8be4-3db22dddc70b service nova] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7d29450b-339e-408b-a4bd-aefa320ddca5 req-d9f94ac9-05fc-4834-8be4-3db22dddc70b service nova] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:36 user nova-compute[74311]: DEBUG nova.compute.manager [req-7d29450b-339e-408b-a4bd-aefa320ddca5 req-d9f94ac9-05fc-4834-8be4-3db22dddc70b service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] No waiting events found dispatching network-vif-plugged-378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:27:36 user nova-compute[74311]: WARNING nova.compute.manager [req-7d29450b-339e-408b-a4bd-aefa320ddca5 req-d9f94ac9-05fc-4834-8be4-3db22dddc70b service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Received unexpected event network-vif-plugged-378b4ae2-4ea8-498d-9ef0-6c3e96817646 for instance with vm_state active and task_state None.
Oct 20 10:27:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b03ded74-bd09-4b1a-84b1-dd6060e0bbb0 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.468s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:45 user nova-compute[74311]: INFO nova.compute.manager [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Terminating instance
Oct 20 10:27:45 user nova-compute[74311]: DEBUG nova.compute.manager [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-3396d6eb-7ea4-470c-9f49-59a801f1ba4b req-65fa70d9-6c09-4f96-9163-cc9b55a6d325 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-vif-unplugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3396d6eb-7ea4-470c-9f49-59a801f1ba4b req-65fa70d9-6c09-4f96-9163-cc9b55a6d325 service nova] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3396d6eb-7ea4-470c-9f49-59a801f1ba4b req-65fa70d9-6c09-4f96-9163-cc9b55a6d325 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3396d6eb-7ea4-470c-9f49-59a801f1ba4b req-65fa70d9-6c09-4f96-9163-cc9b55a6d325 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-3396d6eb-7ea4-470c-9f49-59a801f1ba4b req-65fa70d9-6c09-4f96-9163-cc9b55a6d325 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] No waiting events found dispatching network-vif-unplugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:27:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-3396d6eb-7ea4-470c-9f49-59a801f1ba4b req-65fa70d9-6c09-4f96-9163-cc9b55a6d325 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-vif-unplugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:27:46 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Instance destroyed successfully.
Oct 20 10:27:46 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'resources' on Instance uuid 6a964d89-1f48-405b-bf64-31b9eef9ece3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:27:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1673768130',display_name='tempest-AttachVolumeTestJSON-server-1673768130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1673768130',id=18,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJYcmNlzLpysvhxPxGUSP0j7sh5O9o25thL4eCR81ZsGW+B6UHXUeUQVHkIIazQJidMRU0G/6rN9EQv2+Mt89HRMjWiUYCfGHIzOVJ/WhTEW9pqoD8o/FnFRAAvE/JYDw==',key_name='tempest-keypair-2078286093',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f725dba626242d6ada4ccceab72c55c',ramdisk_id='',reservation_id='r-dtf2wxoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1992975846',owner_user_name='tempest-AttachVolumeTestJSON-1992975846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:25:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3599c6c5ec984a3599dbdd732ffd0977',uuid=6a964d89-1f48-405b-bf64-31b9eef9ece3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:27:46 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converting VIF {"id": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "address": "fa:16:3e:6e:64:47", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb8ce2-6b", "ovs_interfaceid": "98eb8ce2-6b43-43ac-99f6-e908d0688d20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:27:46 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:27:46 user nova-compute[74311]: DEBUG os_vif [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:27:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98eb8ce2-6b, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:27:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b685c1c-2712-4062-905e-4d848b6695c1) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:27:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:27:46 user nova-compute[74311]: INFO os_vif [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:64:47,bridge_name='br-int',has_traffic_filtering=True,id=98eb8ce2-6b43-43ac-99f6-e908d0688d20,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb8ce2-6b')
Oct 20 10:27:46 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Deleting instance files /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3_del
Oct 20 10:27:46 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Deletion of /opt/stack/data/nova/instances/6a964d89-1f48-405b-bf64-31b9eef9ece3_del complete
Oct 20 10:27:46 user nova-compute[74311]: INFO nova.compute.manager [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 20 10:27:46 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:27:46 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:27:46 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:27:47 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:27:47 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Took 1.18 seconds to deallocate network for instance.
Oct 20 10:27:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-60692a5e-afda-44c2-bd18-d76e1d93cdeb req-1acb1214-b91c-4374-8593-d770bc3e2dbd service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-vif-deleted-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:27:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-a31473c4-b6d0-4f1f-92a4-0f7af088f6c3 req-115da2d6-66df-4de0-a9aa-b9fb4cca4424 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:27:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a31473c4-b6d0-4f1f-92a4-0f7af088f6c3 req-115da2d6-66df-4de0-a9aa-b9fb4cca4424 service nova] Acquiring lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a31473c4-b6d0-4f1f-92a4-0f7af088f6c3 req-115da2d6-66df-4de0-a9aa-b9fb4cca4424 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a31473c4-b6d0-4f1f-92a4-0f7af088f6c3 req-115da2d6-66df-4de0-a9aa-b9fb4cca4424 service nova] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-a31473c4-b6d0-4f1f-92a4-0f7af088f6c3 req-115da2d6-66df-4de0-a9aa-b9fb4cca4424 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] No waiting events found dispatching network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:27:47 user nova-compute[74311]: WARNING nova.compute.manager [req-a31473c4-b6d0-4f1f-92a4-0f7af088f6c3 req-115da2d6-66df-4de0-a9aa-b9fb4cca4424 service nova] [instance: 6a964d89-1f48-405b-bf64-31b9eef9ece3] Received unexpected event network-vif-plugged-98eb8ce2-6b43-43ac-99f6-e908d0688d20 for instance with vm_state deleted and task_state None.
Oct 20 10:27:48 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:27:48 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:27:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.606s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:48 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Deleted allocations for instance 6a964d89-1f48-405b-bf64-31b9eef9ece3
Oct 20 10:27:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e38db2b8-4a59-46d3-a6ea-0deeb4ff7a66 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "6a964d89-1f48-405b-bf64-31b9eef9ece3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.136s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "3b70780c-e968-4fce-a887-121d4b00218a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "3b70780c-e968-4fce-a887-121d4b00218a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:49 user nova-compute[74311]: DEBUG nova.compute.manager [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Going to confirm migration 2 {{(pid=74311) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 20 10:27:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:27:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquired lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:27:50 user nova-compute[74311]: DEBUG nova.network.neutron [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:27:50 user nova-compute[74311]: DEBUG nova.objects.instance [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lazy-loading 'info_cache' on Instance uuid 3b70780c-e968-4fce-a887-121d4b00218a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:27:50 user nova-compute[74311]: DEBUG nova.network.neutron [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Updating instance_info_cache with network_info: [{"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:27:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Releasing lock "refresh_cache-3b70780c-e968-4fce-a887-121d4b00218a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:27:50 user nova-compute[74311]: DEBUG nova.objects.instance [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lazy-loading 'migration_context' on Instance uuid 3b70780c-e968-4fce-a887-121d4b00218a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:27:50 user nova-compute[74311]: DEBUG nova.objects.base [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Object Instance<3b70780c-e968-4fce-a887-121d4b00218a> lazy-loaded attributes: info_cache,migration_context {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:27:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:27:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:27:50 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:27:51 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:27:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.488s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:51 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Deleted allocation for migration df3bfebc-7cf4-4b6e-a10b-c2a25cb67c06
Oct 20 10:27:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-97fc96ca-28d0-4d83-af02-e0d6ba1f22bf tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "3b70780c-e968-4fce-a887-121d4b00218a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.494s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:52 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cfb50bd6-42e6-4f8a-af8c-712e52644cb5 is timed out.
Oct 20 10:27:52 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Successfully detached device vdb from instance cfb50bd6-42e6-4f8a-af8c-712e52644cb5 from the live domain config.
Oct 20 10:27:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBQIhHUV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:27:52 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b49de18-7aff-4d4c-afc3-94ad89de3b17]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:27:52 user nova-compute[74311]: No targets found.
Oct 20 10:27:52 user nova-compute[74311]: iSNS:
Oct 20 10:27:52 user nova-compute[74311]: No targets found.
Oct 20 10:27:52 user nova-compute[74311]: STATIC:
Oct 20 10:27:52 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:27:52 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:27:52 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:27:52 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728
Oct 20 10:27:52 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:27:52 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:27:52 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36
Oct 20 10:27:52 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:27:52 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:27:52 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8
Oct 20 10:27:52 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:27:52 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:27:52 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548
Oct 20 10:27:52 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:27:52 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:27:52 user nova-compute[74311]: FIRMWARE:
Oct 20 10:27:52 user nova-compute[74311]: No targets found.
Oct 20 10:27:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:27:52 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:27:52 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77c3c18-364d-4960-a72e-61ae0c0d6432]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07a59b7-acef-4f9e-af40-d71c8a420852]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:27:52 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:27:52 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:27:52 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:27:52 user nova-compute[74311]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:27:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:27:52 user nova-compute[74311]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 (non-flash)
Oct 20 10:27:52 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:27:52 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:27:52 user nova-compute[74311]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:27:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164f37880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36'): ({'sdc'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Removing single pathed devices sdc {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba776d1c-8eca-4994-8e04-f0b7a1dc5ca8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f21d11b-a7ff-4c52-add9-3664c930c6a5]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Flushing IO for device /dev/sdc {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec238d6-da3d-43f5-b0f5-c53315594c76]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4af998-aebd-4056-a7b4-3838bb891964]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fa4f2f-329b-4487-b5a2-4099c7584d4d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc70570-8be5-43ec-a441-06d58269bd5a]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36, portal: 172.16.0.220,3260]
Oct 20 10:27:52 user nova-compute[74311]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36, portal: 172.16.0.220,3260] successful.
Oct 20 10:27:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1e5e3e1-65a9-4ece-9b7d-84ea9256bf36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a8fa18-cab8-481f-80f6-06f34fe952af]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] <== disconnect_volume: return (336ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:27:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:27:53 user nova-compute[74311]: DEBUG nova.objects.instance [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'flavor' on Instance uuid cfb50bd6-42e6-4f8a-af8c-712e52644cb5 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:27:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-76757788-481d-45c7-8525-d14a3f1ee214 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.789s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:27:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:27:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG nova.objects.instance [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lazy-loading 'info_cache' on Instance uuid 22d78096-bc6c-4d6b-93b6-845d596ed24b {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "acd91e17-e847-403f-84f4-8ab962ff06db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "acd91e17-e847-403f-84f4-8ab962ff06db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:03 user nova-compute[74311]: INFO nova.compute.manager [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Terminating instance
Oct 20 10:28:03 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Updating instance_info_cache with network_info: [{"id": "3a618325-862e-4c54-a654-6d3284cb8bf3", "address": "fa:16:3e:e2:bf:e1", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a618325-86", "ovs_interfaceid": "3a618325-862e-4c54-a654-6d3284cb8bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-22d78096-bc6c-4d6b-93b6-845d596ed24b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG nova.compute.manager [req-b0a405b0-7d46-4e69-be3c-3d6895756a55 req-a0488eef-aa6a-4abe-b58c-d2637115e1b0 service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Received event network-vif-unplugged-20688c54-86dc-4d82-a97a-f5c77423d649 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b0a405b0-7d46-4e69-be3c-3d6895756a55 req-a0488eef-aa6a-4abe-b58c-d2637115e1b0 service nova] Acquiring lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b0a405b0-7d46-4e69-be3c-3d6895756a55 req-a0488eef-aa6a-4abe-b58c-d2637115e1b0 service nova] Lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b0a405b0-7d46-4e69-be3c-3d6895756a55 req-a0488eef-aa6a-4abe-b58c-d2637115e1b0 service nova] Lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG nova.compute.manager [req-b0a405b0-7d46-4e69-be3c-3d6895756a55 req-a0488eef-aa6a-4abe-b58c-d2637115e1b0 service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] No waiting events found dispatching network-vif-unplugged-20688c54-86dc-4d82-a97a-f5c77423d649 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:03 user nova-compute[74311]: DEBUG nova.compute.manager [req-b0a405b0-7d46-4e69-be3c-3d6895756a55 req-a0488eef-aa6a-4abe-b58c-d2637115e1b0 service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Received event network-vif-unplugged-20688c54-86dc-4d82-a97a-f5c77423d649 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:28:04 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Instance destroyed successfully.
Oct 20 10:28:04 user nova-compute[74311]: DEBUG nova.objects.instance [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lazy-loading 'resources' on Instance uuid acd91e17-e847-403f-84f4-8ab962ff06db {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1929983182',display_name='tempest-VolumesActionsTest-instance-1929983182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1929983182',id=30,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:26:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bed6d454e3a3423682cd4a6b21c685df',ramdisk_id='',reservation_id='r-i0uz6hqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-711255224',owner_user_name='tempest-VolumesActionsTest-711255224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:26:21Z,user_data=None,user_id='56f4022992534cb0b81e393ccbac8d52',uuid=acd91e17-e847-403f-84f4-8ab962ff06db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20688c54-86dc-4d82-a97a-f5c77423d649", "address": "fa:16:3e:3d:43:cf", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20688c54-86", "ovs_interfaceid": "20688c54-86dc-4d82-a97a-f5c77423d649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Converting VIF {"id": "20688c54-86dc-4d82-a97a-f5c77423d649", "address": "fa:16:3e:3d:43:cf", "network": {"id": "534777ae-0aa3-4431-9cf5-9154ace6d1f2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2063920536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bed6d454e3a3423682cd4a6b21c685df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20688c54-86", "ovs_interfaceid": "20688c54-86dc-4d82-a97a-f5c77423d649", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:43:cf,bridge_name='br-int',has_traffic_filtering=True,id=20688c54-86dc-4d82-a97a-f5c77423d649,network=Network(534777ae-0aa3-4431-9cf5-9154ace6d1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20688c54-86') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG os_vif [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:43:cf,bridge_name='br-int',has_traffic_filtering=True,id=20688c54-86dc-4d82-a97a-f5c77423d649,network=Network(534777ae-0aa3-4431-9cf5-9154ace6d1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20688c54-86') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20688c54-86, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fbe0ead-a438-42d8-a63a-05b6f84c5002) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:28:04 user nova-compute[74311]: INFO os_vif [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:43:cf,bridge_name='br-int',has_traffic_filtering=True,id=20688c54-86dc-4d82-a97a-f5c77423d649,network=Network(534777ae-0aa3-4431-9cf5-9154ace6d1f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20688c54-86')
Oct 20 10:28:04 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Deleting instance files /opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db_del
Oct 20 10:28:04 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Deletion of /opt/stack/data/nova/instances/acd91e17-e847-403f-84f4-8ab962ff06db_del complete
Oct 20 10:28:04 user nova-compute[74311]: INFO nova.compute.manager [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 10:28:04 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:04 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Took 0.46 seconds to deallocate network for instance.
Oct 20 10:28:04 user nova-compute[74311]: DEBUG nova.compute.manager [req-d482fea8-86e3-4dff-9950-a1a60f060eb4 req-a8e30251-ab32-4036-8638-3802c55953eb service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Received event network-vif-deleted-20688c54-86dc-4d82-a97a-f5c77423d649 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:04 user nova-compute[74311]: INFO nova.compute.manager [req-d482fea8-86e3-4dff-9950-a1a60f060eb4 req-a8e30251-ab32-4036-8638-3802c55953eb service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Neutron deleted interface 20688c54-86dc-4d82-a97a-f5c77423d649; detaching it from the instance and deleting it from the info cache
Oct 20 10:28:04 user nova-compute[74311]: DEBUG nova.network.neutron [req-d482fea8-86e3-4dff-9950-a1a60f060eb4 req-a8e30251-ab32-4036-8638-3802c55953eb service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG nova.compute.manager [req-d482fea8-86e3-4dff-9950-a1a60f060eb4 req-a8e30251-ab32-4036-8638-3802c55953eb service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Detach interface failed, port_id=20688c54-86dc-4d82-a97a-f5c77423d649, reason: Instance acd91e17-e847-403f-84f4-8ab962ff06db could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:05 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:28:05 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:28:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:05 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Deleted allocations for instance acd91e17-e847-403f-84f4-8ab962ff06db
Oct 20 10:28:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b670a139-cb01-4703-958d-dfbaa369cec3 tempest-VolumesActionsTest-711255224 tempest-VolumesActionsTest-711255224-project-member] Lock "acd91e17-e847-403f-84f4-8ab962ff06db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.106s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:05 user nova-compute[74311]: DEBUG nova.compute.manager [req-bfe175f7-c577-4398-bb49-fcc6870af4f8 req-aa932a39-b5ca-4a3e-bd8e-e826c7557dd5 service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Received event network-vif-plugged-20688c54-86dc-4d82-a97a-f5c77423d649 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bfe175f7-c577-4398-bb49-fcc6870af4f8 req-aa932a39-b5ca-4a3e-bd8e-e826c7557dd5 service nova] Acquiring lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bfe175f7-c577-4398-bb49-fcc6870af4f8 req-aa932a39-b5ca-4a3e-bd8e-e826c7557dd5 service nova] Lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bfe175f7-c577-4398-bb49-fcc6870af4f8 req-aa932a39-b5ca-4a3e-bd8e-e826c7557dd5 service nova] Lock "acd91e17-e847-403f-84f4-8ab962ff06db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:05 user nova-compute[74311]: DEBUG nova.compute.manager [req-bfe175f7-c577-4398-bb49-fcc6870af4f8 req-aa932a39-b5ca-4a3e-bd8e-e826c7557dd5 service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] No waiting events found dispatching network-vif-plugged-20688c54-86dc-4d82-a97a-f5c77423d649 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:05 user nova-compute[74311]: WARNING nova.compute.manager [req-bfe175f7-c577-4398-bb49-fcc6870af4f8 req-aa932a39-b5ca-4a3e-bd8e-e826c7557dd5 service nova] [instance: acd91e17-e847-403f-84f4-8ab962ff06db] Received unexpected event network-vif-plugged-20688c54-86dc-4d82-a97a-f5c77423d649 for instance with vm_state deleted and task_state None.
Oct 20 10:28:07 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:28:08 user nova-compute[74311]: INFO nova.compute.manager [None req-03af45a6-5a5d-41b7-a4b4-3f69c0357bed tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Unrescuing
Oct 20 10:28:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-03af45a6-5a5d-41b7-a4b4-3f69c0357bed tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "refresh_cache-730bd2ce-cb53-411a-8b74-dafba0d5e2bb" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-03af45a6-5a5d-41b7-a4b4-3f69c0357bed tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquired lock "refresh_cache-730bd2ce-cb53-411a-8b74-dafba0d5e2bb" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG nova.network.neutron [None req-03af45a6-5a5d-41b7-a4b4-3f69c0357bed tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG nova.network.neutron [None req-03af45a6-5a5d-41b7-a4b4-3f69c0357bed tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Updating instance_info_cache with network_info: [{"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-03af45a6-5a5d-41b7-a4b4-3f69c0357bed tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Releasing lock "refresh_cache-730bd2ce-cb53-411a-8b74-dafba0d5e2bb" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG nova.objects.instance [None req-03af45a6-5a5d-41b7-a4b4-3f69c0357bed tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'flavor' on Instance uuid 730bd2ce-cb53-411a-8b74-dafba0d5e2bb {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-1c461a10-dda6-421d-9f2a-b4a9342d58bf req-b7452c3d-3110-47c1-bb32-f72c1d6d4bb6 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-unplugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1c461a10-dda6-421d-9f2a-b4a9342d58bf req-b7452c3d-3110-47c1-bb32-f72c1d6d4bb6 service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1c461a10-dda6-421d-9f2a-b4a9342d58bf req-b7452c3d-3110-47c1-bb32-f72c1d6d4bb6 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1c461a10-dda6-421d-9f2a-b4a9342d58bf req-b7452c3d-3110-47c1-bb32-f72c1d6d4bb6 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-1c461a10-dda6-421d-9f2a-b4a9342d58bf req-b7452c3d-3110-47c1-bb32-f72c1d6d4bb6 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-unplugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:08 user nova-compute[74311]: WARNING nova.compute.manager [req-1c461a10-dda6-421d-9f2a-b4a9342d58bf req-b7452c3d-3110-47c1-bb32-f72c1d6d4bb6 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received unexpected event network-vif-unplugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:28:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:09 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:28:09 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Instance destroyed successfully.
Oct 20 10:28:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:09 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:28:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-6ec166fb-26b2-4a5d-88e0-53f90bde4184 req-158c6d81-6da2-430b-a23e-1a919a1bb02f service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6ec166fb-26b2-4a5d-88e0-53f90bde4184 req-158c6d81-6da2-430b-a23e-1a919a1bb02f service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6ec166fb-26b2-4a5d-88e0-53f90bde4184 req-158c6d81-6da2-430b-a23e-1a919a1bb02f service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6ec166fb-26b2-4a5d-88e0-53f90bde4184 req-158c6d81-6da2-430b-a23e-1a919a1bb02f service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-6ec166fb-26b2-4a5d-88e0-53f90bde4184 req-158c6d81-6da2-430b-a23e-1a919a1bb02f service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:10 user nova-compute[74311]: WARNING nova.compute.manager [req-6ec166fb-26b2-4a5d-88e0-53f90bde4184 req-158c6d81-6da2-430b-a23e-1a919a1bb02f service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received unexpected event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:28:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-6ec166fb-26b2-4a5d-88e0-53f90bde4184 req-158c6d81-6da2-430b-a23e-1a919a1bb02f service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6ec166fb-26b2-4a5d-88e0-53f90bde4184 req-158c6d81-6da2-430b-a23e-1a919a1bb02f service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6ec166fb-26b2-4a5d-88e0-53f90bde4184 req-158c6d81-6da2-430b-a23e-1a919a1bb02f service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6ec166fb-26b2-4a5d-88e0-53f90bde4184 req-158c6d81-6da2-430b-a23e-1a919a1bb02f service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-6ec166fb-26b2-4a5d-88e0-53f90bde4184 req-158c6d81-6da2-430b-a23e-1a919a1bb02f service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:10 user nova-compute[74311]: WARNING nova.compute.manager [req-6ec166fb-26b2-4a5d-88e0-53f90bde4184 req-158c6d81-6da2-430b-a23e-1a919a1bb02f service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received unexpected event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:28:11 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:28:11 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:28:12 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:28:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-03af45a6-5a5d-41b7-a4b4-3f69c0357bed tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:28:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-237535ee-74c2-4d57-9004-d1b67f30177d req-a370e35a-ca9a-4d04-b57b-c560a1ed8540 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-237535ee-74c2-4d57-9004-d1b67f30177d req-a370e35a-ca9a-4d04-b57b-c560a1ed8540 service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-237535ee-74c2-4d57-9004-d1b67f30177d req-a370e35a-ca9a-4d04-b57b-c560a1ed8540 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-237535ee-74c2-4d57-9004-d1b67f30177d req-a370e35a-ca9a-4d04-b57b-c560a1ed8540 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-237535ee-74c2-4d57-9004-d1b67f30177d req-a370e35a-ca9a-4d04-b57b-c560a1ed8540 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:12 user nova-compute[74311]: WARNING nova.compute.manager [req-237535ee-74c2-4d57-9004-d1b67f30177d req-a370e35a-ca9a-4d04-b57b-c560a1ed8540 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received unexpected event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with vm_state active and task_state None.
Oct 20 10:28:12 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:28:13 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:28:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:13 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:28:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:28:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:28:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-8798195e-b0c0-4d87-ad97-60d0dcce80c0 req-1d09129d-ac9a-42e4-9c71-9fbeac73b496 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received event network-changed-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-8798195e-b0c0-4d87-ad97-60d0dcce80c0 req-1d09129d-ac9a-42e4-9c71-9fbeac73b496 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Refreshing instance network info cache due to event network-changed-672b83f5-751d-4964-b6e0-32d120958173. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8798195e-b0c0-4d87-ad97-60d0dcce80c0 req-1d09129d-ac9a-42e4-9c71-9fbeac73b496 service nova] Acquiring lock "refresh_cache-79b6152a-3eec-4412-a063-6e82e767a27b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8798195e-b0c0-4d87-ad97-60d0dcce80c0 req-1d09129d-ac9a-42e4-9c71-9fbeac73b496 service nova] Acquired lock "refresh_cache-79b6152a-3eec-4412-a063-6e82e767a27b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG nova.network.neutron [req-8798195e-b0c0-4d87-ad97-60d0dcce80c0 req-1d09129d-ac9a-42e4-9c71-9fbeac73b496 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Refreshing network info cache for port 672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG nova.network.neutron [req-8798195e-b0c0-4d87-ad97-60d0dcce80c0 req-1d09129d-ac9a-42e4-9c71-9fbeac73b496 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Updated VIF entry in instance network info cache for port 672b83f5-751d-4964-b6e0-32d120958173. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG nova.network.neutron [req-8798195e-b0c0-4d87-ad97-60d0dcce80c0 req-1d09129d-ac9a-42e4-9c71-9fbeac73b496 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Updating instance_info_cache with network_info: [{"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8798195e-b0c0-4d87-ad97-60d0dcce80c0 req-1d09129d-ac9a-42e4-9c71-9fbeac73b496 service nova] Releasing lock "refresh_cache-79b6152a-3eec-4412-a063-6e82e767a27b" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:28:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:17 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:28:17 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7298MB free_disk=25.02045440673828GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:17 user nova-compute[74311]: INFO nova.compute.manager [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Rebuilding instance
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.manager [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 922b36b5-0575-4717-a876-dda27469ebb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfb50bd6-42e6-4f8a-af8c-712e52644cb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 730bd2ce-cb53-411a-8b74-dafba0d5e2bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 3b70780c-e968-4fce-a887-121d4b00218a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 79b6152a-3eec-4412-a063-6e82e767a27b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing inventories for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Updating ProviderTree inventory for provider 77cac819-3c22-4fec-a59d-0525ac40a90b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Updating inventory in ProviderTree for provider 77cac819-3c22-4fec-a59d-0525ac40a90b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing aggregate associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, aggregates: None {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:17 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing trait associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3 {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG nova.compute.manager [req-cbc7ab0b-7555-478c-b1f1-26580396a09d req-b558b145-7fd7-4ec7-963f-ef73c93bc6f7 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received event network-vif-unplugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cbc7ab0b-7555-478c-b1f1-26580396a09d req-b558b145-7fd7-4ec7-963f-ef73c93bc6f7 service nova] Acquiring lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cbc7ab0b-7555-478c-b1f1-26580396a09d req-b558b145-7fd7-4ec7-963f-ef73c93bc6f7 service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-cbc7ab0b-7555-478c-b1f1-26580396a09d req-b558b145-7fd7-4ec7-963f-ef73c93bc6f7 service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG nova.compute.manager [req-cbc7ab0b-7555-478c-b1f1-26580396a09d req-b558b145-7fd7-4ec7-963f-ef73c93bc6f7 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] No waiting events found dispatching network-vif-unplugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:18 user nova-compute[74311]: WARNING nova.compute.manager [req-cbc7ab0b-7555-478c-b1f1-26580396a09d req-b558b145-7fd7-4ec7-963f-ef73c93bc6f7 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received unexpected event network-vif-unplugged-672b83f5-751d-4964-b6e0-32d120958173 for instance with vm_state active and task_state rebuilding.
Oct 20 10:28:18 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.150s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:18 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Instance destroyed successfully.
Oct 20 10:28:18 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Instance destroyed successfully.
Oct 20 10:28:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1929909354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1993782106',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzWhCvMVV6Y1XH/5Ox4S/1XTdcuZMP+vIAuIbp6IPW5DjnB21INUyKyNNxDYjm1qgk+5N7ar0+Y70BR6OMQrtuOTQnI1wGTcSxNpOQfz4xGTk69kpB66KvLuwztnTuwZg==',key_name='tempest-keypair-431497461',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:26:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9820bd4a09494eaf858e88301f6c5827',ramdisk_id='',reservation_id='r-81m98auw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-804114643',owner_user_name='tempest-ServerActionsV293TestJSON-804114643-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:28:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0134a62628fe4dd29bfd61a987d099d3',uuid=79b6152a-3eec-4412-a063-6e82e767a27b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Converting VIF {"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:fe:ae,bridge_name='br-int',has_traffic_filtering=True,id=672b83f5-751d-4964-b6e0-32d120958173,network=Network(630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap672b83f5-75') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_vif [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:fe:ae,bridge_name='br-int',has_traffic_filtering=True,id=672b83f5-751d-4964-b6e0-32d120958173,network=Network(630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap672b83f5-75') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap672b83f5-75, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=367bb98d-1291-41e9-b54f-7eae53b504e7) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:18 user nova-compute[74311]: INFO os_vif [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:fe:ae,bridge_name='br-int',has_traffic_filtering=True,id=672b83f5-751d-4964-b6e0-32d120958173,network=Network(630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap672b83f5-75')
Oct 20 10:28:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGnQdEte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:28:18 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c7495d-9ad4-4b84-adf1-fd131e58df08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:28:18 user nova-compute[74311]: No targets found.
Oct 20 10:28:18 user nova-compute[74311]: iSNS:
Oct 20 10:28:18 user nova-compute[74311]: No targets found.
Oct 20 10:28:18 user nova-compute[74311]: STATIC:
Oct 20 10:28:18 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:28:18 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:28:18 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:28:18 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728
Oct 20 10:28:18 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:28:18 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:28:18 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8
Oct 20 10:28:18 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:28:18 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:28:18 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548
Oct 20 10:28:18 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:28:18 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:28:18 user nova-compute[74311]: FIRMWARE:
Oct 20 10:28:18 user nova-compute[74311]: No targets found.
Oct 20 10:28:18 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:28:18 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:28:18 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17d9e77-ba3e-403e-905f-391a42247260]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a36019-90de-4066-b241-6338ad857947]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:28:18 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:28:18 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:28:18 user nova-compute[74311]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:28:18 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:28:18 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:28:18 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:28:18 user nova-compute[74311]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:28:18 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164e970a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548'): ({'sde'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Removing single pathed devices sde {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[203f0f89-8376-4412-a355-6e267869a604]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c4792b-07b2-4cb7-b9ab-cd535a269fef]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Flushing IO for device /dev/sde {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3303217f-a34a-4af6-ba48-43a8a60154b1]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[61addcbf-31b2-4948-8150-81a8191f3d42]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] SCSI volumes sde have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2d26f00', '/dev/disk/by-id/scsi-1SCST_BIO2d26f00-373e577df3fe82d0', '/dev/disk/by-id/scsi-23337336535373764') {{(pid=85589) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 10:28:18 user nova-compute[74311]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_2d26f00
Oct 20 10:28:18 user nova-compute[74311]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO2d26f00-373e577df3fe82d0
Oct 20 10:28:18 user nova-compute[74311]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23337336535373764
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef0eae0-df9f-43bd-9c16-0629ae401dc6]: (4, None) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00e5fed-e1c8-4526-89a8-5728ab822541]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98bdb66-ef7d-4e9e-958d-b47230624cea]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260]
Oct 20 10:28:18 user nova-compute[74311]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260] successful.
Oct 20 10:28:18 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc14524-1a38-4e4c-9115-99d4c6a3bbe2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] <== disconnect_volume: return (342ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:28:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:28:18 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Deleting instance files /opt/stack/data/nova/instances/79b6152a-3eec-4412-a063-6e82e767a27b_del
Oct 20 10:28:18 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Deletion of /opt/stack/data/nova/instances/79b6152a-3eec-4412-a063-6e82e767a27b_del complete
Oct 20 10:28:19 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 79b6152a-3eec-4412-a063-6e82e767a27b could not be found.
Oct 20 10:28:19 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGnQdEte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:28:19 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 10:28:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[694c34cc-112a-4a65-8f56-8f594256b9e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:28:19 user nova-compute[74311]: No targets found.
Oct 20 10:28:19 user nova-compute[74311]: iSNS:
Oct 20 10:28:19 user nova-compute[74311]: No targets found.
Oct 20 10:28:19 user nova-compute[74311]: STATIC:
Oct 20 10:28:19 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:28:19 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:28:19 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:28:19 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728
Oct 20 10:28:19 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:28:19 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:28:19 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8
Oct 20 10:28:19 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:28:19 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:28:19 user nova-compute[74311]: FIRMWARE:
Oct 20 10:28:19 user nova-compute[74311]: No targets found.
Oct 20 10:28:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:28:19 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:28:19 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0167125c-b369-40d0-8883-cd6e45588af2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3cbd9c-7fdb-4965-816e-78c7b03283ff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:28:19 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:28:19 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:28:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:28:19 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:28:19 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:28:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1ac3fed40>, {}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Disconnecting from: [] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] <== disconnect_volume: return (82ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:28:19 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Acquiring lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Preparing to wait for external event volume-reimaged-9d865eed-f501-4a9b-a4f2-8fd737339548 {{(pid=74311) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:28:20 user nova-compute[74311]: INFO nova.compute.claims [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Claim successful on node user
Oct 20 10:28:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-6fc649d8-c177-4e42-8164-17116be19c84 req-6f4ac3f4-bec3-43f5-a404-d314bfbbc095 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received event network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6fc649d8-c177-4e42-8164-17116be19c84 req-6f4ac3f4-bec3-43f5-a404-d314bfbbc095 service nova] Acquiring lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6fc649d8-c177-4e42-8164-17116be19c84 req-6f4ac3f4-bec3-43f5-a404-d314bfbbc095 service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6fc649d8-c177-4e42-8164-17116be19c84 req-6f4ac3f4-bec3-43f5-a404-d314bfbbc095 service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-6fc649d8-c177-4e42-8164-17116be19c84 req-6f4ac3f4-bec3-43f5-a404-d314bfbbc095 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] No event matching network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 in dict_keys([('volume-reimaged', '9d865eed-f501-4a9b-a4f2-8fd737339548')]) {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Oct 20 10:28:20 user nova-compute[74311]: WARNING nova.compute.manager [req-6fc649d8-c177-4e42-8164-17116be19c84 req-6f4ac3f4-bec3-43f5-a404-d314bfbbc095 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received unexpected event network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 for instance with vm_state active and task_state rebuilding.
Oct 20 10:28:20 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:28:20 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:28:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:28:20 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Creating image(s)
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Acquiring lock "/opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "/opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "/opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG nova.policy [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7baad432e8e54918aabc660c72e94dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6358c3ec703946d79426dae2da3dab09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.247s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/disk 1073741824" returned: 0 in 0.064s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.198s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Cannot resize image /opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Ensure instance console log exists: /opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:22 user nova-compute[74311]: INFO nova.compute.manager [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Terminating instance
Oct 20 10:28:22 user nova-compute[74311]: DEBUG nova.compute.manager [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG nova.network.neutron [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Successfully created port: 8cdf5a29-63ef-41f0-9b6b-482dd1de89ed {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-59fa63ce-4eca-4089-a446-0bafbc2c14b2 req-4307d0bc-d857-48cf-9335-905b4da3af54 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Received event network-vif-unplugged-e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-59fa63ce-4eca-4089-a446-0bafbc2c14b2 req-4307d0bc-d857-48cf-9335-905b4da3af54 service nova] Acquiring lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-59fa63ce-4eca-4089-a446-0bafbc2c14b2 req-4307d0bc-d857-48cf-9335-905b4da3af54 service nova] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-59fa63ce-4eca-4089-a446-0bafbc2c14b2 req-4307d0bc-d857-48cf-9335-905b4da3af54 service nova] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-59fa63ce-4eca-4089-a446-0bafbc2c14b2 req-4307d0bc-d857-48cf-9335-905b4da3af54 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] No waiting events found dispatching network-vif-unplugged-e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-59fa63ce-4eca-4089-a446-0bafbc2c14b2 req-4307d0bc-d857-48cf-9335-905b4da3af54 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Received event network-vif-unplugged-e08b7c03-51f2-450b-b639-a16cf0cd5214 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:28:22 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Instance destroyed successfully.
Oct 20 10:28:22 user nova-compute[74311]: DEBUG nova.objects.instance [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'resources' on Instance uuid cfb50bd6-42e6-4f8a-af8c-712e52644cb5 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1448945593',display_name='tempest-AttachVolumeNegativeTest-server-1448945593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1448945593',id=24,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyhwcwXWTCkFAxqhOK3I4yKV1HFHdMwqt0hLrFZaSsPto+d0y2F3ufj+YukdrbpOjYbGHrElXcDGL27TzBKjwPAAzZMEaxp1dRL3MlI0oVVaKACoNwvj1xegWTpw/4+Ww==',key_name='tempest-keypair-1583343724',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:22:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e99de7cef4b4569a497f77325515680',ramdisk_id='',reservation_id='r-69tg53on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-543930091',owner_user_name='tempest-AttachVolumeNegativeTest-543930091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497267775cc747b8b65b8bcb276806ba',uuid=cfb50bd6-42e6-4f8a-af8c-712e52644cb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "address": "fa:16:3e:44:5f:40", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08b7c03-51", "ovs_interfaceid": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:28:22 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converting VIF {"id": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "address": "fa:16:3e:44:5f:40", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape08b7c03-51", "ovs_interfaceid": "e08b7c03-51f2-450b-b639-a16cf0cd5214", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:5f:40,bridge_name='br-int',has_traffic_filtering=True,id=e08b7c03-51f2-450b-b639-a16cf0cd5214,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08b7c03-51') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG os_vif [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:5f:40,bridge_name='br-int',has_traffic_filtering=True,id=e08b7c03-51f2-450b-b639-a16cf0cd5214,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08b7c03-51') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape08b7c03-51, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f730341c-2b50-47e9-8c77-b9f569f124a7) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:23 user nova-compute[74311]: INFO os_vif [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:5f:40,bridge_name='br-int',has_traffic_filtering=True,id=e08b7c03-51f2-450b-b639-a16cf0cd5214,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape08b7c03-51')
Oct 20 10:28:23 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Deleting instance files /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5_del
Oct 20 10:28:23 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Deletion of /opt/stack/data/nova/instances/cfb50bd6-42e6-4f8a-af8c-712e52644cb5_del complete
Oct 20 10:28:23 user nova-compute[74311]: INFO nova.compute.manager [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 20 10:28:23 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.network.neutron [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Successfully updated port: 8cdf5a29-63ef-41f0-9b6b-482dd1de89ed {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Acquiring lock "refresh_cache-1eae0440-1736-4ea3-ba1c-65aa12fa1b56" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Acquired lock "refresh_cache-1eae0440-1736-4ea3-ba1c-65aa12fa1b56" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.network.neutron [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-f9d4f574-e423-4819-89b4-8dce9e5b29dd req-c53eb1f8-77a7-43bc-a1b5-59bf0d3d8f3e service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Received event network-changed-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-f9d4f574-e423-4819-89b4-8dce9e5b29dd req-c53eb1f8-77a7-43bc-a1b5-59bf0d3d8f3e service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Refreshing instance network info cache due to event network-changed-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f9d4f574-e423-4819-89b4-8dce9e5b29dd req-c53eb1f8-77a7-43bc-a1b5-59bf0d3d8f3e service nova] Acquiring lock "refresh_cache-1eae0440-1736-4ea3-ba1c-65aa12fa1b56" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.network.neutron [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.network.neutron [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Updating instance_info_cache with network_info: [{"id": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "address": "fa:16:3e:a9:b5:14", "network": {"id": "8cac5e04-624c-45f5-bbbd-b225b5ed1f7a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88a2448f77204da4b76f4108232814ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf5a29-63", "ovs_interfaceid": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Releasing lock "refresh_cache-1eae0440-1736-4ea3-ba1c-65aa12fa1b56" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Instance network_info: |[{"id": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "address": "fa:16:3e:a9:b5:14", "network": {"id": "8cac5e04-624c-45f5-bbbd-b225b5ed1f7a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88a2448f77204da4b76f4108232814ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf5a29-63", "ovs_interfaceid": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f9d4f574-e423-4819-89b4-8dce9e5b29dd req-c53eb1f8-77a7-43bc-a1b5-59bf0d3d8f3e service nova] Acquired lock "refresh_cache-1eae0440-1736-4ea3-ba1c-65aa12fa1b56" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.network.neutron [req-f9d4f574-e423-4819-89b4-8dce9e5b29dd req-c53eb1f8-77a7-43bc-a1b5-59bf0d3d8f3e service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Refreshing network info cache for port 8cdf5a29-63ef-41f0-9b6b-482dd1de89ed {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Start _get_guest_xml network_info=[{"id": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "address": "fa:16:3e:a9:b5:14", "network": {"id": "8cac5e04-624c-45f5-bbbd-b225b5ed1f7a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88a2448f77204da4b76f4108232814ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf5a29-63", "ovs_interfaceid": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:28:23 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:28:23 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1975358397',display_name='tempest-VolumesNegativeTest-instance-1975358397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1975358397',id=34,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6358c3ec703946d79426dae2da3dab09',ramdisk_id='',reservation_id='r-ma3y9h8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1768722303',owner_user_name='tempest-VolumesNegativeTest-1768722303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:28:21Z,user_data=None,user_id='7baad432e8e54918aabc660c72e94dc4',uuid=1eae0440-1736-4ea3-ba1c-65aa12fa1b56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "address": "fa:16:3e:a9:b5:14", "network": {"id": "8cac5e04-624c-45f5-bbbd-b225b5ed1f7a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88a2448f77204da4b76f4108232814ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf5a29-63", "ovs_interfaceid": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Converting VIF {"id": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "address": "fa:16:3e:a9:b5:14", "network": {"id": "8cac5e04-624c-45f5-bbbd-b225b5ed1f7a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88a2448f77204da4b76f4108232814ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf5a29-63", "ovs_interfaceid": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b5:14,bridge_name='br-int',has_traffic_filtering=True,id=8cdf5a29-63ef-41f0-9b6b-482dd1de89ed,network=Network(8cac5e04-624c-45f5-bbbd-b225b5ed1f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdf5a29-63') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.objects.instance [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lazy-loading 'pci_devices' on Instance uuid 1eae0440-1736-4ea3-ba1c-65aa12fa1b56 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:28:23 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Took 0.70 seconds to deallocate network for instance.
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:28:23 user nova-compute[74311]:   <uuid>1eae0440-1736-4ea3-ba1c-65aa12fa1b56</uuid>
Oct 20 10:28:23 user nova-compute[74311]:   <name>instance-00000022</name>
Oct 20 10:28:23 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:28:23 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:28:23 user nova-compute[74311]:   <metadata>
Oct 20 10:28:23 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:28:23 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:28:23 user nova-compute[74311]:       <nova:name>tempest-VolumesNegativeTest-instance-1975358397</nova:name>
Oct 20 10:28:23 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:28:23</nova:creationTime>
Oct 20 10:28:23 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:28:23 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:28:23 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:28:23 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:28:23 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:28:23 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:28:23 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:28:23 user nova-compute[74311]:       <nova:owner>
Oct 20 10:28:23 user nova-compute[74311]:         <nova:user uuid="7baad432e8e54918aabc660c72e94dc4">tempest-VolumesNegativeTest-1768722303-project-member</nova:user>
Oct 20 10:28:23 user nova-compute[74311]:         <nova:project uuid="6358c3ec703946d79426dae2da3dab09">tempest-VolumesNegativeTest-1768722303</nova:project>
Oct 20 10:28:23 user nova-compute[74311]:       </nova:owner>
Oct 20 10:28:23 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:28:23 user nova-compute[74311]:       <nova:ports>
Oct 20 10:28:23 user nova-compute[74311]:         <nova:port uuid="8cdf5a29-63ef-41f0-9b6b-482dd1de89ed">
Oct 20 10:28:23 user nova-compute[74311]:           <nova:ip type="fixed" address="192.168.233.23" ipVersion="4"/>
Oct 20 10:28:23 user nova-compute[74311]:         </nova:port>
Oct 20 10:28:23 user nova-compute[74311]:       </nova:ports>
Oct 20 10:28:23 user nova-compute[74311]:     </nova:instance>
Oct 20 10:28:23 user nova-compute[74311]:   </metadata>
Oct 20 10:28:23 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:28:23 user nova-compute[74311]:     <system>
Oct 20 10:28:23 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:28:23 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:28:23 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:28:23 user nova-compute[74311]:       <entry name="serial">1eae0440-1736-4ea3-ba1c-65aa12fa1b56</entry>
Oct 20 10:28:23 user nova-compute[74311]:       <entry name="uuid">1eae0440-1736-4ea3-ba1c-65aa12fa1b56</entry>
Oct 20 10:28:23 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:28:23 user nova-compute[74311]:     </system>
Oct 20 10:28:23 user nova-compute[74311]:   </sysinfo>
Oct 20 10:28:23 user nova-compute[74311]:   <os>
Oct 20 10:28:23 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:28:23 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:28:23 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:28:23 user nova-compute[74311]:   </os>
Oct 20 10:28:23 user nova-compute[74311]:   <features>
Oct 20 10:28:23 user nova-compute[74311]:     <acpi/>
Oct 20 10:28:23 user nova-compute[74311]:     <apic/>
Oct 20 10:28:23 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:28:23 user nova-compute[74311]:   </features>
Oct 20 10:28:23 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:28:23 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:28:23 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:28:23 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:28:23 user nova-compute[74311]:   </clock>
Oct 20 10:28:23 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:28:23 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:28:23 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:28:23 user nova-compute[74311]:   </cpu>
Oct 20 10:28:23 user nova-compute[74311]:   <devices>
Oct 20 10:28:23 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:28:23 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:28:23 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/disk"/>
Oct 20 10:28:23 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:28:23 user nova-compute[74311]:     </disk>
Oct 20 10:28:23 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:28:23 user nova-compute[74311]:       <mac address="fa:16:3e:a9:b5:14"/>
Oct 20 10:28:23 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:28:23 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:28:23 user nova-compute[74311]:       <target dev="tap8cdf5a29-63"/>
Oct 20 10:28:23 user nova-compute[74311]:     </interface>
Oct 20 10:28:23 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:28:23 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/console.log" append="off"/>
Oct 20 10:28:23 user nova-compute[74311]:     </serial>
Oct 20 10:28:23 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:28:23 user nova-compute[74311]:     <video>
Oct 20 10:28:23 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:28:23 user nova-compute[74311]:     </video>
Oct 20 10:28:23 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:28:23 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:28:23 user nova-compute[74311]:     </rng>
Oct 20 10:28:23 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:28:23 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:28:23 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:28:23 user nova-compute[74311]:     </memballoon>
Oct 20 10:28:23 user nova-compute[74311]:   </devices>
Oct 20 10:28:23 user nova-compute[74311]: </domain>
Oct 20 10:28:23 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1975358397',display_name='tempest-VolumesNegativeTest-instance-1975358397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1975358397',id=34,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6358c3ec703946d79426dae2da3dab09',ramdisk_id='',reservation_id='r-ma3y9h8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1768722303',owner_user_name='tempest-VolumesNegativeTest-1768722303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:28:21Z,user_data=None,user_id='7baad432e8e54918aabc660c72e94dc4',uuid=1eae0440-1736-4ea3-ba1c-65aa12fa1b56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "address": "fa:16:3e:a9:b5:14", "network": {"id": "8cac5e04-624c-45f5-bbbd-b225b5ed1f7a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88a2448f77204da4b76f4108232814ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf5a29-63", "ovs_interfaceid": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Converting VIF {"id": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "address": "fa:16:3e:a9:b5:14", "network": {"id": "8cac5e04-624c-45f5-bbbd-b225b5ed1f7a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88a2448f77204da4b76f4108232814ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf5a29-63", "ovs_interfaceid": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b5:14,bridge_name='br-int',has_traffic_filtering=True,id=8cdf5a29-63ef-41f0-9b6b-482dd1de89ed,network=Network(8cac5e04-624c-45f5-bbbd-b225b5ed1f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdf5a29-63') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG os_vif [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b5:14,bridge_name='br-int',has_traffic_filtering=True,id=8cdf5a29-63ef-41f0-9b6b-482dd1de89ed,network=Network(8cac5e04-624c-45f5-bbbd-b225b5ed1f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdf5a29-63') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a665a02-816d-5f87-97f0-c00c9cb0aaf3', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cdf5a29-63, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cdf5a29-63, col_values=(('qos', UUID('45940d66-d2e4-4fe8-bf24-586bcb7f7aac')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cdf5a29-63, col_values=(('external_ids', {'iface-id': '8cdf5a29-63ef-41f0-9b6b-482dd1de89ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:b5:14', 'vm-uuid': '1eae0440-1736-4ea3-ba1c-65aa12fa1b56'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:23 user nova-compute[74311]: INFO os_vif [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b5:14,bridge_name='br-int',has_traffic_filtering=True,id=8cdf5a29-63ef-41f0-9b6b-482dd1de89ed,network=Network(8cac5e04-624c-45f5-bbbd-b225b5ed1f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdf5a29-63')
Oct 20 10:28:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:28:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] No VIF found with MAC fa:16:3e:a9:b5:14, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:28:24 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:28:24 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 10:28:24 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] There are 0 instances to clean {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 10:28:24 user nova-compute[74311]: DEBUG nova.network.neutron [req-f9d4f574-e423-4819-89b4-8dce9e5b29dd req-c53eb1f8-77a7-43bc-a1b5-59bf0d3d8f3e service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Updated VIF entry in instance network info cache for port 8cdf5a29-63ef-41f0-9b6b-482dd1de89ed. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:28:24 user nova-compute[74311]: DEBUG nova.network.neutron [req-f9d4f574-e423-4819-89b4-8dce9e5b29dd req-c53eb1f8-77a7-43bc-a1b5-59bf0d3d8f3e service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Updating instance_info_cache with network_info: [{"id": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "address": "fa:16:3e:a9:b5:14", "network": {"id": "8cac5e04-624c-45f5-bbbd-b225b5ed1f7a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88a2448f77204da4b76f4108232814ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf5a29-63", "ovs_interfaceid": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:28:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f9d4f574-e423-4819-89b4-8dce9e5b29dd req-c53eb1f8-77a7-43bc-a1b5-59bf0d3d8f3e service nova] Releasing lock "refresh_cache-1eae0440-1736-4ea3-ba1c-65aa12fa1b56" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:28:24 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:28:24 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:28:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:24 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Deleted allocations for instance cfb50bd6-42e6-4f8a-af8c-712e52644cb5
Oct 20 10:28:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-affb843b-fbeb-4ce5-a9df-0698545e4045 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.379s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-c4281680-dd8a-423f-bda9-38026d23a89e req-7ebef97f-69f6-45fb-9726-e2104c0b42e0 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Received event network-vif-plugged-e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c4281680-dd8a-423f-bda9-38026d23a89e req-7ebef97f-69f6-45fb-9726-e2104c0b42e0 service nova] Acquiring lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c4281680-dd8a-423f-bda9-38026d23a89e req-7ebef97f-69f6-45fb-9726-e2104c0b42e0 service nova] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c4281680-dd8a-423f-bda9-38026d23a89e req-7ebef97f-69f6-45fb-9726-e2104c0b42e0 service nova] Lock "cfb50bd6-42e6-4f8a-af8c-712e52644cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-c4281680-dd8a-423f-bda9-38026d23a89e req-7ebef97f-69f6-45fb-9726-e2104c0b42e0 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] No waiting events found dispatching network-vif-plugged-e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:24 user nova-compute[74311]: WARNING nova.compute.manager [req-c4281680-dd8a-423f-bda9-38026d23a89e req-7ebef97f-69f6-45fb-9726-e2104c0b42e0 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Received unexpected event network-vif-plugged-e08b7c03-51f2-450b-b639-a16cf0cd5214 for instance with vm_state deleted and task_state None.
Oct 20 10:28:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-c4281680-dd8a-423f-bda9-38026d23a89e req-7ebef97f-69f6-45fb-9726-e2104c0b42e0 service nova] [instance: cfb50bd6-42e6-4f8a-af8c-712e52644cb5] Received event network-vif-deleted-e08b7c03-51f2-450b-b639-a16cf0cd5214 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-aab26093-6e2d-45b3-8cf1-4c52c4f7cadc req-db772c14-156b-440a-9de7-af184df774c2 service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Received event network-vif-plugged-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-aab26093-6e2d-45b3-8cf1-4c52c4f7cadc req-db772c14-156b-440a-9de7-af184df774c2 service nova] Acquiring lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-aab26093-6e2d-45b3-8cf1-4c52c4f7cadc req-db772c14-156b-440a-9de7-af184df774c2 service nova] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-aab26093-6e2d-45b3-8cf1-4c52c4f7cadc req-db772c14-156b-440a-9de7-af184df774c2 service nova] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-aab26093-6e2d-45b3-8cf1-4c52c4f7cadc req-db772c14-156b-440a-9de7-af184df774c2 service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] No waiting events found dispatching network-vif-plugged-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:25 user nova-compute[74311]: WARNING nova.compute.manager [req-aab26093-6e2d-45b3-8cf1-4c52c4f7cadc req-db772c14-156b-440a-9de7-af184df774c2 service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Received unexpected event network-vif-plugged-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed for instance with vm_state building and task_state spawning.
Oct 20 10:28:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-2d989841-17c0-4644-af35-603f0a655390 req-f282b149-03b6-42e0-9f7c-22d254f13daa service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-changed-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-2d989841-17c0-4644-af35-603f0a655390 req-f282b149-03b6-42e0-9f7c-22d254f13daa service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Refreshing instance network info cache due to event network-changed-3e3e5d7a-8868-4b3f-b874-62faba374f3b. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:28:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2d989841-17c0-4644-af35-603f0a655390 req-f282b149-03b6-42e0-9f7c-22d254f13daa service nova] Acquiring lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:28:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2d989841-17c0-4644-af35-603f0a655390 req-f282b149-03b6-42e0-9f7c-22d254f13daa service nova] Acquired lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:28:26 user nova-compute[74311]: DEBUG nova.network.neutron [req-2d989841-17c0-4644-af35-603f0a655390 req-f282b149-03b6-42e0-9f7c-22d254f13daa service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Refreshing network info cache for port 3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:28:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:26 user nova-compute[74311]: DEBUG nova.objects.instance [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'flavor' on Instance uuid ce052ea1-5937-43d6-9ff9-694ff15b7f3e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:28:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:27 user nova-compute[74311]: INFO nova.compute.manager [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Attaching volume a2c32e3c-4140-4758-8553-022bf9bed478 to /dev/vdb
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.network.neutron [req-2d989841-17c0-4644-af35-603f0a655390 req-f282b149-03b6-42e0-9f7c-22d254f13daa service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updated VIF entry in instance network info cache for port 3e3e5d7a-8868-4b3f-b874-62faba374f3b. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.network.neutron [req-2d989841-17c0-4644-af35-603f0a655390 req-f282b149-03b6-42e0-9f7c-22d254f13daa service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updating instance_info_cache with network_info: [{"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2d989841-17c0-4644-af35-603f0a655390 req-f282b149-03b6-42e0-9f7c-22d254f13daa service nova] Releasing lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG os_brick.utils [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3120575-9cfb-472e-b6d0-311d46e7f058]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e53e8f-6d0a-4f81-8e06-7a9636343a63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f8ec1e-3fb2-47a4-a277-32d70d1fc72e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb54baa-3687-4eb1-b3a7-9ad36da799c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:28:27 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c6c308-d27b-432d-9641-083295c5c938]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG os_brick.utils [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updating existing volume attachment record: c898b33b-9ac5-499b-be9f-4fe7f8e39491 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-0ca3d840-8c64-4036-9a4a-44d41e4348db req-8b5c8407-b195-4181-9a3f-011dcd318af4 service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Received event network-vif-plugged-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0ca3d840-8c64-4036-9a4a-44d41e4348db req-8b5c8407-b195-4181-9a3f-011dcd318af4 service nova] Acquiring lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0ca3d840-8c64-4036-9a4a-44d41e4348db req-8b5c8407-b195-4181-9a3f-011dcd318af4 service nova] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0ca3d840-8c64-4036-9a4a-44d41e4348db req-8b5c8407-b195-4181-9a3f-011dcd318af4 service nova] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-0ca3d840-8c64-4036-9a4a-44d41e4348db req-8b5c8407-b195-4181-9a3f-011dcd318af4 service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] No waiting events found dispatching network-vif-plugged-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:27 user nova-compute[74311]: WARNING nova.compute.manager [req-0ca3d840-8c64-4036-9a4a-44d41e4348db req-8b5c8407-b195-4181-9a3f-011dcd318af4 service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Received unexpected event network-vif-plugged-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed for instance with vm_state building and task_state spawning.
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:28:27 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Instance spawned successfully.
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:28:27 user nova-compute[74311]: INFO nova.compute.manager [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Took 6.87 seconds to spawn the instance on the hypervisor.
Oct 20 10:28:27 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:28:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:28:28 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74311) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 10:28:28 user nova-compute[74311]: INFO nova.compute.manager [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Took 7.84 seconds to build instance.
Oct 20 10:28:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5529037c-d393-496b-a92c-57ceba421a67 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.955s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "00f57349-a3b2-49a1-99f9-97510634f3b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:28:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:39 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:28:39 user nova-compute[74311]: INFO nova.compute.claims [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Claim successful on node user
Oct 20 10:28:39 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:28:39 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:28:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:28:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:28:39 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:28:39 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:28:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:28:39 user nova-compute[74311]: DEBUG nova.policy [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3599c6c5ec984a3599dbdd732ffd0977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f725dba626242d6ada4ccceab72c55c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:28:40 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Creating image(s)
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "/opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "/opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "/opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.235s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk 1073741824" returned: 0 in 0.054s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Successfully created port: ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.208s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Cannot resize image /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Ensure instance console log exists: /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Successfully updated port: ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "refresh_cache-00f57349-a3b2-49a1-99f9-97510634f3b0" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquired lock "refresh_cache-00f57349-a3b2-49a1-99f9-97510634f3b0" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-74a1807c-be6a-4b22-9f7d-161956566421 req-070a1e30-afad-4730-8190-24bcc28b5c28 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Received event network-changed-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-74a1807c-be6a-4b22-9f7d-161956566421 req-070a1e30-afad-4730-8190-24bcc28b5c28 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Refreshing instance network info cache due to event network-changed-ebe77cc0-8ca0-4dd5-bca5-dc0794962702. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-74a1807c-be6a-4b22-9f7d-161956566421 req-070a1e30-afad-4730-8190-24bcc28b5c28 service nova] Acquiring lock "refresh_cache-00f57349-a3b2-49a1-99f9-97510634f3b0" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Updating instance_info_cache with network_info: [{"id": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "address": "fa:16:3e:15:db:5c", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe77cc0-8c", "ovs_interfaceid": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Releasing lock "refresh_cache-00f57349-a3b2-49a1-99f9-97510634f3b0" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Instance network_info: |[{"id": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "address": "fa:16:3e:15:db:5c", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe77cc0-8c", "ovs_interfaceid": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-74a1807c-be6a-4b22-9f7d-161956566421 req-070a1e30-afad-4730-8190-24bcc28b5c28 service nova] Acquired lock "refresh_cache-00f57349-a3b2-49a1-99f9-97510634f3b0" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.network.neutron [req-74a1807c-be6a-4b22-9f7d-161956566421 req-070a1e30-afad-4730-8190-24bcc28b5c28 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Refreshing network info cache for port ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Start _get_guest_xml network_info=[{"id": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "address": "fa:16:3e:15:db:5c", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe77cc0-8c", "ovs_interfaceid": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:28:41 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:28:41 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:28:41 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-650401654',display_name='tempest-AttachVolumeTestJSON-server-650401654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-650401654',id=35,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvjo82/ZL1p3p/pupx6h5Y6ehQwOdE3alS24LRXUXUNpGw6Mg7lgbIvwSyJGXZDy36jn5ShVHT0rnmlez6zmaobYJMfAkGNtHfm8gL1U9r9HAw5UgGC3vudZapf3h7MZg==',key_name='tempest-keypair-498238364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f725dba626242d6ada4ccceab72c55c',ramdisk_id='',reservation_id='r-404gl9wb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1992975846',owner_user_name='tempest-AttachVolumeTestJSON-1992975846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3599c6c5ec984a3599dbdd732ffd0977',uuid=00f57349-a3b2-49a1-99f9-97510634f3b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "address": "fa:16:3e:15:db:5c", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe77cc0-8c", "ovs_interfaceid": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converting VIF {"id": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "address": "fa:16:3e:15:db:5c", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe77cc0-8c", "ovs_interfaceid": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:5c,bridge_name='br-int',has_traffic_filtering=True,id=ebe77cc0-8ca0-4dd5-bca5-dc0794962702,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe77cc0-8c') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG nova.objects.instance [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'pci_devices' on Instance uuid 00f57349-a3b2-49a1-99f9-97510634f3b0 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:28:42 user nova-compute[74311]:   <uuid>00f57349-a3b2-49a1-99f9-97510634f3b0</uuid>
Oct 20 10:28:42 user nova-compute[74311]:   <name>instance-00000023</name>
Oct 20 10:28:42 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:28:42 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:28:42 user nova-compute[74311]:   <metadata>
Oct 20 10:28:42 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:28:42 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:28:42 user nova-compute[74311]:       <nova:name>tempest-AttachVolumeTestJSON-server-650401654</nova:name>
Oct 20 10:28:42 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:28:41</nova:creationTime>
Oct 20 10:28:42 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:28:42 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:28:42 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:28:42 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:28:42 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:28:42 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:28:42 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:28:42 user nova-compute[74311]:       <nova:owner>
Oct 20 10:28:42 user nova-compute[74311]:         <nova:user uuid="3599c6c5ec984a3599dbdd732ffd0977">tempest-AttachVolumeTestJSON-1992975846-project-member</nova:user>
Oct 20 10:28:42 user nova-compute[74311]:         <nova:project uuid="5f725dba626242d6ada4ccceab72c55c">tempest-AttachVolumeTestJSON-1992975846</nova:project>
Oct 20 10:28:42 user nova-compute[74311]:       </nova:owner>
Oct 20 10:28:42 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:28:42 user nova-compute[74311]:       <nova:ports>
Oct 20 10:28:42 user nova-compute[74311]:         <nova:port uuid="ebe77cc0-8ca0-4dd5-bca5-dc0794962702">
Oct 20 10:28:42 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 10:28:42 user nova-compute[74311]:         </nova:port>
Oct 20 10:28:42 user nova-compute[74311]:       </nova:ports>
Oct 20 10:28:42 user nova-compute[74311]:     </nova:instance>
Oct 20 10:28:42 user nova-compute[74311]:   </metadata>
Oct 20 10:28:42 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:28:42 user nova-compute[74311]:     <system>
Oct 20 10:28:42 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:28:42 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:28:42 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:28:42 user nova-compute[74311]:       <entry name="serial">00f57349-a3b2-49a1-99f9-97510634f3b0</entry>
Oct 20 10:28:42 user nova-compute[74311]:       <entry name="uuid">00f57349-a3b2-49a1-99f9-97510634f3b0</entry>
Oct 20 10:28:42 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:28:42 user nova-compute[74311]:     </system>
Oct 20 10:28:42 user nova-compute[74311]:   </sysinfo>
Oct 20 10:28:42 user nova-compute[74311]:   <os>
Oct 20 10:28:42 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:28:42 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:28:42 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:28:42 user nova-compute[74311]:   </os>
Oct 20 10:28:42 user nova-compute[74311]:   <features>
Oct 20 10:28:42 user nova-compute[74311]:     <acpi/>
Oct 20 10:28:42 user nova-compute[74311]:     <apic/>
Oct 20 10:28:42 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:28:42 user nova-compute[74311]:   </features>
Oct 20 10:28:42 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:28:42 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:28:42 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:28:42 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:28:42 user nova-compute[74311]:   </clock>
Oct 20 10:28:42 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:28:42 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:28:42 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:28:42 user nova-compute[74311]:   </cpu>
Oct 20 10:28:42 user nova-compute[74311]:   <devices>
Oct 20 10:28:42 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:28:42 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:28:42 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk"/>
Oct 20 10:28:42 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:28:42 user nova-compute[74311]:     </disk>
Oct 20 10:28:42 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:28:42 user nova-compute[74311]:       <mac address="fa:16:3e:15:db:5c"/>
Oct 20 10:28:42 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:28:42 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:28:42 user nova-compute[74311]:       <target dev="tapebe77cc0-8c"/>
Oct 20 10:28:42 user nova-compute[74311]:     </interface>
Oct 20 10:28:42 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:28:42 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/console.log" append="off"/>
Oct 20 10:28:42 user nova-compute[74311]:     </serial>
Oct 20 10:28:42 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:28:42 user nova-compute[74311]:     <video>
Oct 20 10:28:42 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:28:42 user nova-compute[74311]:     </video>
Oct 20 10:28:42 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:28:42 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:28:42 user nova-compute[74311]:     </rng>
Oct 20 10:28:42 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:28:42 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:28:42 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:28:42 user nova-compute[74311]:     </memballoon>
Oct 20 10:28:42 user nova-compute[74311]:   </devices>
Oct 20 10:28:42 user nova-compute[74311]: </domain>
Oct 20 10:28:42 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-650401654',display_name='tempest-AttachVolumeTestJSON-server-650401654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-650401654',id=35,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvjo82/ZL1p3p/pupx6h5Y6ehQwOdE3alS24LRXUXUNpGw6Mg7lgbIvwSyJGXZDy36jn5ShVHT0rnmlez6zmaobYJMfAkGNtHfm8gL1U9r9HAw5UgGC3vudZapf3h7MZg==',key_name='tempest-keypair-498238364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f725dba626242d6ada4ccceab72c55c',ramdisk_id='',reservation_id='r-404gl9wb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1992975846',owner_user_name='tempest-AttachVolumeTestJSON-1992975846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3599c6c5ec984a3599dbdd732ffd0977',uuid=00f57349-a3b2-49a1-99f9-97510634f3b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "address": "fa:16:3e:15:db:5c", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe77cc0-8c", "ovs_interfaceid": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converting VIF {"id": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "address": "fa:16:3e:15:db:5c", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe77cc0-8c", "ovs_interfaceid": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:5c,bridge_name='br-int',has_traffic_filtering=True,id=ebe77cc0-8ca0-4dd5-bca5-dc0794962702,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe77cc0-8c') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG os_vif [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:5c,bridge_name='br-int',has_traffic_filtering=True,id=ebe77cc0-8ca0-4dd5-bca5-dc0794962702,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe77cc0-8c') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99297d20-c015-5682-a9df-8b1d7bd066f8', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebe77cc0-8c, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebe77cc0-8c, col_values=(('qos', UUID('863fc408-a3ee-4fa4-8763-8ef7dad68571')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebe77cc0-8c, col_values=(('external_ids', {'iface-id': 'ebe77cc0-8ca0-4dd5-bca5-dc0794962702', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:db:5c', 'vm-uuid': '00f57349-a3b2-49a1-99f9-97510634f3b0'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:42 user nova-compute[74311]: INFO os_vif [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:db:5c,bridge_name='br-int',has_traffic_filtering=True,id=ebe77cc0-8ca0-4dd5-bca5-dc0794962702,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe77cc0-8c')
Oct 20 10:28:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] No VIF found with MAC fa:16:3e:15:db:5c, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG nova.network.neutron [req-74a1807c-be6a-4b22-9f7d-161956566421 req-070a1e30-afad-4730-8190-24bcc28b5c28 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Updated VIF entry in instance network info cache for port ebe77cc0-8ca0-4dd5-bca5-dc0794962702. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG nova.network.neutron [req-74a1807c-be6a-4b22-9f7d-161956566421 req-070a1e30-afad-4730-8190-24bcc28b5c28 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Updating instance_info_cache with network_info: [{"id": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "address": "fa:16:3e:15:db:5c", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe77cc0-8c", "ovs_interfaceid": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:28:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-74a1807c-be6a-4b22-9f7d-161956566421 req-070a1e30-afad-4730-8190-24bcc28b5c28 service nova] Releasing lock "refresh_cache-00f57349-a3b2-49a1-99f9-97510634f3b0" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:28:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-6328351f-f74a-42ff-bfa4-409f6385da1b req-61fcfae0-9b5a-49e5-a327-07fd1fd74ac1 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Received event network-vif-plugged-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6328351f-f74a-42ff-bfa4-409f6385da1b req-61fcfae0-9b5a-49e5-a327-07fd1fd74ac1 service nova] Acquiring lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6328351f-f74a-42ff-bfa4-409f6385da1b req-61fcfae0-9b5a-49e5-a327-07fd1fd74ac1 service nova] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6328351f-f74a-42ff-bfa4-409f6385da1b req-61fcfae0-9b5a-49e5-a327-07fd1fd74ac1 service nova] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-6328351f-f74a-42ff-bfa4-409f6385da1b req-61fcfae0-9b5a-49e5-a327-07fd1fd74ac1 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] No waiting events found dispatching network-vif-plugged-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:43 user nova-compute[74311]: WARNING nova.compute.manager [req-6328351f-f74a-42ff-bfa4-409f6385da1b req-61fcfae0-9b5a-49e5-a327-07fd1fd74ac1 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Received unexpected event network-vif-plugged-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 for instance with vm_state building and task_state spawning.
Oct 20 10:28:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBLXuRZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:28:45 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:28:45 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:28:45 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[527b9226-3fef-4669-bb3d-d91723a56fd8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:28:45 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dc09c4-7dbf-4b02-9279-a2859f9df309]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478] added
Oct 20 10:28:45 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[35336309-d011-4a18-bca2-f4fe12187eb6]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97ebf46-03fe-497d-b02e-1fa939c3f1ec]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBLXuRZy {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBLXuRZy" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32332e8-c8a0-453c-a70e-62617d152f89]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pBLXuRZy'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1524a32-89ce-4ffa-95b4-9261724c47f7]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1b74a3-a13a-4b49-a93e-89ec42c4c350]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:28:45 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:28:45 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:28:45 user nova-compute[74311]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:28:45 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:28:45 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:28:45 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:28:45 user nova-compute[74311]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:28:45 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[882fdc78-c6e2-4a4c-a1d5-799957706d4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478, portal: 172.16.0.220,3260]
Oct 20 10:28:45 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478, portal: 172.16.0.220,3260] successful.
Oct 20 10:28:45 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a78cc25-42ff-4a84-bea9-f806c7afc6da]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e89a07-7e1f-4865-bfc4-c2debdd5af16]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:28:45 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:28:45 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:28:45 user nova-compute[74311]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:28:45 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:28:45 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:28:45 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:28:45 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:28:45 user nova-compute[74311]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:28:45 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:28:45 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-ce6b496b-f9d0-45ae-b860-2eb3bb6483c8 req-b26ff1bc-81fc-4d24-8f93-362b5998c0e3 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Received event network-vif-plugged-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ce6b496b-f9d0-45ae-b860-2eb3bb6483c8 req-b26ff1bc-81fc-4d24-8f93-362b5998c0e3 service nova] Acquiring lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ce6b496b-f9d0-45ae-b860-2eb3bb6483c8 req-b26ff1bc-81fc-4d24-8f93-362b5998c0e3 service nova] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ce6b496b-f9d0-45ae-b860-2eb3bb6483c8 req-b26ff1bc-81fc-4d24-8f93-362b5998c0e3 service nova] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-ce6b496b-f9d0-45ae-b860-2eb3bb6483c8 req-b26ff1bc-81fc-4d24-8f93-362b5998c0e3 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] No waiting events found dispatching network-vif-plugged-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:45 user nova-compute[74311]: WARNING nova.compute.manager [req-ce6b496b-f9d0-45ae-b860-2eb3bb6483c8 req-b26ff1bc-81fc-4d24-8f93-362b5998c0e3 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Received unexpected event network-vif-plugged-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 for instance with vm_state building and task_state spawning.
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[506484f3-02fa-42ca-82f5-783f055fa7cf]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBLXuRZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:28:45 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Instance spawned successfully.
Oct 20 10:28:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:28:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:28:45 user nova-compute[74311]: INFO nova.compute.manager [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Took 5.94 seconds to spawn the instance on the hypervisor.
Oct 20 10:28:46 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:28:46 user nova-compute[74311]: INFO nova.compute.manager [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Took 6.86 seconds to build instance.
Oct 20 10:28:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0bde4e76-0b5d-4498-986d-dfac35fce6c7 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.978s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:28:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23462343538623134', 'path': '/dev/sde'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:28:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462343538623134', 'path': '/dev/sde'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:28:46 user nova-compute[74311]: DEBUG nova.objects.instance [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'flavor' on Instance uuid ce052ea1-5937-43d6-9ff9-694ff15b7f3e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:28:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:28:46 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:28:46 user nova-compute[74311]:   <source dev="/dev/sde"/>
Oct 20 10:28:46 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:28:46 user nova-compute[74311]:   <serial>a2c32e3c-4140-4758-8553-022bf9bed478</serial>
Oct 20 10:28:46 user nova-compute[74311]: </disk>
Oct 20 10:28:46 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No VIF found with MAC fa:16:3e:ce:fd:01, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62190132-384d-415b-8f54-f4e865fa9891 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.217s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-29e59f07-37cc-4c87-8714-0f730ed2e996 req-c5a56000-360d-405b-978d-071918de8317 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received event volume-reimaged-9d865eed-f501-4a9b-a4f2-8fd737339548 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-29e59f07-37cc-4c87-8714-0f730ed2e996 req-c5a56000-360d-405b-978d-071918de8317 service nova] Acquiring lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-29e59f07-37cc-4c87-8714-0f730ed2e996 req-c5a56000-360d-405b-978d-071918de8317 service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-29e59f07-37cc-4c87-8714-0f730ed2e996 req-c5a56000-360d-405b-978d-071918de8317 service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-29e59f07-37cc-4c87-8714-0f730ed2e996 req-c5a56000-360d-405b-978d-071918de8317 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Processing event volume-reimaged-9d865eed-f501-4a9b-a4f2-8fd737339548 {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG nova.compute.manager [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Instance event wait completed in 27 seconds for volume-reimaged {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:28:47 user nova-compute[74311]: INFO nova.virt.block_device [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Booting with volume 9d865eed-f501-4a9b-a4f2-8fd737339548 at /dev/vda
Oct 20 10:28:47 user nova-compute[74311]: DEBUG os_brick.utils [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[72980732-8d14-41ef-bda7-3f880ef90650]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d42f39-070d-4393-b4d8-73006bdf6cec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[62012bbe-004a-40df-8348-b6db1bb84416]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5763cf2-3f29-4ea4-8507-87ccee1e465e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:28:47 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0406cc-d4d5-403f-9a1f-631bbdb58718]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG os_brick.utils [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Updating existing volume attachment record: b8d2238b-cb0b-41f8-830e-1c059470671b {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:28:47 user nova-compute[74311]: INFO nova.compute.manager [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Rescuing
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquired lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:28:47 user nova-compute[74311]: DEBUG nova.network.neutron [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:28:48 user nova-compute[74311]: DEBUG nova.network.neutron [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updating instance_info_cache with network_info: [{"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:28:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Releasing lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:28:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:48 user nova-compute[74311]: DEBUG nova.compute.manager [req-0c02c3af-790e-4512-8364-bc62e6d3f32b req-2a89e891-6e3f-40bf-861a-25b542c931d1 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-vif-unplugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0c02c3af-790e-4512-8364-bc62e6d3f32b req-2a89e891-6e3f-40bf-861a-25b542c931d1 service nova] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0c02c3af-790e-4512-8364-bc62e6d3f32b req-2a89e891-6e3f-40bf-861a-25b542c931d1 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0c02c3af-790e-4512-8364-bc62e6d3f32b req-2a89e891-6e3f-40bf-861a-25b542c931d1 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:48 user nova-compute[74311]: DEBUG nova.compute.manager [req-0c02c3af-790e-4512-8364-bc62e6d3f32b req-2a89e891-6e3f-40bf-861a-25b542c931d1 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] No waiting events found dispatching network-vif-unplugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:48 user nova-compute[74311]: WARNING nova.compute.manager [req-0c02c3af-790e-4512-8364-bc62e6d3f32b req-2a89e891-6e3f-40bf-861a-25b542c931d1 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received unexpected event network-vif-unplugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b for instance with vm_state active and task_state rescuing.
Oct 20 10:28:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:49 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Instance destroyed successfully.
Oct 20 10:28:49 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Attempting rescue
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74311) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Instance directory exists: not creating {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 10:28:49 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Creating image(s)
Oct 20 10:28:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "/opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "/opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'trusted_certs' on Instance uuid ce052ea1-5937-43d6-9ff9-694ff15b7f3e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.rescue {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.rescue" returned: 0 in 0.049s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'migration_context' on Instance uuid ce052ea1-5937-43d6-9ff9-694ff15b7f3e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.objects.base [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<ce052ea1-5937-43d6-9ff9-694ff15b7f3e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Start _get_guest_xml network_info=[{"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "vif_mac": "fa:16:3e:ce:fd:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'resources' on Instance uuid ce052ea1-5937-43d6-9ff9-694ff15b7f3e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.objects.base [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<ce052ea1-5937-43d6-9ff9-694ff15b7f3e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'numa_topology' on Instance uuid ce052ea1-5937-43d6-9ff9-694ff15b7f3e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.objects.base [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<ce052ea1-5937-43d6-9ff9-694ff15b7f3e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:28:49 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:28:49 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'vcpu_model' on Instance uuid ce052ea1-5937-43d6-9ff9-694ff15b7f3e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.objects.base [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<ce052ea1-5937-43d6-9ff9-694ff15b7f3e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1295854338',display_name='tempest-ServerRescueNegativeTestJSON-server-1295854338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1295854338',id=32,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyu5kH6h3CMySukZ4xYw3WRv8PPFiosuSGC1QUW+H0JC2aBbjS8QlGQc+KOukJmdnZqV8LAzxGqK3l3vxdKR4Exoa6KSvU7gjrjaAd92zAtyVLhJNetUMdmWcoXhIfgjA==',key_name='tempest-keypair-793510087',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07b7c2a684a3466eba4799473c725066',ramdisk_id='',reservation_id='r-7gmb5360',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-320006607',owner_user_name='tempest-ServerRescueNegativeTestJSON-320006607-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:26:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302a265253b14a19be48546953baaebf',uuid=ce052ea1-5937-43d6-9ff9-694ff15b7f3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "vif_mac": "fa:16:3e:ce:fd:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converting VIF {"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "vif_mac": "fa:16:3e:ce:fd:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=3e3e5d7a-8868-4b3f-b874-62faba374f3b,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3e5d7a-88') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'pci_devices' on Instance uuid ce052ea1-5937-43d6-9ff9-694ff15b7f3e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.objects.base [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Object Instance<ce052ea1-5937-43d6-9ff9-694ff15b7f3e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:28:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:28:49 user nova-compute[74311]:   <uuid>ce052ea1-5937-43d6-9ff9-694ff15b7f3e</uuid>
Oct 20 10:28:49 user nova-compute[74311]:   <name>instance-00000020</name>
Oct 20 10:28:49 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:28:49 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:28:49 user nova-compute[74311]:   <metadata>
Oct 20 10:28:49 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:28:49 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:28:49 user nova-compute[74311]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1295854338</nova:name>
Oct 20 10:28:49 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:28:49</nova:creationTime>
Oct 20 10:28:49 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:28:49 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:28:49 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:28:49 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:28:49 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:28:49 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:28:49 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:28:49 user nova-compute[74311]:       <nova:owner>
Oct 20 10:28:49 user nova-compute[74311]:         <nova:user uuid="302a265253b14a19be48546953baaebf">tempest-ServerRescueNegativeTestJSON-320006607-project-member</nova:user>
Oct 20 10:28:49 user nova-compute[74311]:         <nova:project uuid="07b7c2a684a3466eba4799473c725066">tempest-ServerRescueNegativeTestJSON-320006607</nova:project>
Oct 20 10:28:49 user nova-compute[74311]:       </nova:owner>
Oct 20 10:28:49 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:28:49 user nova-compute[74311]:       <nova:ports>
Oct 20 10:28:49 user nova-compute[74311]:         <nova:port uuid="3e3e5d7a-8868-4b3f-b874-62faba374f3b">
Oct 20 10:28:49 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 10:28:49 user nova-compute[74311]:         </nova:port>
Oct 20 10:28:49 user nova-compute[74311]:       </nova:ports>
Oct 20 10:28:49 user nova-compute[74311]:     </nova:instance>
Oct 20 10:28:49 user nova-compute[74311]:   </metadata>
Oct 20 10:28:49 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:28:49 user nova-compute[74311]:     <system>
Oct 20 10:28:49 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:28:49 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:28:49 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:28:49 user nova-compute[74311]:       <entry name="serial">ce052ea1-5937-43d6-9ff9-694ff15b7f3e</entry>
Oct 20 10:28:49 user nova-compute[74311]:       <entry name="uuid">ce052ea1-5937-43d6-9ff9-694ff15b7f3e</entry>
Oct 20 10:28:49 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:28:49 user nova-compute[74311]:     </system>
Oct 20 10:28:49 user nova-compute[74311]:   </sysinfo>
Oct 20 10:28:49 user nova-compute[74311]:   <os>
Oct 20 10:28:49 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:28:49 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:28:49 user nova-compute[74311]:   </os>
Oct 20 10:28:49 user nova-compute[74311]:   <features>
Oct 20 10:28:49 user nova-compute[74311]:     <acpi/>
Oct 20 10:28:49 user nova-compute[74311]:     <apic/>
Oct 20 10:28:49 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:28:49 user nova-compute[74311]:   </features>
Oct 20 10:28:49 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:28:49 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:28:49 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:28:49 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:28:49 user nova-compute[74311]:   </clock>
Oct 20 10:28:49 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:28:49 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:28:49 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:28:49 user nova-compute[74311]:   </cpu>
Oct 20 10:28:49 user nova-compute[74311]:   <devices>
Oct 20 10:28:49 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:28:49 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:28:49 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.rescue"/>
Oct 20 10:28:49 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:28:49 user nova-compute[74311]:     </disk>
Oct 20 10:28:49 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:28:49 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:28:49 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk"/>
Oct 20 10:28:49 user nova-compute[74311]:       <target dev="vdb" bus="virtio"/>
Oct 20 10:28:49 user nova-compute[74311]:     </disk>
Oct 20 10:28:49 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:28:49 user nova-compute[74311]:       <mac address="fa:16:3e:ce:fd:01"/>
Oct 20 10:28:49 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:28:49 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:28:49 user nova-compute[74311]:       <target dev="tap3e3e5d7a-88"/>
Oct 20 10:28:49 user nova-compute[74311]:     </interface>
Oct 20 10:28:49 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:28:49 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/console.log" append="off"/>
Oct 20 10:28:49 user nova-compute[74311]:     </serial>
Oct 20 10:28:49 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:28:49 user nova-compute[74311]:     <video>
Oct 20 10:28:49 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:28:49 user nova-compute[74311]:     </video>
Oct 20 10:28:49 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:28:49 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:28:49 user nova-compute[74311]:     </rng>
Oct 20 10:28:49 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:28:49 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:28:49 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:28:49 user nova-compute[74311]:     </memballoon>
Oct 20 10:28:49 user nova-compute[74311]:   </devices>
Oct 20 10:28:49 user nova-compute[74311]: </domain>
Oct 20 10:28:49 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:28:49 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Instance destroyed successfully.
Oct 20 10:28:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:28:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:28:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] No VIF found with MAC fa:16:3e:ce:fd:01, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:28:50 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-030767d7-c1a5-4a42-b3e0-0da2ebbee777 req-58fddc40-475c-4cf5-a694-d49307ff1e34 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-030767d7-c1a5-4a42-b3e0-0da2ebbee777 req-58fddc40-475c-4cf5-a694-d49307ff1e34 service nova] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-030767d7-c1a5-4a42-b3e0-0da2ebbee777 req-58fddc40-475c-4cf5-a694-d49307ff1e34 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-030767d7-c1a5-4a42-b3e0-0da2ebbee777 req-58fddc40-475c-4cf5-a694-d49307ff1e34 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-030767d7-c1a5-4a42-b3e0-0da2ebbee777 req-58fddc40-475c-4cf5-a694-d49307ff1e34 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] No waiting events found dispatching network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:51 user nova-compute[74311]: WARNING nova.compute.manager [req-030767d7-c1a5-4a42-b3e0-0da2ebbee777 req-58fddc40-475c-4cf5-a694-d49307ff1e34 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received unexpected event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b for instance with vm_state active and task_state rescuing.
Oct 20 10:28:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:51 user nova-compute[74311]: WARNING nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] While synchronizing instance power states, found 13 instances in the database and 12 instances on the hypervisor.
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 22d78096-bc6c-4d6b-93b6-845d596ed24b {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid b0b457b8-159b-4533-ac97-dab7ffe0945e {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid cfc97865-6f94-4924-afc5-188d50543672 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid c0f944dd-b256-4b47-9e2e-7ba50188f636 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 60618091-1d8e-477c-8ea8-63973626a7e2 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 922b36b5-0575-4717-a876-dda27469ebb2 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 3b70780c-e968-4fce-a887-121d4b00218a {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 730bd2ce-cb53-411a-8b74-dafba0d5e2bb {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid ce052ea1-5937-43d6-9ff9-694ff15b7f3e {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 1eae0440-1736-4ea3-ba1c-65aa12fa1b56 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 00f57349-a3b2-49a1-99f9-97510634f3b0 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 79b6152a-3eec-4412-a063-6e82e767a27b {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "22d78096-bc6c-4d6b-93b6-845d596ed24b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "b0b457b8-159b-4533-ac97-dab7ffe0945e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "cfc97865-6f94-4924-afc5-188d50543672" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "60618091-1d8e-477c-8ea8-63973626a7e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "60618091-1d8e-477c-8ea8-63973626a7e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "922b36b5-0575-4717-a876-dda27469ebb2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "922b36b5-0575-4717-a876-dda27469ebb2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "3b70780c-e968-4fce-a887-121d4b00218a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "3b70780c-e968-4fce-a887-121d4b00218a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:51 user nova-compute[74311]: INFO nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] During sync_power_state the instance has a pending task (rescuing). Skip.
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "00f57349-a3b2-49a1-99f9-97510634f3b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "79b6152a-3eec-4412-a063-6e82e767a27b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "79b6152a-3eec-4412-a063-6e82e767a27b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:51 user nova-compute[74311]: INFO nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "79b6152a-3eec-4412-a063-6e82e767a27b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "cfc97865-6f94-4924-afc5-188d50543672" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "3b70780c-e968-4fce-a887-121d4b00218a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "60618091-1d8e-477c-8ea8-63973626a7e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "922b36b5-0575-4717-a876-dda27469ebb2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:53 user nova-compute[74311]: DEBUG nova.compute.manager [req-6c44590e-d95d-4830-95fe-ce02d9de9eb4 req-6e3eca1c-897e-4dd5-ab98-e78c5a7f0dc2 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6c44590e-d95d-4830-95fe-ce02d9de9eb4 req-6e3eca1c-897e-4dd5-ab98-e78c5a7f0dc2 service nova] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6c44590e-d95d-4830-95fe-ce02d9de9eb4 req-6e3eca1c-897e-4dd5-ab98-e78c5a7f0dc2 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6c44590e-d95d-4830-95fe-ce02d9de9eb4 req-6e3eca1c-897e-4dd5-ab98-e78c5a7f0dc2 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:53 user nova-compute[74311]: DEBUG nova.compute.manager [req-6c44590e-d95d-4830-95fe-ce02d9de9eb4 req-6e3eca1c-897e-4dd5-ab98-e78c5a7f0dc2 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] No waiting events found dispatching network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:53 user nova-compute[74311]: WARNING nova.compute.manager [req-6c44590e-d95d-4830-95fe-ce02d9de9eb4 req-6e3eca1c-897e-4dd5-ab98-e78c5a7f0dc2 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received unexpected event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b for instance with vm_state active and task_state rescuing.
Oct 20 10:28:53 user nova-compute[74311]: DEBUG nova.compute.manager [req-6c44590e-d95d-4830-95fe-ce02d9de9eb4 req-6e3eca1c-897e-4dd5-ab98-e78c5a7f0dc2 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:28:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6c44590e-d95d-4830-95fe-ce02d9de9eb4 req-6e3eca1c-897e-4dd5-ab98-e78c5a7f0dc2 service nova] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:28:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6c44590e-d95d-4830-95fe-ce02d9de9eb4 req-6e3eca1c-897e-4dd5-ab98-e78c5a7f0dc2 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:28:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6c44590e-d95d-4830-95fe-ce02d9de9eb4 req-6e3eca1c-897e-4dd5-ab98-e78c5a7f0dc2 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:28:53 user nova-compute[74311]: DEBUG nova.compute.manager [req-6c44590e-d95d-4830-95fe-ce02d9de9eb4 req-6e3eca1c-897e-4dd5-ab98-e78c5a7f0dc2 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] No waiting events found dispatching network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:28:53 user nova-compute[74311]: WARNING nova.compute.manager [req-6c44590e-d95d-4830-95fe-ce02d9de9eb4 req-6e3eca1c-897e-4dd5-ab98-e78c5a7f0dc2 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received unexpected event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b for instance with vm_state active and task_state rescuing.
Oct 20 10:28:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-9001ff64-635e-4d77-a1fb-456e78e303eb tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:28:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:28:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:04 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:29:04 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:29:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:29:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:29:04 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:29:05 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Updating instance_info_cache with network_info: [{"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:29:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-b0b457b8-159b-4533-ac97-dab7ffe0945e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:29:05 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:29:06 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Creating image(s)
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Ensure instance console log exists: /opt/stack/data/nova/instances/79b6152a-3eec-4412-a063-6e82e767a27b/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Start _get_guest_xml network_info=[{"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'b8d2238b-cb0b-41f8-830e-1c059470671b', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGnQdEte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '79b6152a-3eec-4412-a063-6e82e767a27b', 'attached_at': '', 'detached_at': '', 'volume_id': '9d865eed-f501-4a9b-a4f2-8fd737339548', 'serial': '9d865eed-f501-4a9b-a4f2-8fd737339548'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:29:06 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 10:29:06 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.objects.instance [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lazy-loading 'vcpu_model' on Instance uuid 79b6152a-3eec-4412-a063-6e82e767a27b {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGnQdEte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:29:06 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:29:06 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:29:06 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cac0f1b-67b1-4e39-923c-0882cf401728]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:29:06 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe43d31-add9-4fc9-a8a2-5ecfd10f1936]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548] added
Oct 20 10:29:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[37164ad6-d924-4ae0-8d72-7ea043d59fe9]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d3aa76-e332-4ead-8067-20adb37b08c7]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGnQdEte {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGnQdEte" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75a5b7f-086d-4627-af1f-5c3ce6f5d884]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NGnQdEte'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8639063-d719-4fb0-9069-9f64800372d4]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d45484-7228-4359-84a6-6b122f44d0f6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:29:06 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:29:06 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:29:06 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:29:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:29:06 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:29:06 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:29:06 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:29:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37c1ccc-f0c6-488e-bfc1-2496cef6ba95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260]
Oct 20 10:29:06 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260] successful.
Oct 20 10:29:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[909558ed-f7a4-4cdb-888f-5dbe47743b1d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3d0172-7377-47f2-896e-c39c1662262e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:29:06 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:29:06 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:29:06 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:29:06 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:29:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:29:06 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:29:06 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:29:06 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:29:06 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:29:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bf89e1-1730-4f2a-b8f7-30eea6c47891]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:29:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGnQdEte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23337336535373764', 'path': '/dev/sdc'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337336535373764', 'path': '/dev/sdc'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T10:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1929909354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1993782106',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzWhCvMVV6Y1XH/5Ox4S/1XTdcuZMP+vIAuIbp6IPW5DjnB21INUyKyNNxDYjm1qgk+5N7ar0+Y70BR6OMQrtuOTQnI1wGTcSxNpOQfz4xGTk69kpB66KvLuwztnTuwZg==',key_name='tempest-keypair-431497461',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:26:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9820bd4a09494eaf858e88301f6c5827',ramdisk_id='',reservation_id='r-81m98auw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-804114643',owner_user_name='tempest-ServerActionsV293TestJSON-804114643-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0134a62628fe4dd29bfd61a987d099d3',uuid=79b6152a-3eec-4412-a063-6e82e767a27b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Converting VIF {"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:fe:ae,bridge_name='br-int',has_traffic_filtering=True,id=672b83f5-751d-4964-b6e0-32d120958173,network=Network(630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap672b83f5-75') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:29:07 user nova-compute[74311]:   <uuid>79b6152a-3eec-4412-a063-6e82e767a27b</uuid>
Oct 20 10:29:07 user nova-compute[74311]:   <name>instance-0000001f</name>
Oct 20 10:29:07 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:29:07 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:29:07 user nova-compute[74311]:   <metadata>
Oct 20 10:29:07 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:29:07 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:29:07 user nova-compute[74311]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1929909354</nova:name>
Oct 20 10:29:07 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:29:06</nova:creationTime>
Oct 20 10:29:07 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:29:07 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:29:07 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:29:07 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:29:07 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:29:07 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:29:07 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:29:07 user nova-compute[74311]:       <nova:owner>
Oct 20 10:29:07 user nova-compute[74311]:         <nova:user uuid="0134a62628fe4dd29bfd61a987d099d3">tempest-ServerActionsV293TestJSON-804114643-project-member</nova:user>
Oct 20 10:29:07 user nova-compute[74311]:         <nova:project uuid="9820bd4a09494eaf858e88301f6c5827">tempest-ServerActionsV293TestJSON-804114643</nova:project>
Oct 20 10:29:07 user nova-compute[74311]:       </nova:owner>
Oct 20 10:29:07 user nova-compute[74311]:       <nova:ports>
Oct 20 10:29:07 user nova-compute[74311]:         <nova:port uuid="672b83f5-751d-4964-b6e0-32d120958173">
Oct 20 10:29:07 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 10:29:07 user nova-compute[74311]:         </nova:port>
Oct 20 10:29:07 user nova-compute[74311]:       </nova:ports>
Oct 20 10:29:07 user nova-compute[74311]:     </nova:instance>
Oct 20 10:29:07 user nova-compute[74311]:   </metadata>
Oct 20 10:29:07 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:29:07 user nova-compute[74311]:     <system>
Oct 20 10:29:07 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:29:07 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:29:07 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:29:07 user nova-compute[74311]:       <entry name="serial">79b6152a-3eec-4412-a063-6e82e767a27b</entry>
Oct 20 10:29:07 user nova-compute[74311]:       <entry name="uuid">79b6152a-3eec-4412-a063-6e82e767a27b</entry>
Oct 20 10:29:07 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:29:07 user nova-compute[74311]:     </system>
Oct 20 10:29:07 user nova-compute[74311]:   </sysinfo>
Oct 20 10:29:07 user nova-compute[74311]:   <os>
Oct 20 10:29:07 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:29:07 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:29:07 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:29:07 user nova-compute[74311]:   </os>
Oct 20 10:29:07 user nova-compute[74311]:   <features>
Oct 20 10:29:07 user nova-compute[74311]:     <acpi/>
Oct 20 10:29:07 user nova-compute[74311]:     <apic/>
Oct 20 10:29:07 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:29:07 user nova-compute[74311]:   </features>
Oct 20 10:29:07 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:29:07 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:29:07 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:29:07 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:29:07 user nova-compute[74311]:   </clock>
Oct 20 10:29:07 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:29:07 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:29:07 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:29:07 user nova-compute[74311]:   </cpu>
Oct 20 10:29:07 user nova-compute[74311]:   <devices>
Oct 20 10:29:07 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:29:07 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:29:07 user nova-compute[74311]:       <source dev="/dev/sdc"/>
Oct 20 10:29:07 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:29:07 user nova-compute[74311]:       <serial>9d865eed-f501-4a9b-a4f2-8fd737339548</serial>
Oct 20 10:29:07 user nova-compute[74311]:     </disk>
Oct 20 10:29:07 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:29:07 user nova-compute[74311]:       <mac address="fa:16:3e:cc:fe:ae"/>
Oct 20 10:29:07 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:29:07 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:29:07 user nova-compute[74311]:       <target dev="tap672b83f5-75"/>
Oct 20 10:29:07 user nova-compute[74311]:     </interface>
Oct 20 10:29:07 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:29:07 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/79b6152a-3eec-4412-a063-6e82e767a27b/console.log" append="off"/>
Oct 20 10:29:07 user nova-compute[74311]:     </serial>
Oct 20 10:29:07 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:29:07 user nova-compute[74311]:     <video>
Oct 20 10:29:07 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:29:07 user nova-compute[74311]:     </video>
Oct 20 10:29:07 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:29:07 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:29:07 user nova-compute[74311]:     </rng>
Oct 20 10:29:07 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:29:07 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:29:07 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:29:07 user nova-compute[74311]:     </memballoon>
Oct 20 10:29:07 user nova-compute[74311]:   </devices>
Oct 20 10:29:07 user nova-compute[74311]: </domain>
Oct 20 10:29:07 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T10:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1929909354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1993782106',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzWhCvMVV6Y1XH/5Ox4S/1XTdcuZMP+vIAuIbp6IPW5DjnB21INUyKyNNxDYjm1qgk+5N7ar0+Y70BR6OMQrtuOTQnI1wGTcSxNpOQfz4xGTk69kpB66KvLuwztnTuwZg==',key_name='tempest-keypair-431497461',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:26:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9820bd4a09494eaf858e88301f6c5827',ramdisk_id='',reservation_id='r-81m98auw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-804114643',owner_user_name='tempest-ServerActionsV293TestJSON-804114643-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:28:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0134a62628fe4dd29bfd61a987d099d3',uuid=79b6152a-3eec-4412-a063-6e82e767a27b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Converting VIF {"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:fe:ae,bridge_name='br-int',has_traffic_filtering=True,id=672b83f5-751d-4964-b6e0-32d120958173,network=Network(630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap672b83f5-75') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG os_vif [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:fe:ae,bridge_name='br-int',has_traffic_filtering=True,id=672b83f5-751d-4964-b6e0-32d120958173,network=Network(630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap672b83f5-75') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6ea7100-db44-5751-b617-00776e332ad4', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap672b83f5-75, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap672b83f5-75, col_values=(('qos', UUID('9d54df1a-9ed5-4724-875f-9a76cfbd8eed')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap672b83f5-75, col_values=(('external_ids', {'iface-id': '672b83f5-751d-4964-b6e0-32d120958173', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:fe:ae', 'vm-uuid': '79b6152a-3eec-4412-a063-6e82e767a27b'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:07 user nova-compute[74311]: INFO os_vif [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:fe:ae,bridge_name='br-int',has_traffic_filtering=True,id=672b83f5-751d-4964-b6e0-32d120958173,network=Network(630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap672b83f5-75')
Oct 20 10:29:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:29:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] No VIF found with MAC fa:16:3e:cc:fe:ae, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:29:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:09 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:29:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-447702d6-bf2c-495c-a9f7-744505a32e51 req-cf1b7c47-5e4b-422b-9b5d-b05b483b3371 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received event network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:29:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-447702d6-bf2c-495c-a9f7-744505a32e51 req-cf1b7c47-5e4b-422b-9b5d-b05b483b3371 service nova] Acquiring lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-447702d6-bf2c-495c-a9f7-744505a32e51 req-cf1b7c47-5e4b-422b-9b5d-b05b483b3371 service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-447702d6-bf2c-495c-a9f7-744505a32e51 req-cf1b7c47-5e4b-422b-9b5d-b05b483b3371 service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-447702d6-bf2c-495c-a9f7-744505a32e51 req-cf1b7c47-5e4b-422b-9b5d-b05b483b3371 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] No waiting events found dispatching network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:29:09 user nova-compute[74311]: WARNING nova.compute.manager [req-447702d6-bf2c-495c-a9f7-744505a32e51 req-cf1b7c47-5e4b-422b-9b5d-b05b483b3371 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received unexpected event network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 for instance with vm_state active and task_state rebuild_spawning.
Oct 20 10:29:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:10 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG nova.compute.manager [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:29:11 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Instance spawned successfully.
Oct 20 10:29:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG nova.compute.manager [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8237a80-eb2f-4510-b6f2-a98619af40f7 req-ae25a1f6-1b88-4654-8fcf-a1bb99346337 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received event network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8237a80-eb2f-4510-b6f2-a98619af40f7 req-ae25a1f6-1b88-4654-8fcf-a1bb99346337 service nova] Acquiring lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8237a80-eb2f-4510-b6f2-a98619af40f7 req-ae25a1f6-1b88-4654-8fcf-a1bb99346337 service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8237a80-eb2f-4510-b6f2-a98619af40f7 req-ae25a1f6-1b88-4654-8fcf-a1bb99346337 service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8237a80-eb2f-4510-b6f2-a98619af40f7 req-ae25a1f6-1b88-4654-8fcf-a1bb99346337 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] No waiting events found dispatching network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:29:11 user nova-compute[74311]: WARNING nova.compute.manager [req-a8237a80-eb2f-4510-b6f2-a98619af40f7 req-ae25a1f6-1b88-4654-8fcf-a1bb99346337 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received unexpected event network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 for instance with vm_state active and task_state rebuild_spawning.
Oct 20 10:29:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG nova.objects.instance [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74311) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 20 10:29:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-29e59f07-37cc-4c87-8714-0f730ed2e996 tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.065s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:13 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:29:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:14 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:29:14 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:29:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:14 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:29:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:14 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:16 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:29:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:16 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:29:16 user nova-compute[74311]: INFO nova.compute.claims [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Claim successful on node user
Oct 20 10:29:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:29:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.743s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:17 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:29:17 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG nova.policy [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '497267775cc747b8b65b8bcb276806ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e99de7cef4b4569a497f77325515680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:29:17 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Creating image(s)
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "/opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "/opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.219s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk 1073741824" returned: 0 in 0.096s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Successfully created port: 0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.202s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk --force-share --output=json" returned: 0 in 0.451s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Cannot resize image /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Ensure instance console log exists: /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.401s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Successfully updated port: 0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.manager [req-1a0e1ab6-d887-4ba7-8b7b-2e09ba7f8139 req-ed198cb3-eb64-4839-8024-392896dd39b5 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Received event network-changed-0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.manager [req-1a0e1ab6-d887-4ba7-8b7b-2e09ba7f8139 req-ed198cb3-eb64-4839-8024-392896dd39b5 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Refreshing instance network info cache due to event network-changed-0f62e9d8-7d48-4066-b706-a7fb7bc61869. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1a0e1ab6-d887-4ba7-8b7b-2e09ba7f8139 req-ed198cb3-eb64-4839-8024-392896dd39b5 service nova] Acquiring lock "refresh_cache-2c91da9a-42ec-46b0-acbe-83b9fe36510a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1a0e1ab6-d887-4ba7-8b7b-2e09ba7f8139 req-ed198cb3-eb64-4839-8024-392896dd39b5 service nova] Acquired lock "refresh_cache-2c91da9a-42ec-46b0-acbe-83b9fe36510a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.network.neutron [req-1a0e1ab6-d887-4ba7-8b7b-2e09ba7f8139 req-ed198cb3-eb64-4839-8024-392896dd39b5 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Refreshing network info cache for port 0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:29:19 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:29:19 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7124MB free_disk=24.97832489013672GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "refresh_cache-2c91da9a-42ec-46b0-acbe-83b9fe36510a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.network.neutron [req-1a0e1ab6-d887-4ba7-8b7b-2e09ba7f8139 req-ed198cb3-eb64-4839-8024-392896dd39b5 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.network.neutron [req-1a0e1ab6-d887-4ba7-8b7b-2e09ba7f8139 req-ed198cb3-eb64-4839-8024-392896dd39b5 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 922b36b5-0575-4717-a876-dda27469ebb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 730bd2ce-cb53-411a-8b74-dafba0d5e2bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 3b70780c-e968-4fce-a887-121d4b00218a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 79b6152a-3eec-4412-a063-6e82e767a27b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 1eae0440-1736-4ea3-ba1c-65aa12fa1b56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 00f57349-a3b2-49a1-99f9-97510634f3b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2c91da9a-42ec-46b0-acbe-83b9fe36510a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1a0e1ab6-d887-4ba7-8b7b-2e09ba7f8139 req-ed198cb3-eb64-4839-8024-392896dd39b5 service nova] Releasing lock "refresh_cache-2c91da9a-42ec-46b0-acbe-83b9fe36510a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquired lock "refresh_cache-2c91da9a-42ec-46b0-acbe-83b9fe36510a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:29:19 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Updating instance_info_cache with network_info: [{"id": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "address": "fa:16:3e:ae:4e:4e", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f62e9d8-7d", "ovs_interfaceid": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Releasing lock "refresh_cache-2c91da9a-42ec-46b0-acbe-83b9fe36510a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Instance network_info: |[{"id": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "address": "fa:16:3e:ae:4e:4e", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f62e9d8-7d", "ovs_interfaceid": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Start _get_guest_xml network_info=[{"id": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "address": "fa:16:3e:ae:4e:4e", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f62e9d8-7d", "ovs_interfaceid": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:29:20 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:29:20 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:29:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-365882943',display_name='tempest-AttachVolumeNegativeTest-server-365882943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-365882943',id=36,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiTyOPfYeDLwZNQ3G84CsnJCrMYI81h9WQ9mhTCgeiJlJ3UBZdY8bFAC+KG05s/Rc9zxXxcvQfOdBGXH+RSmaf1S1QLvTtEtJoAYN8NzaUGlniYQSzY7H9UDL9YjgE1nQ==',key_name='tempest-keypair-1042428170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e99de7cef4b4569a497f77325515680',ramdisk_id='',reservation_id='r-k1y92mm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-543930091',owner_user_name='tempest-AttachVolumeNegativeTest-543930091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:29:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497267775cc747b8b65b8bcb276806ba',uuid=2c91da9a-42ec-46b0-acbe-83b9fe36510a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "address": "fa:16:3e:ae:4e:4e", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f62e9d8-7d", "ovs_interfaceid": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converting VIF {"id": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "address": "fa:16:3e:ae:4e:4e", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f62e9d8-7d", "ovs_interfaceid": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4e:4e,bridge_name='br-int',has_traffic_filtering=True,id=0f62e9d8-7d48-4066-b706-a7fb7bc61869,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f62e9d8-7d') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.objects.instance [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c91da9a-42ec-46b0-acbe-83b9fe36510a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:29:20 user nova-compute[74311]:   <uuid>2c91da9a-42ec-46b0-acbe-83b9fe36510a</uuid>
Oct 20 10:29:20 user nova-compute[74311]:   <name>instance-00000024</name>
Oct 20 10:29:20 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:29:20 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:29:20 user nova-compute[74311]:   <metadata>
Oct 20 10:29:20 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:29:20 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:29:20 user nova-compute[74311]:       <nova:name>tempest-AttachVolumeNegativeTest-server-365882943</nova:name>
Oct 20 10:29:20 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:29:20</nova:creationTime>
Oct 20 10:29:20 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:29:20 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:29:20 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:29:20 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:29:20 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:29:20 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:29:20 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:29:20 user nova-compute[74311]:       <nova:owner>
Oct 20 10:29:20 user nova-compute[74311]:         <nova:user uuid="497267775cc747b8b65b8bcb276806ba">tempest-AttachVolumeNegativeTest-543930091-project-member</nova:user>
Oct 20 10:29:20 user nova-compute[74311]:         <nova:project uuid="4e99de7cef4b4569a497f77325515680">tempest-AttachVolumeNegativeTest-543930091</nova:project>
Oct 20 10:29:20 user nova-compute[74311]:       </nova:owner>
Oct 20 10:29:20 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:29:20 user nova-compute[74311]:       <nova:ports>
Oct 20 10:29:20 user nova-compute[74311]:         <nova:port uuid="0f62e9d8-7d48-4066-b706-a7fb7bc61869">
Oct 20 10:29:20 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 10:29:20 user nova-compute[74311]:         </nova:port>
Oct 20 10:29:20 user nova-compute[74311]:       </nova:ports>
Oct 20 10:29:20 user nova-compute[74311]:     </nova:instance>
Oct 20 10:29:20 user nova-compute[74311]:   </metadata>
Oct 20 10:29:20 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:29:20 user nova-compute[74311]:     <system>
Oct 20 10:29:20 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:29:20 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:29:20 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:29:20 user nova-compute[74311]:       <entry name="serial">2c91da9a-42ec-46b0-acbe-83b9fe36510a</entry>
Oct 20 10:29:20 user nova-compute[74311]:       <entry name="uuid">2c91da9a-42ec-46b0-acbe-83b9fe36510a</entry>
Oct 20 10:29:20 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:29:20 user nova-compute[74311]:     </system>
Oct 20 10:29:20 user nova-compute[74311]:   </sysinfo>
Oct 20 10:29:20 user nova-compute[74311]:   <os>
Oct 20 10:29:20 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:29:20 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:29:20 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:29:20 user nova-compute[74311]:   </os>
Oct 20 10:29:20 user nova-compute[74311]:   <features>
Oct 20 10:29:20 user nova-compute[74311]:     <acpi/>
Oct 20 10:29:20 user nova-compute[74311]:     <apic/>
Oct 20 10:29:20 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:29:20 user nova-compute[74311]:   </features>
Oct 20 10:29:20 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:29:20 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:29:20 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:29:20 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:29:20 user nova-compute[74311]:   </clock>
Oct 20 10:29:20 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:29:20 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:29:20 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:29:20 user nova-compute[74311]:   </cpu>
Oct 20 10:29:20 user nova-compute[74311]:   <devices>
Oct 20 10:29:20 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:29:20 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:29:20 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk"/>
Oct 20 10:29:20 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:29:20 user nova-compute[74311]:     </disk>
Oct 20 10:29:20 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:29:20 user nova-compute[74311]:       <mac address="fa:16:3e:ae:4e:4e"/>
Oct 20 10:29:20 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:29:20 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:29:20 user nova-compute[74311]:       <target dev="tap0f62e9d8-7d"/>
Oct 20 10:29:20 user nova-compute[74311]:     </interface>
Oct 20 10:29:20 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:29:20 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/console.log" append="off"/>
Oct 20 10:29:20 user nova-compute[74311]:     </serial>
Oct 20 10:29:20 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:29:20 user nova-compute[74311]:     <video>
Oct 20 10:29:20 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:29:20 user nova-compute[74311]:     </video>
Oct 20 10:29:20 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:29:20 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:29:20 user nova-compute[74311]:     </rng>
Oct 20 10:29:20 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:29:20 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:29:20 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:29:20 user nova-compute[74311]:     </memballoon>
Oct 20 10:29:20 user nova-compute[74311]:   </devices>
Oct 20 10:29:20 user nova-compute[74311]: </domain>
Oct 20 10:29:20 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:29:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-365882943',display_name='tempest-AttachVolumeNegativeTest-server-365882943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-365882943',id=36,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiTyOPfYeDLwZNQ3G84CsnJCrMYI81h9WQ9mhTCgeiJlJ3UBZdY8bFAC+KG05s/Rc9zxXxcvQfOdBGXH+RSmaf1S1QLvTtEtJoAYN8NzaUGlniYQSzY7H9UDL9YjgE1nQ==',key_name='tempest-keypair-1042428170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e99de7cef4b4569a497f77325515680',ramdisk_id='',reservation_id='r-k1y92mm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-543930091',owner_user_name='tempest-AttachVolumeNegativeTest-543930091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:29:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497267775cc747b8b65b8bcb276806ba',uuid=2c91da9a-42ec-46b0-acbe-83b9fe36510a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "address": "fa:16:3e:ae:4e:4e", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f62e9d8-7d", "ovs_interfaceid": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converting VIF {"id": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "address": "fa:16:3e:ae:4e:4e", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f62e9d8-7d", "ovs_interfaceid": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4e:4e,bridge_name='br-int',has_traffic_filtering=True,id=0f62e9d8-7d48-4066-b706-a7fb7bc61869,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f62e9d8-7d') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG os_vif [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4e:4e,bridge_name='br-int',has_traffic_filtering=True,id=0f62e9d8-7d48-4066-b706-a7fb7bc61869,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f62e9d8-7d') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '077ef6dc-7c43-5687-877b-1fb3925ecd85', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f62e9d8-7d, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f62e9d8-7d, col_values=(('qos', UUID('da9723ef-64e6-45c5-adbd-89709bbd57bb')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f62e9d8-7d, col_values=(('external_ids', {'iface-id': '0f62e9d8-7d48-4066-b706-a7fb7bc61869', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:4e:4e', 'vm-uuid': '2c91da9a-42ec-46b0-acbe-83b9fe36510a'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:20 user nova-compute[74311]: INFO os_vif [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4e:4e,bridge_name='br-int',has_traffic_filtering=True,id=0f62e9d8-7d48-4066-b706-a7fb7bc61869,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f62e9d8-7d')
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No VIF found with MAC fa:16:3e:ae:4e:4e, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:29:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.950s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:21 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8309688-cd36-43e7-bbd9-98c47d74e652 req-d2e54357-138b-4fd7-a30a-4ef471729896 service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Received event network-changed-378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:29:21 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8309688-cd36-43e7-bbd9-98c47d74e652 req-d2e54357-138b-4fd7-a30a-4ef471729896 service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Refreshing instance network info cache due to event network-changed-378b4ae2-4ea8-498d-9ef0-6c3e96817646. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:29:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8309688-cd36-43e7-bbd9-98c47d74e652 req-d2e54357-138b-4fd7-a30a-4ef471729896 service nova] Acquiring lock "refresh_cache-28ec7283-8a34-4eb4-b458-ed9fe6723ec2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:29:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8309688-cd36-43e7-bbd9-98c47d74e652 req-d2e54357-138b-4fd7-a30a-4ef471729896 service nova] Acquired lock "refresh_cache-28ec7283-8a34-4eb4-b458-ed9fe6723ec2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:29:21 user nova-compute[74311]: DEBUG nova.network.neutron [req-a8309688-cd36-43e7-bbd9-98c47d74e652 req-d2e54357-138b-4fd7-a30a-4ef471729896 service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Refreshing network info cache for port 378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:29:21 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:29:21 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:29:22 user nova-compute[74311]: DEBUG nova.network.neutron [req-a8309688-cd36-43e7-bbd9-98c47d74e652 req-d2e54357-138b-4fd7-a30a-4ef471729896 service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Updated VIF entry in instance network info cache for port 378b4ae2-4ea8-498d-9ef0-6c3e96817646. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:29:22 user nova-compute[74311]: DEBUG nova.network.neutron [req-a8309688-cd36-43e7-bbd9-98c47d74e652 req-d2e54357-138b-4fd7-a30a-4ef471729896 service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Updating instance_info_cache with network_info: [{"id": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "address": "fa:16:3e:5a:e5:8e", "network": {"id": "73186602-4613-449b-b892-2aed0cad9aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-347025189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c01bcaa34104f29ab8566e793779055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378b4ae2-4e", "ovs_interfaceid": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:29:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8309688-cd36-43e7-bbd9-98c47d74e652 req-d2e54357-138b-4fd7-a30a-4ef471729896 service nova] Releasing lock "refresh_cache-28ec7283-8a34-4eb4-b458-ed9fe6723ec2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:29:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-d5e61a5e-1917-4a2b-b9a4-883f69b21212 req-b061e997-3548-46eb-af26-cf65da772595 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Received event network-vif-plugged-0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:29:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d5e61a5e-1917-4a2b-b9a4-883f69b21212 req-b061e997-3548-46eb-af26-cf65da772595 service nova] Acquiring lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d5e61a5e-1917-4a2b-b9a4-883f69b21212 req-b061e997-3548-46eb-af26-cf65da772595 service nova] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d5e61a5e-1917-4a2b-b9a4-883f69b21212 req-b061e997-3548-46eb-af26-cf65da772595 service nova] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-d5e61a5e-1917-4a2b-b9a4-883f69b21212 req-b061e997-3548-46eb-af26-cf65da772595 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] No waiting events found dispatching network-vif-plugged-0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:29:22 user nova-compute[74311]: WARNING nova.compute.manager [req-d5e61a5e-1917-4a2b-b9a4-883f69b21212 req-b061e997-3548-46eb-af26-cf65da772595 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Received unexpected event network-vif-plugged-0f62e9d8-7d48-4066-b706-a7fb7bc61869 for instance with vm_state building and task_state spawning.
Oct 20 10:29:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:22 user nova-compute[74311]: DEBUG nova.objects.instance [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lazy-loading 'flavor' on Instance uuid 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:29:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:24 user nova-compute[74311]: INFO nova.compute.manager [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Attaching volume ac503668-162e-484e-802b-c3c38764a2cc to /dev/vdb
Oct 20 10:29:24 user nova-compute[74311]: DEBUG os_brick.utils [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[93da4779-f581-461c-888c-2b602bf9e45b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[61577405-72be-48a3-b2c1-0cb99f9df2d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2f9ead-97bf-4553-8e8c-f91234dd726b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[006a2b4e-c91e-4ecb-9be5-3be345796065]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:29:24 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7920c1-012c-415e-9359-181de22f7327]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG os_brick.utils [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Updating existing volume attachment record: 1ea65543-2879-43ae-83d2-da1509eb505f {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-57378a90-47d6-43ce-8379-7ccfad3a5fa2 req-d0d6477d-240b-4a9e-80fc-e8c17fce44ed service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Received event network-vif-plugged-0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57378a90-47d6-43ce-8379-7ccfad3a5fa2 req-d0d6477d-240b-4a9e-80fc-e8c17fce44ed service nova] Acquiring lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57378a90-47d6-43ce-8379-7ccfad3a5fa2 req-d0d6477d-240b-4a9e-80fc-e8c17fce44ed service nova] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-57378a90-47d6-43ce-8379-7ccfad3a5fa2 req-d0d6477d-240b-4a9e-80fc-e8c17fce44ed service nova] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-57378a90-47d6-43ce-8379-7ccfad3a5fa2 req-d0d6477d-240b-4a9e-80fc-e8c17fce44ed service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] No waiting events found dispatching network-vif-plugged-0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:29:24 user nova-compute[74311]: WARNING nova.compute.manager [req-57378a90-47d6-43ce-8379-7ccfad3a5fa2 req-d0d6477d-240b-4a9e-80fc-e8c17fce44ed service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Received unexpected event network-vif-plugged-0f62e9d8-7d48-4066-b706-a7fb7bc61869 for instance with vm_state building and task_state spawning.
Oct 20 10:29:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:27 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:29:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:29:27 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Instance spawned successfully.
Oct 20 10:29:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:29:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:29:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:29:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:29:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:29:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:29:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:29:27 user nova-compute[74311]: INFO nova.compute.manager [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Took 10.11 seconds to spawn the instance on the hypervisor.
Oct 20 10:29:27 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:29:27 user nova-compute[74311]: INFO nova.compute.manager [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Took 11.40 seconds to build instance.
Oct 20 10:29:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b626b6ee-a33b-4929-bd6d-b3e3fcf015ba tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.550s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:40 user nova-compute[74311]: INFO nova.compute.manager [None req-dd8f798d-ce03-46d4-b583-468d088a9239 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Get console output
Oct 20 10:29:40 user nova-compute[74311]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 20 10:29:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQWXVjNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:29:43 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:29:43 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:29:43 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[69341c25-7a8f-4f50-b7c7-1f723dc3554a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:29:43 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd0a53d-40ff-47ad-ae3a-70566e03c905]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc] added
Oct 20 10:29:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4b5f7a-5c44-499b-b6bf-2a6f4a3ec44a]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dd2234-4d1f-4ac5-a11b-a9ae457dc322]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nQWXVjNY {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nQWXVjNY" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[322287f1-7fdf-426a-8689-ff0772daa690]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nQWXVjNY'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd060e9a-7072-4457-9bcc-0b99e664d1c1]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05fd56b-b543-42b0-8c36-4dd6a9301dc9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b09636-1b8c-4f69-a281-cd72eb0a9401]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc, portal: 172.16.0.220,3260]
Oct 20 10:29:43 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc, portal: 172.16.0.220,3260] successful.
Oct 20 10:29:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c9a439-67b6-48c9-b641-a718edd3b6e8]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e68ef49-435d-4cd4-acc6-e1a6c36f9e47]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:29:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:29:43 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:29:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f749e64b-974e-496b-93bf-fe63d9247587]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:43 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:29:44 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:29:44 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQWXVjNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:29:44 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:29:44 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23736623561666435', 'path': '/dev/sdg'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:29:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736623561666435', 'path': '/dev/sdg'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:29:44 user nova-compute[74311]: DEBUG nova.objects.instance [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lazy-loading 'flavor' on Instance uuid 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:29:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:29:44 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:29:44 user nova-compute[74311]:   <source dev="/dev/sdg"/>
Oct 20 10:29:44 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:29:44 user nova-compute[74311]:   <serial>ac503668-162e-484e-802b-c3c38764a2cc</serial>
Oct 20 10:29:44 user nova-compute[74311]: </disk>
Oct 20 10:29:44 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:29:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:29:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:29:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] No VIF found with MAC fa:16:3e:5a:e5:8e, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:29:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2d1fe2ef-77b8-493e-ac22-fcb67547fe05 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.498s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG nova.objects.instance [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lazy-loading 'flavor' on Instance uuid 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:50 user nova-compute[74311]: INFO nova.compute.manager [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Attaching volume 7727f182-ea58-43bc-bb94-cf9e4d956236 to /dev/vdc
Oct 20 10:29:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG os_brick.utils [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e68f262-e563-454a-9084-db276564482a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[da02496a-a01a-45dc-91d0-60be7f65fdd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[74975b3a-1594-4221-b995-b2e3d5419479]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8357b6-d1ea-4d07-86c2-159568786d88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:29:50 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:29:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e1e29c-2a06-4974-ae1a-7598aba4e78f]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG os_brick.utils [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:29:50 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Updating existing volume attachment record: 170d66c3-9fc2-498d-86b3-949aadb38559 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:29:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:59 user nova-compute[74311]: INFO nova.compute.manager [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Terminating instance
Oct 20 10:29:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-929fcc3f-bcd1-4961-b573-29347d73f043 req-e5de7a96-7a5c-4a11-a783-2c36094ead7f service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-unplugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-929fcc3f-bcd1-4961-b573-29347d73f043 req-e5de7a96-7a5c-4a11-a783-2c36094ead7f service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-929fcc3f-bcd1-4961-b573-29347d73f043 req-e5de7a96-7a5c-4a11-a783-2c36094ead7f service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-929fcc3f-bcd1-4961-b573-29347d73f043 req-e5de7a96-7a5c-4a11-a783-2c36094ead7f service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-929fcc3f-bcd1-4961-b573-29347d73f043 req-e5de7a96-7a5c-4a11-a783-2c36094ead7f service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-unplugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-929fcc3f-bcd1-4961-b573-29347d73f043 req-e5de7a96-7a5c-4a11-a783-2c36094ead7f service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-unplugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:59 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Instance destroyed successfully.
Oct 20 10:29:59 user nova-compute[74311]: DEBUG nova.objects.instance [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'resources' on Instance uuid 730bd2ce-cb53-411a-8b74-dafba0d5e2bb {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:24:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-141140732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-141140732',id=28,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090bd6a8a14d4a308e67be7a12e47ae6',ramdisk_id='',reservation_id='r-swhff48u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:28:13Z,user_data=None,user_id='0c6b76de1f054ca0973f2f9ba2eafaed',uuid=730bd2ce-cb53-411a-8b74-dafba0d5e2bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converting VIF {"id": "24df162f-75d9-4c7b-9b02-843587088e7c", "address": "fa:16:3e:32:c0:77", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24df162f-75", "ovs_interfaceid": "24df162f-75d9-4c7b-9b02-843587088e7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:c0:77,bridge_name='br-int',has_traffic_filtering=True,id=24df162f-75d9-4c7b-9b02-843587088e7c,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24df162f-75') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG os_vif [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:c0:77,bridge_name='br-int',has_traffic_filtering=True,id=24df162f-75d9-4c7b-9b02-843587088e7c,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24df162f-75') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24df162f-75, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=acf0e500-978b-4c25-a329-56fe9155785f) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:29:59 user nova-compute[74311]: INFO os_vif [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:c0:77,bridge_name='br-int',has_traffic_filtering=True,id=24df162f-75d9-4c7b-9b02-843587088e7c,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24df162f-75')
Oct 20 10:29:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xBwJTzCc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:29:59 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:29:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[605bbcfe-67d4-4b44-a042-e671afa3c5fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:29:59 user nova-compute[74311]: No targets found.
Oct 20 10:29:59 user nova-compute[74311]: iSNS:
Oct 20 10:29:59 user nova-compute[74311]: No targets found.
Oct 20 10:29:59 user nova-compute[74311]: STATIC:
Oct 20 10:29:59 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:29:59 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:29:59 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:29:59 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728
Oct 20 10:29:59 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:29:59 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:29:59 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc
Oct 20 10:29:59 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:29:59 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:29:59 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8
Oct 20 10:29:59 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:29:59 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:29:59 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478
Oct 20 10:29:59 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:29:59 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:29:59 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548
Oct 20 10:29:59 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:29:59 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:29:59 user nova-compute[74311]: FIRMWARE:
Oct 20 10:29:59 user nova-compute[74311]: No targets found.
Oct 20 10:29:59 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:29:59 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:29:59 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[937b4505-ad0c-444e-9809-4139c40965a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d71b2b-2e15-44d3-880c-c235326c5050]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:29:59 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:29:59 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:29:59 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:29:59 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:29:59 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:29:59 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:29:59 user nova-compute[74311]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 (non-flash)
Oct 20 10:29:59 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:29:59 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:29:59 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:29:59 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:29:59 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164cf4e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8'): ({'sdd'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:29:59 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Removing single pathed devices sdd {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d541741-2aaa-4817-a599-ea3a7543fd61]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e06033-6dca-49cb-a842-2cabe738e6e0]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Flushing IO for device /dev/sdd {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.032s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[896a4f26-6d12-4ba3-b461-fbfc872c34e3]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[169aa184-a14d-41b4-a8cc-751f3bf25756]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23337316533363937', '/dev/disk/by-id/scsi-1SCST_BIOa0fff2a9-371e3697fcfd7137', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a0fff2a9') {{(pid=85589) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e4599a-e987-407d-80f9-6ed9269e7f0e]: (4, None) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c349e7-f4cb-444b-b345-b358d41555f6]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d1ee8a-190f-417e-beed-67101a9f2f57]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8, portal: 172.16.0.220,3260]
Oct 20 10:30:00 user nova-compute[74311]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8, portal: 172.16.0.220,3260] successful.
Oct 20 10:30:00 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d65f3863-0f82-406c-bfc2-07dc2d1afec8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[427fe1e7-0c18-4f1d-8a39-0af5703df306]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.410s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] <== disconnect_volume: return (411ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:30:00 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Deleting instance files /opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb_del
Oct 20 10:30:00 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Deletion of /opt/stack/data/nova/instances/730bd2ce-cb53-411a-8b74-dafba0d5e2bb_del complete
Oct 20 10:30:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:00 user nova-compute[74311]: INFO nova.compute.manager [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Took 1.34 seconds to destroy the instance on the hypervisor.
Oct 20 10:30:00 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:30:00 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:30:01 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Took 0.65 seconds to deallocate network for instance.
Oct 20 10:30:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-6a1ab0b7-c6e0-4b43-8ea6-0994e880f833 req-a9985238-dcd5-4bf8-a19c-8569caf856b3 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-deleted-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:01 user nova-compute[74311]: WARNING nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received unexpected event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with vm_state active and task_state deleting.
Oct 20 10:30:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:01 user nova-compute[74311]: WARNING nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received unexpected event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with vm_state active and task_state deleting.
Oct 20 10:30:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:01 user nova-compute[74311]: WARNING nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received unexpected event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with vm_state active and task_state deleting.
Oct 20 10:30:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-unplugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-unplugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-unplugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Acquiring lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] No waiting events found dispatching network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:01 user nova-compute[74311]: WARNING nova.compute.manager [req-ddaca58d-e402-474f-9e02-d97831815593 req-7e73ca7f-8e12-4b6d-86f6-006a5fc16511 service nova] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Received unexpected event network-vif-plugged-24df162f-75d9-4c7b-9b02-843587088e7c for instance with vm_state active and task_state deleting.
Oct 20 10:30:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:05 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:30:05 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:30:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:30:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:30:05 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: cfc97865-6f94-4924-afc5-188d50543672] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:30:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "593a4f46-9b5b-4a3c-95c7-21712b081069" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:05 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:30:05 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: cfc97865-6f94-4924-afc5-188d50543672] Updating instance_info_cache with network_info: [{"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:30:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-cfc97865-6f94-4924-afc5-188d50543672" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:30:05 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: cfc97865-6f94-4924-afc5-188d50543672] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:30:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:05 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:30:05 user nova-compute[74311]: INFO nova.compute.claims [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Claim successful on node user
Oct 20 10:30:06 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:30:06 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:30:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG nova.policy [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e90400e50b143a09e2936ed67ea5c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eccbc22a0844e5864eb2e4d4c8f3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:30:06 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Creating image(s)
Oct 20 10:30:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "/opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "/opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "/opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.223s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk 1073741824" returned: 0 in 0.058s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Successfully created port: aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Checking if we can resize image /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Cannot resize image /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Ensure instance console log exists: /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Successfully updated port: aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquired lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG nova.compute.manager [req-1e5701db-1b75-48db-be38-cbdd579d788a req-4e19459c-eda6-43d1-9573-5b19860a2c55 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Received event network-changed-aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG nova.compute.manager [req-1e5701db-1b75-48db-be38-cbdd579d788a req-4e19459c-eda6-43d1-9573-5b19860a2c55 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Refreshing instance network info cache due to event network-changed-aba6ea09-c123-48e0-83d2-294027a059c6. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:30:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1e5701db-1b75-48db-be38-cbdd579d788a req-4e19459c-eda6-43d1-9573-5b19860a2c55 service nova] Acquiring lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Updating instance_info_cache with network_info: [{"id": "aba6ea09-c123-48e0-83d2-294027a059c6", "address": "fa:16:3e:8b:a4:67", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba6ea09-c1", "ovs_interfaceid": "aba6ea09-c123-48e0-83d2-294027a059c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Releasing lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Instance network_info: |[{"id": "aba6ea09-c123-48e0-83d2-294027a059c6", "address": "fa:16:3e:8b:a4:67", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba6ea09-c1", "ovs_interfaceid": "aba6ea09-c123-48e0-83d2-294027a059c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1e5701db-1b75-48db-be38-cbdd579d788a req-4e19459c-eda6-43d1-9573-5b19860a2c55 service nova] Acquired lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.network.neutron [req-1e5701db-1b75-48db-be38-cbdd579d788a req-4e19459c-eda6-43d1-9573-5b19860a2c55 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Refreshing network info cache for port aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Start _get_guest_xml network_info=[{"id": "aba6ea09-c123-48e0-83d2-294027a059c6", "address": "fa:16:3e:8b:a4:67", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba6ea09-c1", "ovs_interfaceid": "aba6ea09-c123-48e0-83d2-294027a059c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:30:08 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:30:08 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:30:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2049730992',display_name='tempest-TestStampPattern-server-2049730992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2049730992',id=37,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxIz+AOQh5BFtvQDWoLXblBp+TB3fi3MeSA/3rUAks7ejyqHfrxlBfgqB6oyecw1P0xdLVr8KQzmCjxwt7BESaDUHM3Wwh/O99KdQsg36VfSYG5rbhAc/v9D0kkQRONKQ==',key_name='tempest-TestStampPattern-1298176157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8eccbc22a0844e5864eb2e4d4c8f3f9',ramdisk_id='',reservation_id='r-4aqr1zl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1787276252',owner_user_name='tempest-TestStampPattern-1787276252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:30:07Z,user_data=None,user_id='3e90400e50b143a09e2936ed67ea5c77',uuid=593a4f46-9b5b-4a3c-95c7-21712b081069,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aba6ea09-c123-48e0-83d2-294027a059c6", "address": "fa:16:3e:8b:a4:67", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba6ea09-c1", "ovs_interfaceid": "aba6ea09-c123-48e0-83d2-294027a059c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Converting VIF {"id": "aba6ea09-c123-48e0-83d2-294027a059c6", "address": "fa:16:3e:8b:a4:67", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba6ea09-c1", "ovs_interfaceid": "aba6ea09-c123-48e0-83d2-294027a059c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:a4:67,bridge_name='br-int',has_traffic_filtering=True,id=aba6ea09-c123-48e0-83d2-294027a059c6,network=Network(e3e17086-dc82-40b0-8b51-655f5083b429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba6ea09-c1') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.objects.instance [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lazy-loading 'pci_devices' on Instance uuid 593a4f46-9b5b-4a3c-95c7-21712b081069 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:30:08 user nova-compute[74311]:   <uuid>593a4f46-9b5b-4a3c-95c7-21712b081069</uuid>
Oct 20 10:30:08 user nova-compute[74311]:   <name>instance-00000025</name>
Oct 20 10:30:08 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:30:08 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:30:08 user nova-compute[74311]:   <metadata>
Oct 20 10:30:08 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:30:08 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:30:08 user nova-compute[74311]:       <nova:name>tempest-TestStampPattern-server-2049730992</nova:name>
Oct 20 10:30:08 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:30:08</nova:creationTime>
Oct 20 10:30:08 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:30:08 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:30:08 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:30:08 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:30:08 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:30:08 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:30:08 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:30:08 user nova-compute[74311]:       <nova:owner>
Oct 20 10:30:08 user nova-compute[74311]:         <nova:user uuid="3e90400e50b143a09e2936ed67ea5c77">tempest-TestStampPattern-1787276252-project-member</nova:user>
Oct 20 10:30:08 user nova-compute[74311]:         <nova:project uuid="f8eccbc22a0844e5864eb2e4d4c8f3f9">tempest-TestStampPattern-1787276252</nova:project>
Oct 20 10:30:08 user nova-compute[74311]:       </nova:owner>
Oct 20 10:30:08 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:30:08 user nova-compute[74311]:       <nova:ports>
Oct 20 10:30:08 user nova-compute[74311]:         <nova:port uuid="aba6ea09-c123-48e0-83d2-294027a059c6">
Oct 20 10:30:08 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 10:30:08 user nova-compute[74311]:         </nova:port>
Oct 20 10:30:08 user nova-compute[74311]:       </nova:ports>
Oct 20 10:30:08 user nova-compute[74311]:     </nova:instance>
Oct 20 10:30:08 user nova-compute[74311]:   </metadata>
Oct 20 10:30:08 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:30:08 user nova-compute[74311]:     <system>
Oct 20 10:30:08 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:30:08 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:30:08 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:30:08 user nova-compute[74311]:       <entry name="serial">593a4f46-9b5b-4a3c-95c7-21712b081069</entry>
Oct 20 10:30:08 user nova-compute[74311]:       <entry name="uuid">593a4f46-9b5b-4a3c-95c7-21712b081069</entry>
Oct 20 10:30:08 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:30:08 user nova-compute[74311]:     </system>
Oct 20 10:30:08 user nova-compute[74311]:   </sysinfo>
Oct 20 10:30:08 user nova-compute[74311]:   <os>
Oct 20 10:30:08 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:30:08 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:30:08 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:30:08 user nova-compute[74311]:   </os>
Oct 20 10:30:08 user nova-compute[74311]:   <features>
Oct 20 10:30:08 user nova-compute[74311]:     <acpi/>
Oct 20 10:30:08 user nova-compute[74311]:     <apic/>
Oct 20 10:30:08 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:30:08 user nova-compute[74311]:   </features>
Oct 20 10:30:08 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:30:08 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:30:08 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:30:08 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:30:08 user nova-compute[74311]:   </clock>
Oct 20 10:30:08 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:30:08 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:30:08 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:30:08 user nova-compute[74311]:   </cpu>
Oct 20 10:30:08 user nova-compute[74311]:   <devices>
Oct 20 10:30:08 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:30:08 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:30:08 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk"/>
Oct 20 10:30:08 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:30:08 user nova-compute[74311]:     </disk>
Oct 20 10:30:08 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:30:08 user nova-compute[74311]:       <mac address="fa:16:3e:8b:a4:67"/>
Oct 20 10:30:08 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:30:08 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:30:08 user nova-compute[74311]:       <target dev="tapaba6ea09-c1"/>
Oct 20 10:30:08 user nova-compute[74311]:     </interface>
Oct 20 10:30:08 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:30:08 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/console.log" append="off"/>
Oct 20 10:30:08 user nova-compute[74311]:     </serial>
Oct 20 10:30:08 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:30:08 user nova-compute[74311]:     <video>
Oct 20 10:30:08 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:30:08 user nova-compute[74311]:     </video>
Oct 20 10:30:08 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:30:08 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:30:08 user nova-compute[74311]:     </rng>
Oct 20 10:30:08 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:30:08 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:30:08 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:30:08 user nova-compute[74311]:     </memballoon>
Oct 20 10:30:08 user nova-compute[74311]:   </devices>
Oct 20 10:30:08 user nova-compute[74311]: </domain>
Oct 20 10:30:08 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:30:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2049730992',display_name='tempest-TestStampPattern-server-2049730992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2049730992',id=37,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxIz+AOQh5BFtvQDWoLXblBp+TB3fi3MeSA/3rUAks7ejyqHfrxlBfgqB6oyecw1P0xdLVr8KQzmCjxwt7BESaDUHM3Wwh/O99KdQsg36VfSYG5rbhAc/v9D0kkQRONKQ==',key_name='tempest-TestStampPattern-1298176157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8eccbc22a0844e5864eb2e4d4c8f3f9',ramdisk_id='',reservation_id='r-4aqr1zl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1787276252',owner_user_name='tempest-TestStampPattern-1787276252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:30:07Z,user_data=None,user_id='3e90400e50b143a09e2936ed67ea5c77',uuid=593a4f46-9b5b-4a3c-95c7-21712b081069,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aba6ea09-c123-48e0-83d2-294027a059c6", "address": "fa:16:3e:8b:a4:67", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba6ea09-c1", "ovs_interfaceid": "aba6ea09-c123-48e0-83d2-294027a059c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Converting VIF {"id": "aba6ea09-c123-48e0-83d2-294027a059c6", "address": "fa:16:3e:8b:a4:67", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba6ea09-c1", "ovs_interfaceid": "aba6ea09-c123-48e0-83d2-294027a059c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:a4:67,bridge_name='br-int',has_traffic_filtering=True,id=aba6ea09-c123-48e0-83d2-294027a059c6,network=Network(e3e17086-dc82-40b0-8b51-655f5083b429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba6ea09-c1') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG os_vif [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:a4:67,bridge_name='br-int',has_traffic_filtering=True,id=aba6ea09-c123-48e0-83d2-294027a059c6,network=Network(e3e17086-dc82-40b0-8b51-655f5083b429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba6ea09-c1') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64ea886c-af87-5007-921f-db4e7ba5efae', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaba6ea09-c1, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaba6ea09-c1, col_values=(('qos', UUID('6f582f21-fb9b-49bc-819f-b93aa9e6330f')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaba6ea09-c1, col_values=(('external_ids', {'iface-id': 'aba6ea09-c123-48e0-83d2-294027a059c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:a4:67', 'vm-uuid': '593a4f46-9b5b-4a3c-95c7-21712b081069'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:08 user nova-compute[74311]: INFO os_vif [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:a4:67,bridge_name='br-int',has_traffic_filtering=True,id=aba6ea09-c123-48e0-83d2-294027a059c6,network=Network(e3e17086-dc82-40b0-8b51-655f5083b429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba6ea09-c1')
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] No VIF found with MAC fa:16:3e:8b:a4:67, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:30:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:09 user nova-compute[74311]: DEBUG nova.network.neutron [req-1e5701db-1b75-48db-be38-cbdd579d788a req-4e19459c-eda6-43d1-9573-5b19860a2c55 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Updated VIF entry in instance network info cache for port aba6ea09-c123-48e0-83d2-294027a059c6. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:30:09 user nova-compute[74311]: DEBUG nova.network.neutron [req-1e5701db-1b75-48db-be38-cbdd579d788a req-4e19459c-eda6-43d1-9573-5b19860a2c55 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Updating instance_info_cache with network_info: [{"id": "aba6ea09-c123-48e0-83d2-294027a059c6", "address": "fa:16:3e:8b:a4:67", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba6ea09-c1", "ovs_interfaceid": "aba6ea09-c123-48e0-83d2-294027a059c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:30:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1e5701db-1b75-48db-be38-cbdd579d788a req-4e19459c-eda6-43d1-9573-5b19860a2c55 service nova] Releasing lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:30:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-8d52caf6-3d36-488b-aef1-b7efbf21462e req-13423d7b-e979-4026-9132-e4c9989c8510 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Received event network-vif-plugged-aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8d52caf6-3d36-488b-aef1-b7efbf21462e req-13423d7b-e979-4026-9132-e4c9989c8510 service nova] Acquiring lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8d52caf6-3d36-488b-aef1-b7efbf21462e req-13423d7b-e979-4026-9132-e4c9989c8510 service nova] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8d52caf6-3d36-488b-aef1-b7efbf21462e req-13423d7b-e979-4026-9132-e4c9989c8510 service nova] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-8d52caf6-3d36-488b-aef1-b7efbf21462e req-13423d7b-e979-4026-9132-e4c9989c8510 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] No waiting events found dispatching network-vif-plugged-aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:10 user nova-compute[74311]: WARNING nova.compute.manager [req-8d52caf6-3d36-488b-aef1-b7efbf21462e req-13423d7b-e979-4026-9132-e4c9989c8510 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Received unexpected event network-vif-plugged-aba6ea09-c123-48e0-83d2-294027a059c6 for instance with vm_state building and task_state spawning.
Oct 20 10:30:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:10 user nova-compute[74311]: INFO nova.compute.manager [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 730bd2ce-cb53-411a-8b74-dafba0d5e2bb] Took 9.04 seconds to detach 1 volumes for instance.
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgPNYAuS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:30:10 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:30:10 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:30:10 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5745c9-fbdc-4783-93d6-463547380751]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:30:10 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfe00f6-7018-49ca-8d94-3f510f10d358]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236] added
Oct 20 10:30:10 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4aa7a5-43f7-42ca-9b05-56b59361b3e9]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[051148f6-716e-49cb-81e2-30dbb087cc39]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GgPNYAuS {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GgPNYAuS" returned: 0 in 0.039s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0989f8-3f43-486e-a08a-64ba6d7f2b90]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GgPNYAuS'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Acquiring lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Acquiring lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:10 user nova-compute[74311]: INFO nova.compute.manager [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Terminating instance
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d3831d-abbe-4d0c-b4ee-6c739d64cb63]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45ab0d2-6eac-400e-97d3-1cd0a07a1d5a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:30:10 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:30:10 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[125cdb11-1a72-4970-bfab-e29db447f5f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236, portal: 172.16.0.220,3260]
Oct 20 10:30:10 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236, portal: 172.16.0.220,3260] successful.
Oct 20 10:30:10 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5fdab7-73a6-4d0d-8acc-55fc6f47dda8]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace1db60-1b25-41c0-983c-3da237bb44ca]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 (non-flash)
Oct 20 10:30:10 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:30:10 user nova-compute[74311]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 (non-flash)
Oct 20 10:30:10 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[123c998f-6a42-4edf-81c0-6eea6f60c38c]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgPNYAuS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.615s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:10 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Deleted allocations for instance 730bd2ce-cb53-411a-8b74-dafba0d5e2bb
Oct 20 10:30:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-845da66c-bde4-409a-ba51-e7dcfcf70a39 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "730bd2ce-cb53-411a-8b74-dafba0d5e2bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.860s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:30:11 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Instance destroyed successfully.
Oct 20 10:30:11 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lazy-loading 'resources' on Instance uuid 1eae0440-1736-4ea3-ba1c-65aa12fa1b56 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1975358397',display_name='tempest-VolumesNegativeTest-instance-1975358397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1975358397',id=34,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:28:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6358c3ec703946d79426dae2da3dab09',ramdisk_id='',reservation_id='r-ma3y9h8u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1768722303',owner_user_name='tempest-VolumesNegativeTest-1768722303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:28:28Z,user_data=None,user_id='7baad432e8e54918aabc660c72e94dc4',uuid=1eae0440-1736-4ea3-ba1c-65aa12fa1b56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "address": "fa:16:3e:a9:b5:14", "network": {"id": "8cac5e04-624c-45f5-bbbd-b225b5ed1f7a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88a2448f77204da4b76f4108232814ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf5a29-63", "ovs_interfaceid": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Converting VIF {"id": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "address": "fa:16:3e:a9:b5:14", "network": {"id": "8cac5e04-624c-45f5-bbbd-b225b5ed1f7a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88a2448f77204da4b76f4108232814ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cdf5a29-63", "ovs_interfaceid": "8cdf5a29-63ef-41f0-9b6b-482dd1de89ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b5:14,bridge_name='br-int',has_traffic_filtering=True,id=8cdf5a29-63ef-41f0-9b6b-482dd1de89ed,network=Network(8cac5e04-624c-45f5-bbbd-b225b5ed1f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdf5a29-63') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG os_vif [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b5:14,bridge_name='br-int',has_traffic_filtering=True,id=8cdf5a29-63ef-41f0-9b6b-482dd1de89ed,network=Network(8cac5e04-624c-45f5-bbbd-b225b5ed1f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdf5a29-63') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cdf5a29-63, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45940d66-d2e4-4fe8-bf24-586bcb7f7aac) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:30:11 user nova-compute[74311]: INFO os_vif [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:b5:14,bridge_name='br-int',has_traffic_filtering=True,id=8cdf5a29-63ef-41f0-9b6b-482dd1de89ed,network=Network(8cac5e04-624c-45f5-bbbd-b225b5ed1f7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cdf5a29-63')
Oct 20 10:30:11 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Deleting instance files /opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56_del
Oct 20 10:30:11 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Deletion of /opt/stack/data/nova/instances/1eae0440-1736-4ea3-ba1c-65aa12fa1b56_del complete
Oct 20 10:30:11 user nova-compute[74311]: INFO nova.compute.manager [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 10:30:11 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '23762313430633663', 'path': '/dev/sdd'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762313430633663', 'path': '/dev/sdd'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG nova.objects.instance [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lazy-loading 'flavor' on Instance uuid 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:30:11 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:30:11 user nova-compute[74311]:   <source dev="/dev/sdd"/>
Oct 20 10:30:11 user nova-compute[74311]:   <target dev="vdc" bus="virtio"/>
Oct 20 10:30:11 user nova-compute[74311]:   <serial>7727f182-ea58-43bc-bb94-cf9e4d956236</serial>
Oct 20 10:30:11 user nova-compute[74311]: </disk>
Oct 20 10:30:11 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:30:11 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Took 0.44 seconds to deallocate network for instance.
Oct 20 10:30:11 user nova-compute[74311]: DEBUG nova.compute.manager [req-6aa0bcf3-92d8-4bac-9832-26ef3d4481a7 req-bccd8da3-55f5-41c1-b5b4-a3855566c546 service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Received event network-vif-deleted-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:11 user nova-compute[74311]: INFO nova.compute.manager [req-6aa0bcf3-92d8-4bac-9832-26ef3d4481a7 req-bccd8da3-55f5-41c1-b5b4-a3855566c546 service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Neutron deleted interface 8cdf5a29-63ef-41f0-9b6b-482dd1de89ed; detaching it from the instance and deleting it from the info cache
Oct 20 10:30:11 user nova-compute[74311]: DEBUG nova.network.neutron [req-6aa0bcf3-92d8-4bac-9832-26ef3d4481a7 req-bccd8da3-55f5-41c1-b5b4-a3855566c546 service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG nova.compute.manager [req-6aa0bcf3-92d8-4bac-9832-26ef3d4481a7 req-bccd8da3-55f5-41c1-b5b4-a3855566c546 service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Detach interface failed, port_id=8cdf5a29-63ef-41f0-9b6b-482dd1de89ed, reason: Instance 1eae0440-1736-4ea3-ba1c-65aa12fa1b56 could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] No VIF found with MAC fa:16:3e:5a:e5:8e, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Received event network-vif-plugged-aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] Acquiring lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] No waiting events found dispatching network-vif-plugged-aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:12 user nova-compute[74311]: WARNING nova.compute.manager [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Received unexpected event network-vif-plugged-aba6ea09-c123-48e0-83d2-294027a059c6 for instance with vm_state building and task_state spawning.
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Received event network-vif-unplugged-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] Acquiring lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] No waiting events found dispatching network-vif-unplugged-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:12 user nova-compute[74311]: WARNING nova.compute.manager [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Received unexpected event network-vif-unplugged-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed for instance with vm_state deleted and task_state None.
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Received event network-vif-plugged-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] Acquiring lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] No waiting events found dispatching network-vif-plugged-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:12 user nova-compute[74311]: WARNING nova.compute.manager [req-81186574-dadb-4a40-8bc0-310d77fad3b0 req-2ba4bde2-aa98-4ceb-a3ff-1ee62772a27c service nova] [instance: 1eae0440-1736-4ea3-ba1c-65aa12fa1b56] Received unexpected event network-vif-plugged-8cdf5a29-63ef-41f0-9b6b-482dd1de89ed for instance with vm_state deleted and task_state None.
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-191565be-6176-4ea5-ac14-31f407b2a04c tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.893s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:12 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Deleted allocations for instance 1eae0440-1736-4ea3-ba1c-65aa12fa1b56
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:30:12 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Instance spawned successfully.
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e396e791-549c-480f-8336-285a3b5eb3a7 tempest-VolumesNegativeTest-1768722303 tempest-VolumesNegativeTest-1768722303-project-member] Lock "1eae0440-1736-4ea3-ba1c-65aa12fa1b56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.958s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:30:12 user nova-compute[74311]: INFO nova.compute.manager [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Took 5.77 seconds to spawn the instance on the hypervisor.
Oct 20 10:30:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:30:12 user nova-compute[74311]: INFO nova.compute.manager [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Took 6.82 seconds to build instance.
Oct 20 10:30:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0c7e709a-c6bc-418b-a2c0-8764e06df723 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.138s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:12 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:30:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:13 user nova-compute[74311]: INFO nova.compute.manager [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Detaching volume 7727f182-ea58-43bc-bb94-cf9e4d956236
Oct 20 10:30:13 user nova-compute[74311]: INFO nova.virt.block_device [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Attempting to driver detach volume 7727f182-ea58-43bc-bb94-cf9e4d956236 from mountpoint /dev/vdc
Oct 20 10:30:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Attempting to detach device vdc from instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:30:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:30:13 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:30:13 user nova-compute[74311]:   <source dev="/dev/sdd"/>
Oct 20 10:30:13 user nova-compute[74311]:   <target dev="vdc" bus="virtio"/>
Oct 20 10:30:13 user nova-compute[74311]:   <serial>7727f182-ea58-43bc-bb94-cf9e4d956236</serial>
Oct 20 10:30:13 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 10:30:13 user nova-compute[74311]: </disk>
Oct 20 10:30:13 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:30:13 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Successfully detached device vdc from instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 from the persistent domain config.
Oct 20 10:30:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:30:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:30:13 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:30:13 user nova-compute[74311]:   <source dev="/dev/sdd"/>
Oct 20 10:30:13 user nova-compute[74311]:   <target dev="vdc" bus="virtio"/>
Oct 20 10:30:13 user nova-compute[74311]:   <serial>7727f182-ea58-43bc-bb94-cf9e4d956236</serial>
Oct 20 10:30:13 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 10:30:13 user nova-compute[74311]: </disk>
Oct 20 10:30:13 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:30:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:30:14 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:30:14 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:30:15 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:30:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:15 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:30:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:17 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:30:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:30:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:30:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:19 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:30:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:19 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:30:19 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:30:19 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:30:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7126MB free_disk=24.96420669555664GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:30:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 922b36b5-0575-4717-a876-dda27469ebb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 3b70780c-e968-4fce-a887-121d4b00218a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 79b6152a-3eec-4412-a063-6e82e767a27b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 00f57349-a3b2-49a1-99f9-97510634f3b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2c91da9a-42ec-46b0-acbe-83b9fe36510a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 593a4f46-9b5b-4a3c-95c7-21712b081069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:30:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:22 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:30:22 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:30:22 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:30:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-ee9c0b77-024a-4a5a-827b-8a410e3f62cb req-761bfa33-1c41-410e-822a-2569467582bb service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Received event network-changed-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-ee9c0b77-024a-4a5a-827b-8a410e3f62cb req-761bfa33-1c41-410e-822a-2569467582bb service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Refreshing instance network info cache due to event network-changed-ebe77cc0-8ca0-4dd5-bca5-dc0794962702. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:30:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee9c0b77-024a-4a5a-827b-8a410e3f62cb req-761bfa33-1c41-410e-822a-2569467582bb service nova] Acquiring lock "refresh_cache-00f57349-a3b2-49a1-99f9-97510634f3b0" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:30:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee9c0b77-024a-4a5a-827b-8a410e3f62cb req-761bfa33-1c41-410e-822a-2569467582bb service nova] Acquired lock "refresh_cache-00f57349-a3b2-49a1-99f9-97510634f3b0" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:30:30 user nova-compute[74311]: DEBUG nova.network.neutron [req-ee9c0b77-024a-4a5a-827b-8a410e3f62cb req-761bfa33-1c41-410e-822a-2569467582bb service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Refreshing network info cache for port ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:30:30 user nova-compute[74311]: DEBUG nova.network.neutron [req-ee9c0b77-024a-4a5a-827b-8a410e3f62cb req-761bfa33-1c41-410e-822a-2569467582bb service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Updated VIF entry in instance network info cache for port ebe77cc0-8ca0-4dd5-bca5-dc0794962702. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:30:30 user nova-compute[74311]: DEBUG nova.network.neutron [req-ee9c0b77-024a-4a5a-827b-8a410e3f62cb req-761bfa33-1c41-410e-822a-2569467582bb service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Updating instance_info_cache with network_info: [{"id": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "address": "fa:16:3e:15:db:5c", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe77cc0-8c", "ovs_interfaceid": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:30:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee9c0b77-024a-4a5a-827b-8a410e3f62cb req-761bfa33-1c41-410e-822a-2569467582bb service nova] Releasing lock "refresh_cache-00f57349-a3b2-49a1-99f9-97510634f3b0" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:30:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:34 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 is timed out.
Oct 20 10:30:34 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Successfully detached device vdc from instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 from the live domain config.
Oct 20 10:30:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgPNYAuS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:30:34 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1231eee1-ffd8-4f63-891d-594e4c860691]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:30:34 user nova-compute[74311]: No targets found.
Oct 20 10:30:34 user nova-compute[74311]: iSNS:
Oct 20 10:30:34 user nova-compute[74311]: No targets found.
Oct 20 10:30:34 user nova-compute[74311]: STATIC:
Oct 20 10:30:34 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:30:34 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:30:34 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:30:34 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728
Oct 20 10:30:34 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:30:34 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:30:34 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236
Oct 20 10:30:34 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:30:34 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:30:34 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc
Oct 20 10:30:34 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:30:34 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:30:34 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478
Oct 20 10:30:34 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:30:34 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:30:34 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548
Oct 20 10:30:34 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:30:34 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:30:34 user nova-compute[74311]: FIRMWARE:
Oct 20 10:30:34 user nova-compute[74311]: No targets found.
Oct 20 10:30:34 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:30:34 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:30:34 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e778789-5d72-4d3f-95e1-afdfa54dd8d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc9b150-fa81-4057-aae1-cbdce9a6a0ad]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:30:34 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:30:34 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:30:34 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:30:34 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:30:34 user nova-compute[74311]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 (non-flash)
Oct 20 10:30:34 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:30:34 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:30:34 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:30:34 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:30:34 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:30:34 user nova-compute[74311]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 (non-flash)
Oct 20 10:30:34 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164f8d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236'): ({'sdd'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Removing single pathed devices sdd {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74c7314-4a42-49ef-81ef-f18d724ebb57]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[647b725d-2ed0-40fc-b33b-6397f5119e32]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Flushing IO for device /dev/sdd {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfca5221-1956-490c-b3c3-6f92912dd094]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c047a71-6d88-41bb-a377-9e7e7d58e335]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0873fb24-7888-4302-ab25-0278698e5268]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[222271df-2b20-4803-9ba9-0fbd8e855d50]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236, portal: 172.16.0.220,3260]
Oct 20 10:30:34 user nova-compute[74311]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236, portal: 172.16.0.220,3260] successful.
Oct 20 10:30:34 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7727f182-ea58-43bc-bb94-cf9e4d956236 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f44cda8-411c-41fc-a3c5-aa076a4588e8]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] <== disconnect_volume: return (348ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:30:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "00f57349-a3b2-49a1-99f9-97510634f3b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'flavor' on Instance uuid 00f57349-a3b2-49a1-99f9-97510634f3b0 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG nova.objects.instance [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lazy-loading 'flavor' on Instance uuid 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "00f57349-a3b2-49a1-99f9-97510634f3b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:35 user nova-compute[74311]: INFO nova.compute.manager [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Attaching volume 55fe5db9-6873-4957-889a-a7df43721a62 to /dev/vdb
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-41cf2301-9f66-420b-8763-43159bb65fcf tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.806s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG os_brick.utils [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce55b67-52b8-4661-90ff-6b6f91247399]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff50084-f498-43a4-929a-bcef30322b16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4ac9dd-90a0-4a14-a1b0-37477934750e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4a798f-12e5-4a7e-bfc6-048a4db5b441]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:30:35 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:30:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2443d0a8-14b3-4259-8da8-9ae4af0d47fe]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG os_brick.utils [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:30:35 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Updating existing volume attachment record: b4d48775-b1ff-488e-93a9-dc6fa12a13ee {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:30:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:38 user nova-compute[74311]: INFO nova.compute.manager [None req-4297a688-4db8-4085-a316-63cb89523875 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Unrescuing
Oct 20 10:30:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4297a688-4db8-4085-a316-63cb89523875 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:30:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4297a688-4db8-4085-a316-63cb89523875 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquired lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:30:38 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4297a688-4db8-4085-a316-63cb89523875 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:30:39 user nova-compute[74311]: DEBUG nova.network.neutron [None req-4297a688-4db8-4085-a316-63cb89523875 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updating instance_info_cache with network_info: [{"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:30:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4297a688-4db8-4085-a316-63cb89523875 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Releasing lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:30:39 user nova-compute[74311]: DEBUG nova.objects.instance [None req-4297a688-4db8-4085-a316-63cb89523875 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'flavor' on Instance uuid ce052ea1-5937-43d6-9ff9-694ff15b7f3e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:30:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-31c857b8-44f6-47b4-8017-dc9c8cf56356 req-f7ed0824-90fe-4d4c-ba3a-b608915258fa service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-vif-unplugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-31c857b8-44f6-47b4-8017-dc9c8cf56356 req-f7ed0824-90fe-4d4c-ba3a-b608915258fa service nova] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-31c857b8-44f6-47b4-8017-dc9c8cf56356 req-f7ed0824-90fe-4d4c-ba3a-b608915258fa service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-31c857b8-44f6-47b4-8017-dc9c8cf56356 req-f7ed0824-90fe-4d4c-ba3a-b608915258fa service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:39 user nova-compute[74311]: DEBUG nova.compute.manager [req-31c857b8-44f6-47b4-8017-dc9c8cf56356 req-f7ed0824-90fe-4d4c-ba3a-b608915258fa service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] No waiting events found dispatching network-vif-unplugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:39 user nova-compute[74311]: WARNING nova.compute.manager [req-31c857b8-44f6-47b4-8017-dc9c8cf56356 req-f7ed0824-90fe-4d4c-ba3a-b608915258fa service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received unexpected event network-vif-unplugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:30:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:40 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Instance destroyed successfully.
Oct 20 10:30:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "3b70780c-e968-4fce-a887-121d4b00218a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "3b70780c-e968-4fce-a887-121d4b00218a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "3b70780c-e968-4fce-a887-121d4b00218a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:41 user nova-compute[74311]: INFO nova.compute.manager [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Terminating instance
Oct 20 10:30:41 user nova-compute[74311]: DEBUG nova.compute.manager [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-c3e4047f-6b1c-4275-aaec-adb899e36ee2 req-5c3e080d-c57c-4c09-a6c2-c1394c8ad546 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c3e4047f-6b1c-4275-aaec-adb899e36ee2 req-5c3e080d-c57c-4c09-a6c2-c1394c8ad546 service nova] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c3e4047f-6b1c-4275-aaec-adb899e36ee2 req-5c3e080d-c57c-4c09-a6c2-c1394c8ad546 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c3e4047f-6b1c-4275-aaec-adb899e36ee2 req-5c3e080d-c57c-4c09-a6c2-c1394c8ad546 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-c3e4047f-6b1c-4275-aaec-adb899e36ee2 req-5c3e080d-c57c-4c09-a6c2-c1394c8ad546 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] No waiting events found dispatching network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:41 user nova-compute[74311]: WARNING nova.compute.manager [req-c3e4047f-6b1c-4275-aaec-adb899e36ee2 req-5c3e080d-c57c-4c09-a6c2-c1394c8ad546 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received unexpected event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:30:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-c3e4047f-6b1c-4275-aaec-adb899e36ee2 req-5c3e080d-c57c-4c09-a6c2-c1394c8ad546 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c3e4047f-6b1c-4275-aaec-adb899e36ee2 req-5c3e080d-c57c-4c09-a6c2-c1394c8ad546 service nova] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c3e4047f-6b1c-4275-aaec-adb899e36ee2 req-5c3e080d-c57c-4c09-a6c2-c1394c8ad546 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c3e4047f-6b1c-4275-aaec-adb899e36ee2 req-5c3e080d-c57c-4c09-a6c2-c1394c8ad546 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-c3e4047f-6b1c-4275-aaec-adb899e36ee2 req-5c3e080d-c57c-4c09-a6c2-c1394c8ad546 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] No waiting events found dispatching network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:41 user nova-compute[74311]: WARNING nova.compute.manager [req-c3e4047f-6b1c-4275-aaec-adb899e36ee2 req-5c3e080d-c57c-4c09-a6c2-c1394c8ad546 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received unexpected event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:30:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-31e2256d-811b-4ded-9136-eaee1ae41362 req-618202d4-4a50-4ab4-b30c-6b5ca86d05a7 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received event network-vif-unplugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-31e2256d-811b-4ded-9136-eaee1ae41362 req-618202d4-4a50-4ab4-b30c-6b5ca86d05a7 service nova] Acquiring lock "3b70780c-e968-4fce-a887-121d4b00218a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-31e2256d-811b-4ded-9136-eaee1ae41362 req-618202d4-4a50-4ab4-b30c-6b5ca86d05a7 service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-31e2256d-811b-4ded-9136-eaee1ae41362 req-618202d4-4a50-4ab4-b30c-6b5ca86d05a7 service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-31e2256d-811b-4ded-9136-eaee1ae41362 req-618202d4-4a50-4ab4-b30c-6b5ca86d05a7 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] No waiting events found dispatching network-vif-unplugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-31e2256d-811b-4ded-9136-eaee1ae41362 req-618202d4-4a50-4ab4-b30c-6b5ca86d05a7 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received event network-vif-unplugged-e240d2ee-098d-4047-97e1-e81090552740 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:42 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Instance destroyed successfully.
Oct 20 10:30:42 user nova-compute[74311]: DEBUG nova.objects.instance [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lazy-loading 'resources' on Instance uuid 3b70780c-e968-4fce-a887-121d4b00218a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:24:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1216890647',display_name='tempest-ServerActionsTestOtherA-server-1216890647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1216890647',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrV3Ete25j/fWp9se4mxMWH8BlUBzypkEKDQ+cEJ4VP8hCjsvoAfM2JugNca5+qdBC1FO7G9hMianDZcBDCqTf2/GGIFqvMCvoR42Lgy+aDjy2Ay+qKFAL51raC0WY1Gw==',key_name='tempest-keypair-317846828',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:26:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-0vwgd7k7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:27:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=3b70780c-e968-4fce-a887-121d4b00218a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "e240d2ee-098d-4047-97e1-e81090552740", "address": "fa:16:3e:36:f6:51", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape240d2ee-09", "ovs_interfaceid": "e240d2ee-098d-4047-97e1-e81090552740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=e240d2ee-098d-4047-97e1-e81090552740,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240d2ee-09') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_vif [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=e240d2ee-098d-4047-97e1-e81090552740,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240d2ee-09') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape240d2ee-09, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f65ec3e-1ef8-4b25-9bb2-c2fcf3b4930e) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:42 user nova-compute[74311]: INFO os_vif [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:f6:51,bridge_name='br-int',has_traffic_filtering=True,id=e240d2ee-098d-4047-97e1-e81090552740,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240d2ee-09')
Oct 20 10:30:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MlIvXJBs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:30:42 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e03887f-9924-4153-8deb-a3d42789ea78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:30:42 user nova-compute[74311]: No targets found.
Oct 20 10:30:42 user nova-compute[74311]: iSNS:
Oct 20 10:30:42 user nova-compute[74311]: No targets found.
Oct 20 10:30:42 user nova-compute[74311]: STATIC:
Oct 20 10:30:42 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:30:42 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:30:42 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:30:42 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728
Oct 20 10:30:42 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:30:42 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:30:42 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc
Oct 20 10:30:42 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:30:42 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:30:42 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478
Oct 20 10:30:42 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:30:42 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:30:42 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548
Oct 20 10:30:42 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:30:42 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:30:42 user nova-compute[74311]: FIRMWARE:
Oct 20 10:30:42 user nova-compute[74311]: No targets found.
Oct 20 10:30:42 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:30:42 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:30:42 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d47e147-d9c4-4b9d-90a0-156777df69ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[358f527e-9a30-4739-98a9-cc795b82825c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:30:42 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:30:42 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:30:42 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:30:42 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:30:42 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:30:42 user nova-compute[74311]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 (non-flash)
Oct 20 10:30:42 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:30:42 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:30:42 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:30:42 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164cf76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55274c3-0ec8-4a4b-ab30-1887d2a0c5ae]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e21952-0251-49d7-ae2e-52b3b625f08b]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c6ed82-aad1-4032-9607-4b05e8d0f6a4]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[261083ce-7eef-4c82-8c97-07af79d45ec0]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccffefb9-8f5f-4dd0-8ff1-a920eacc68a7]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ef3178-39f1-479b-8e4e-42794c2ee168]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260]
Oct 20 10:30:42 user nova-compute[74311]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728, portal: 172.16.0.220,3260] successful.
Oct 20 10:30:42 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78d2e0a3-6f17-494b-bb62-eee5bbb10728 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef8a7bf-688b-44a6-8cdd-d7c4c5d95e96]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] <== disconnect_volume: return (349ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:30:42 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Deleting instance files /opt/stack/data/nova/instances/3b70780c-e968-4fce-a887-121d4b00218a_del
Oct 20 10:30:42 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Deletion of /opt/stack/data/nova/instances/3b70780c-e968-4fce-a887-121d4b00218a_del complete
Oct 20 10:30:42 user nova-compute[74311]: INFO nova.compute.manager [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 20 10:30:42 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:30:42 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:30:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:43 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4297a688-4db8-4085-a316-63cb89523875 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:30:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-3d86044e-7609-44c2-99a5-e87c09926b86 req-10ffcc0f-36f0-405d-9eea-033f04f1851f service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3d86044e-7609-44c2-99a5-e87c09926b86 req-10ffcc0f-36f0-405d-9eea-033f04f1851f service nova] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3d86044e-7609-44c2-99a5-e87c09926b86 req-10ffcc0f-36f0-405d-9eea-033f04f1851f service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3d86044e-7609-44c2-99a5-e87c09926b86 req-10ffcc0f-36f0-405d-9eea-033f04f1851f service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-3d86044e-7609-44c2-99a5-e87c09926b86 req-10ffcc0f-36f0-405d-9eea-033f04f1851f service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] No waiting events found dispatching network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:43 user nova-compute[74311]: WARNING nova.compute.manager [req-3d86044e-7609-44c2-99a5-e87c09926b86 req-10ffcc0f-36f0-405d-9eea-033f04f1851f service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received unexpected event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b for instance with vm_state rescued and task_state unrescuing.
Oct 20 10:30:43 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:30:43 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Took 1.04 seconds to deallocate network for instance.
Oct 20 10:30:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-da2e3793-beac-48a3-ac13-0e6cc9e889e0 req-40b6eeb0-9772-4569-b0f8-fab0df4d8982 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received event network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-da2e3793-beac-48a3-ac13-0e6cc9e889e0 req-40b6eeb0-9772-4569-b0f8-fab0df4d8982 service nova] Acquiring lock "3b70780c-e968-4fce-a887-121d4b00218a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-da2e3793-beac-48a3-ac13-0e6cc9e889e0 req-40b6eeb0-9772-4569-b0f8-fab0df4d8982 service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-da2e3793-beac-48a3-ac13-0e6cc9e889e0 req-40b6eeb0-9772-4569-b0f8-fab0df4d8982 service nova] Lock "3b70780c-e968-4fce-a887-121d4b00218a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-da2e3793-beac-48a3-ac13-0e6cc9e889e0 req-40b6eeb0-9772-4569-b0f8-fab0df4d8982 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] No waiting events found dispatching network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:44 user nova-compute[74311]: WARNING nova.compute.manager [req-da2e3793-beac-48a3-ac13-0e6cc9e889e0 req-40b6eeb0-9772-4569-b0f8-fab0df4d8982 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received unexpected event network-vif-plugged-e240d2ee-098d-4047-97e1-e81090552740 for instance with vm_state active and task_state deleting.
Oct 20 10:30:44 user nova-compute[74311]: DEBUG nova.compute.manager [req-da2e3793-beac-48a3-ac13-0e6cc9e889e0 req-40b6eeb0-9772-4569-b0f8-fab0df4d8982 service nova] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Received event network-vif-deleted-e240d2ee-098d-4047-97e1-e81090552740 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:44 user nova-compute[74311]: INFO nova.compute.manager [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Took 0.83 seconds to detach 1 volumes for instance.
Oct 20 10:30:44 user nova-compute[74311]: DEBUG nova.compute.manager [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: 3b70780c-e968-4fce-a887-121d4b00218a] Deleting volume: 78d2e0a3-6f17-494b-bb62-eee5bbb10728 {{(pid=74311) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 10:30:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:45 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:30:45 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:30:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:45 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Deleted allocations for instance 3b70780c-e968-4fce-a887-121d4b00218a
Oct 20 10:30:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-331d7ad6-05ba-41a6-86bd-758fe79cd730 tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "3b70780c-e968-4fce-a887-121d4b00218a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.859s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "922b36b5-0575-4717-a876-dda27469ebb2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "922b36b5-0575-4717-a876-dda27469ebb2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "922b36b5-0575-4717-a876-dda27469ebb2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "922b36b5-0575-4717-a876-dda27469ebb2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "922b36b5-0575-4717-a876-dda27469ebb2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:49 user nova-compute[74311]: INFO nova.compute.manager [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Terminating instance
Oct 20 10:30:50 user nova-compute[74311]: DEBUG nova.compute.manager [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG nova.compute.manager [req-2356a610-fffc-42d1-8fd0-75f44f49adcd req-b5788bab-9ef9-433f-8bf4-aeb35b92ba1a service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Received event network-vif-unplugged-f3b77955-fd93-4421-941d-b99f0d54ebbc {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2356a610-fffc-42d1-8fd0-75f44f49adcd req-b5788bab-9ef9-433f-8bf4-aeb35b92ba1a service nova] Acquiring lock "922b36b5-0575-4717-a876-dda27469ebb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2356a610-fffc-42d1-8fd0-75f44f49adcd req-b5788bab-9ef9-433f-8bf4-aeb35b92ba1a service nova] Lock "922b36b5-0575-4717-a876-dda27469ebb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2356a610-fffc-42d1-8fd0-75f44f49adcd req-b5788bab-9ef9-433f-8bf4-aeb35b92ba1a service nova] Lock "922b36b5-0575-4717-a876-dda27469ebb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG nova.compute.manager [req-2356a610-fffc-42d1-8fd0-75f44f49adcd req-b5788bab-9ef9-433f-8bf4-aeb35b92ba1a service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] No waiting events found dispatching network-vif-unplugged-f3b77955-fd93-4421-941d-b99f0d54ebbc {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG nova.compute.manager [req-2356a610-fffc-42d1-8fd0-75f44f49adcd req-b5788bab-9ef9-433f-8bf4-aeb35b92ba1a service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Received event network-vif-unplugged-f3b77955-fd93-4421-941d-b99f0d54ebbc for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:50 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Instance destroyed successfully.
Oct 20 10:30:50 user nova-compute[74311]: DEBUG nova.objects.instance [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'resources' on Instance uuid 922b36b5-0575-4717-a876-dda27469ebb2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:21:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1406375063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1406375063',id=23,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:21:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090bd6a8a14d4a308e67be7a12e47ae6',ramdisk_id='',reservation_id='r-xo0ylhoy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:23:25Z,user_data=None,user_id='0c6b76de1f054ca0973f2f9ba2eafaed',uuid=922b36b5-0575-4717-a876-dda27469ebb2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "address": "fa:16:3e:51:48:ab", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b77955-fd", "ovs_interfaceid": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converting VIF {"id": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "address": "fa:16:3e:51:48:ab", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b77955-fd", "ovs_interfaceid": "f3b77955-fd93-4421-941d-b99f0d54ebbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=f3b77955-fd93-4421-941d-b99f0d54ebbc,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b77955-fd') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG os_vif [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=f3b77955-fd93-4421-941d-b99f0d54ebbc,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b77955-fd') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3b77955-fd, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7a2c78c-749a-4b2d-8022-be4ee69b8f7e) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:50 user nova-compute[74311]: INFO os_vif [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=f3b77955-fd93-4421-941d-b99f0d54ebbc,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b77955-fd')
Oct 20 10:30:50 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Deleting instance files /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2_del
Oct 20 10:30:50 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Deletion of /opt/stack/data/nova/instances/922b36b5-0575-4717-a876-dda27469ebb2_del complete
Oct 20 10:30:50 user nova-compute[74311]: INFO nova.compute.manager [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 10:30:50 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:30:50 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:30:51 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:30:51 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Took 0.44 seconds to deallocate network for instance.
Oct 20 10:30:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-ab6979b3-9437-40f2-8cc7-7300bb519056 req-88ecb5cc-f69c-4d95-af21-78af30df9318 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Received event network-vif-deleted-f3b77955-fd93-4421-941d-b99f0d54ebbc {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:51 user nova-compute[74311]: INFO nova.compute.manager [req-ab6979b3-9437-40f2-8cc7-7300bb519056 req-88ecb5cc-f69c-4d95-af21-78af30df9318 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Neutron deleted interface f3b77955-fd93-4421-941d-b99f0d54ebbc; detaching it from the instance and deleting it from the info cache
Oct 20 10:30:51 user nova-compute[74311]: DEBUG nova.network.neutron [req-ab6979b3-9437-40f2-8cc7-7300bb519056 req-88ecb5cc-f69c-4d95-af21-78af30df9318 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:30:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-ab6979b3-9437-40f2-8cc7-7300bb519056 req-88ecb5cc-f69c-4d95-af21-78af30df9318 service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Detach interface failed, port_id=f3b77955-fd93-4421-941d-b99f0d54ebbc, reason: Instance 922b36b5-0575-4717-a876-dda27469ebb2 could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:30:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:51 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:30:51 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:30:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:51 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Deleted allocations for instance 922b36b5-0575-4717-a876-dda27469ebb2
Oct 20 10:30:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2c2aa59b-8042-472a-b00f-3a47c312fc10 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "922b36b5-0575-4717-a876-dda27469ebb2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.975s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-f8a0eefb-8dca-4000-a0cc-6f5c2b5c770a req-ca5ceb29-b318-4243-908b-60096972446d service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Received event network-vif-plugged-f3b77955-fd93-4421-941d-b99f0d54ebbc {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f8a0eefb-8dca-4000-a0cc-6f5c2b5c770a req-ca5ceb29-b318-4243-908b-60096972446d service nova] Acquiring lock "922b36b5-0575-4717-a876-dda27469ebb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f8a0eefb-8dca-4000-a0cc-6f5c2b5c770a req-ca5ceb29-b318-4243-908b-60096972446d service nova] Lock "922b36b5-0575-4717-a876-dda27469ebb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f8a0eefb-8dca-4000-a0cc-6f5c2b5c770a req-ca5ceb29-b318-4243-908b-60096972446d service nova] Lock "922b36b5-0575-4717-a876-dda27469ebb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-f8a0eefb-8dca-4000-a0cc-6f5c2b5c770a req-ca5ceb29-b318-4243-908b-60096972446d service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] No waiting events found dispatching network-vif-plugged-f3b77955-fd93-4421-941d-b99f0d54ebbc {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:52 user nova-compute[74311]: WARNING nova.compute.manager [req-f8a0eefb-8dca-4000-a0cc-6f5c2b5c770a req-ca5ceb29-b318-4243-908b-60096972446d service nova] [instance: 922b36b5-0575-4717-a876-dda27469ebb2] Received unexpected event network-vif-plugged-f3b77955-fd93-4421-941d-b99f0d54ebbc for instance with vm_state deleted and task_state None.
Oct 20 10:30:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mvPsAOtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:30:53 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:30:53 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:30:53 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1028b1bf-95eb-496c-bd8d-f23482969284]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:30:53 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d770d0eb-4e6f-44cc-ba8c-a2f9fe8bb1ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62] added
Oct 20 10:30:53 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2973dd-db84-455c-ab83-a502810ec11f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b503a2-5e5d-417d-bf9e-dd02cf06de10]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mvPsAOtw {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mvPsAOtw" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[11630aae-ff6d-4333-8000-490af37855af]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mvPsAOtw'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c2df28-80ea-4c98-a414-c16722d3c2c2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f46d0f6-878d-47c9-99d2-c6aa394feb62]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:30:53 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:30:53 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:30:53 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:30:53 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:30:53 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:30:53 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:30:53 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:30:53 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c94d7a-c360-4929-9bb7-75c21fbeeaf0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62, portal: 172.16.0.220,3260]
Oct 20 10:30:53 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62, portal: 172.16.0.220,3260] successful.
Oct 20 10:30:53 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6be5997-d9d0-4596-88c2-76016e2628b4]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[222fb57a-e2bd-4849-afa3-eb42454d28c9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:30:53 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:30:53 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:30:53 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:30:53 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:30:53 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:30:53 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:30:53 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:30:53 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:30:53 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:30:53 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[860d475e-2adc-4f61-b13f-788e3caaac55]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:30:53 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:30:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:30:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mvPsAOtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:30:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:30:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23832393238373439', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:30:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832393238373439', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:30:54 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'flavor' on Instance uuid 00f57349-a3b2-49a1-99f9-97510634f3b0 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:30:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:30:54 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:30:54 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:30:54 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:30:54 user nova-compute[74311]:   <serial>55fe5db9-6873-4957-889a-a7df43721a62</serial>
Oct 20 10:30:54 user nova-compute[74311]: </disk>
Oct 20 10:30:54 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:30:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:30:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:30:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] No VIF found with MAC fa:16:3e:15:db:5c, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:30:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e1296da4-792d-4e34-937b-e5a7333b3cbe tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.271s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "79b6152a-3eec-4412-a063-6e82e767a27b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "79b6152a-3eec-4412-a063-6e82e767a27b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:59 user nova-compute[74311]: INFO nova.compute.manager [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Terminating instance
Oct 20 10:30:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-0cf25128-4ac8-459f-971c-d6c982e5d61a req-a289f685-c4b6-49ab-9858-6a6c70feefeb service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received event network-vif-unplugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0cf25128-4ac8-459f-971c-d6c982e5d61a req-a289f685-c4b6-49ab-9858-6a6c70feefeb service nova] Acquiring lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0cf25128-4ac8-459f-971c-d6c982e5d61a req-a289f685-c4b6-49ab-9858-6a6c70feefeb service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0cf25128-4ac8-459f-971c-d6c982e5d61a req-a289f685-c4b6-49ab-9858-6a6c70feefeb service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-0cf25128-4ac8-459f-971c-d6c982e5d61a req-a289f685-c4b6-49ab-9858-6a6c70feefeb service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] No waiting events found dispatching network-vif-unplugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-0cf25128-4ac8-459f-971c-d6c982e5d61a req-a289f685-c4b6-49ab-9858-6a6c70feefeb service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received event network-vif-unplugged-672b83f5-751d-4964-b6e0-32d120958173 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:30:59 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Instance destroyed successfully.
Oct 20 10:30:59 user nova-compute[74311]: DEBUG nova.objects.instance [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lazy-loading 'resources' on Instance uuid 79b6152a-3eec-4412-a063-6e82e767a27b {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T10:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1929909354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1993782106',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzWhCvMVV6Y1XH/5Ox4S/1XTdcuZMP+vIAuIbp6IPW5DjnB21INUyKyNNxDYjm1qgk+5N7ar0+Y70BR6OMQrtuOTQnI1wGTcSxNpOQfz4xGTk69kpB66KvLuwztnTuwZg==',key_name='tempest-keypair-431497461',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:29:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9820bd4a09494eaf858e88301f6c5827',ramdisk_id='',reservation_id='r-81m98auw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-804114643',owner_user_name='tempest-ServerActionsV293TestJSON-804114643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:29:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0134a62628fe4dd29bfd61a987d099d3',uuid=79b6152a-3eec-4412-a063-6e82e767a27b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Converting VIF {"id": "672b83f5-751d-4964-b6e0-32d120958173", "address": "fa:16:3e:cc:fe:ae", "network": {"id": "630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1421195253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9820bd4a09494eaf858e88301f6c5827", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap672b83f5-75", "ovs_interfaceid": "672b83f5-751d-4964-b6e0-32d120958173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:fe:ae,bridge_name='br-int',has_traffic_filtering=True,id=672b83f5-751d-4964-b6e0-32d120958173,network=Network(630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap672b83f5-75') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG os_vif [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:fe:ae,bridge_name='br-int',has_traffic_filtering=True,id=672b83f5-751d-4964-b6e0-32d120958173,network=Network(630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap672b83f5-75') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap672b83f5-75, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d54df1a-9ed5-4724-875f-9a76cfbd8eed) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:30:59 user nova-compute[74311]: INFO os_vif [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:fe:ae,bridge_name='br-int',has_traffic_filtering=True,id=672b83f5-751d-4964-b6e0-32d120958173,network=Network(630a8ff5-c57c-42ae-8aa0-bb4d9b9ca332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap672b83f5-75')
Oct 20 10:30:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGnQdEte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:30:59 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:30:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:30:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece2e366-67fd-40f9-adb7-ef4b035a2c10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:31:00 user nova-compute[74311]: No targets found.
Oct 20 10:31:00 user nova-compute[74311]: iSNS:
Oct 20 10:31:00 user nova-compute[74311]: No targets found.
Oct 20 10:31:00 user nova-compute[74311]: STATIC:
Oct 20 10:31:00 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62
Oct 20 10:31:00 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:00 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:00 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:31:00 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:00 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:00 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc
Oct 20 10:31:00 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:00 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:00 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478
Oct 20 10:31:00 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:00 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:00 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548
Oct 20 10:31:00 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:00 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:00 user nova-compute[74311]: FIRMWARE:
Oct 20 10:31:00 user nova-compute[74311]: No targets found.
Oct 20 10:31:00 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:31:00 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:31:00 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e539f15-c45b-4cb1-b99c-257474cd4430]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e005c2-16e9-4116-97e3-7b42fc5c84b6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:31:00 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:00 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:31:00 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:31:00 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:00 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:31:00 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:00 user nova-compute[74311]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 (non-flash)
Oct 20 10:31:00 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:31:00 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:00 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1887a3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548'): ({'sdc'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Removing single pathed devices sdc {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[709cea5b-cdbc-45e7-8138-749c4108dd21]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff0ff00-9c6c-4a6c-b795-8555d6a22867]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Flushing IO for device /dev/sdc {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6039da07-9615-43e3-a918-41b03203569c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0332b8-a4dc-4761-ae96-ad6154bf194c]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96dc479-7057-4a98-8813-3f0b836309ba]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e0cb87-e596-4a99-95f2-4f9c9cf46342]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260]
Oct 20 10:31:00 user nova-compute[74311]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548, portal: 172.16.0.220,3260] successful.
Oct 20 10:31:00 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d865eed-f501-4a9b-a4f2-8fd737339548 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf101a0-4f5a-444a-b020-4a6e58ee9f95]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] <== disconnect_volume: return (354ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:31:00 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Deleting instance files /opt/stack/data/nova/instances/79b6152a-3eec-4412-a063-6e82e767a27b_del
Oct 20 10:31:00 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Deletion of /opt/stack/data/nova/instances/79b6152a-3eec-4412-a063-6e82e767a27b_del complete
Oct 20 10:31:00 user nova-compute[74311]: INFO nova.compute.manager [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Took 1.29 seconds to destroy the instance on the hypervisor.
Oct 20 10:31:00 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:31:00 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:31:01 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:31:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-3e95d44a-27d0-4179-8fb2-fb29869a99dc req-17fbf1c2-1402-4978-a619-fc6ca18b3eb1 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received event network-vif-deleted-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:31:01 user nova-compute[74311]: INFO nova.compute.manager [req-3e95d44a-27d0-4179-8fb2-fb29869a99dc req-17fbf1c2-1402-4978-a619-fc6ca18b3eb1 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Neutron deleted interface 672b83f5-751d-4964-b6e0-32d120958173; detaching it from the instance and deleting it from the info cache
Oct 20 10:31:01 user nova-compute[74311]: DEBUG nova.network.neutron [req-3e95d44a-27d0-4179-8fb2-fb29869a99dc req-17fbf1c2-1402-4978-a619-fc6ca18b3eb1 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:31:01 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Took 0.71 seconds to deallocate network for instance.
Oct 20 10:31:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-3e95d44a-27d0-4179-8fb2-fb29869a99dc req-17fbf1c2-1402-4978-a619-fc6ca18b3eb1 service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Detach interface failed, port_id=672b83f5-751d-4964-b6e0-32d120958173, reason: Instance 79b6152a-3eec-4412-a063-6e82e767a27b could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:31:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-c4f440ed-efb7-4e39-97c0-21d1a28ddbf1 req-f0e2a464-00d8-41d7-9d8d-ab2f2b2f3d8c service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received event network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:31:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c4f440ed-efb7-4e39-97c0-21d1a28ddbf1 req-f0e2a464-00d8-41d7-9d8d-ab2f2b2f3d8c service nova] Acquiring lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c4f440ed-efb7-4e39-97c0-21d1a28ddbf1 req-f0e2a464-00d8-41d7-9d8d-ab2f2b2f3d8c service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c4f440ed-efb7-4e39-97c0-21d1a28ddbf1 req-f0e2a464-00d8-41d7-9d8d-ab2f2b2f3d8c service nova] Lock "79b6152a-3eec-4412-a063-6e82e767a27b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-c4f440ed-efb7-4e39-97c0-21d1a28ddbf1 req-f0e2a464-00d8-41d7-9d8d-ab2f2b2f3d8c service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] No waiting events found dispatching network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:31:01 user nova-compute[74311]: WARNING nova.compute.manager [req-c4f440ed-efb7-4e39-97c0-21d1a28ddbf1 req-f0e2a464-00d8-41d7-9d8d-ab2f2b2f3d8c service nova] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Received unexpected event network-vif-plugged-672b83f5-751d-4964-b6e0-32d120958173 for instance with vm_state active and task_state deleting.
Oct 20 10:31:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "00f57349-a3b2-49a1-99f9-97510634f3b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:01 user nova-compute[74311]: DEBUG nova.objects.instance [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'flavor' on Instance uuid 00f57349-a3b2-49a1-99f9-97510634f3b0 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:31:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:02 user nova-compute[74311]: INFO nova.compute.manager [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Took 0.85 seconds to detach 1 volumes for instance.
Oct 20 10:31:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] [instance: 79b6152a-3eec-4412-a063-6e82e767a27b] Deleting volume: 9d865eed-f501-4a9b-a4f2-8fd737339548 {{(pid=74311) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "00f57349-a3b2-49a1-99f9-97510634f3b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:02 user nova-compute[74311]: INFO nova.compute.manager [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Attaching volume c3bdfcdc-b429-4ce3-8eca-c04939001e00 to /dev/vdc
Oct 20 10:31:02 user nova-compute[74311]: DEBUG os_brick.utils [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fb28a1-52a6-4eae-a3b3-58a755b66612]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[79facd39-cc6e-4d01-a00f-d8911154d659]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5a0771-a12b-4816-be4c-9052139ab94f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fa8d08-a1f4-4c1e-9d28-7a7d9ac63672]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:31:02 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b556aec-a40a-4408-b2f7-92b0c0205e5b]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG os_brick.utils [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Updating existing volume attachment record: d5df1a46-2e46-4f68-86d3-0e5a6914148d {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:02 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Deleted allocations for instance 79b6152a-3eec-4412-a063-6e82e767a27b
Oct 20 10:31:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-74dc678d-8101-407b-9778-ddfb8b89544c tempest-ServerActionsV293TestJSON-804114643 tempest-ServerActionsV293TestJSON-804114643-project-member] Lock "79b6152a-3eec-4412-a063-6e82e767a27b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.675s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:03 user nova-compute[74311]: INFO nova.compute.manager [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Detaching volume ac503668-162e-484e-802b-c3c38764a2cc
Oct 20 10:31:04 user nova-compute[74311]: INFO nova.virt.block_device [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Attempting to driver detach volume ac503668-162e-484e-802b-c3c38764a2cc from mountpoint /dev/vdb
Oct 20 10:31:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Attempting to detach device vdb from instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:31:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:31:04 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:31:04 user nova-compute[74311]:   <source dev="/dev/sdg"/>
Oct 20 10:31:04 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:31:04 user nova-compute[74311]:   <serial>ac503668-162e-484e-802b-c3c38764a2cc</serial>
Oct 20 10:31:04 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:31:04 user nova-compute[74311]: </disk>
Oct 20 10:31:04 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:31:04 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Successfully detached device vdb from instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 from the persistent domain config.
Oct 20 10:31:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:31:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:31:04 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:31:04 user nova-compute[74311]:   <source dev="/dev/sdg"/>
Oct 20 10:31:04 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:31:04 user nova-compute[74311]:   <serial>ac503668-162e-484e-802b-c3c38764a2cc</serial>
Oct 20 10:31:04 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:31:04 user nova-compute[74311]: </disk>
Oct 20 10:31:04 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:31:04 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:31:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:05 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:31:05 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:31:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:31:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:31:05 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:31:05 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Updating instance_info_cache with network_info: [{"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:31:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:31:05 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:31:07 user nova-compute[74311]: DEBUG nova.compute.manager [req-23b71ca4-02fd-4367-98d8-d1241b01ca35 req-76c71bbe-c150-4c01-a68a-edb62f8c8ee6 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Received event network-changed-0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:31:07 user nova-compute[74311]: DEBUG nova.compute.manager [req-23b71ca4-02fd-4367-98d8-d1241b01ca35 req-76c71bbe-c150-4c01-a68a-edb62f8c8ee6 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Refreshing instance network info cache due to event network-changed-0f62e9d8-7d48-4066-b706-a7fb7bc61869. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:31:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-23b71ca4-02fd-4367-98d8-d1241b01ca35 req-76c71bbe-c150-4c01-a68a-edb62f8c8ee6 service nova] Acquiring lock "refresh_cache-2c91da9a-42ec-46b0-acbe-83b9fe36510a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:31:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-23b71ca4-02fd-4367-98d8-d1241b01ca35 req-76c71bbe-c150-4c01-a68a-edb62f8c8ee6 service nova] Acquired lock "refresh_cache-2c91da9a-42ec-46b0-acbe-83b9fe36510a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:31:07 user nova-compute[74311]: DEBUG nova.network.neutron [req-23b71ca4-02fd-4367-98d8-d1241b01ca35 req-76c71bbe-c150-4c01-a68a-edb62f8c8ee6 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Refreshing network info cache for port 0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:31:07 user nova-compute[74311]: DEBUG nova.network.neutron [req-23b71ca4-02fd-4367-98d8-d1241b01ca35 req-76c71bbe-c150-4c01-a68a-edb62f8c8ee6 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Updated VIF entry in instance network info cache for port 0f62e9d8-7d48-4066-b706-a7fb7bc61869. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:31:07 user nova-compute[74311]: DEBUG nova.network.neutron [req-23b71ca4-02fd-4367-98d8-d1241b01ca35 req-76c71bbe-c150-4c01-a68a-edb62f8c8ee6 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Updating instance_info_cache with network_info: [{"id": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "address": "fa:16:3e:ae:4e:4e", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f62e9d8-7d", "ovs_interfaceid": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:31:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-23b71ca4-02fd-4367-98d8-d1241b01ca35 req-76c71bbe-c150-4c01-a68a-edb62f8c8ee6 service nova] Releasing lock "refresh_cache-2c91da9a-42ec-46b0-acbe-83b9fe36510a" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:31:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:10 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG nova.objects.instance [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'flavor' on Instance uuid 2c91da9a-42ec-46b0-acbe-83b9fe36510a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:13 user nova-compute[74311]: INFO nova.compute.manager [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Attaching volume ec8a7672-cfcf-4d4c-9b76-68d8c4396efe to /dev/vdb
Oct 20 10:31:13 user nova-compute[74311]: DEBUG os_brick.utils [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[814925b3-183a-4193-bbce-bb67f9543065]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74cd13b-5d47-422c-aafa-882462f5eb22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d3d6e5-8ae6-4968-b371-654bdfbaa96e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[54368cb7-4ac7-4cd2-8f71-3c9bfb3c592d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:31:13 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:31:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a17b18-e747-412f-abca-6beaf18861d3]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG os_brick.utils [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Updating existing volume attachment record: ffff5fa2-3fab-41b1-81be-48d9bad9b5be {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:31:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:14 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:31:16 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:31:16 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:31:17 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:31:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:17 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:31:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:31:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:19 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:31:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnfLlaDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:31:20 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:31:20 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:31:20 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7d1e95-778d-428d-9f8d-5ac058de2f3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:31:20 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9a1125-40d8-4c66-9ac3-ccec213806fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00] added
Oct 20 10:31:20 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc2431c-f45f-4f9d-9c0b-6ced1114c136]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf499abf-832a-4256-a3b5-7bbe6365a857]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qnfLlaDs {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qnfLlaDs" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b25d19-a7f2-4f19-a8c8-f0a975e73e0d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qnfLlaDs'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5a948d-e628-4133-9d4b-3d9b36b773d1]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc01fda7-b454-4d37-8942-27a59a943443]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:31:20 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:20 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:31:20 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:20 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:31:20 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:20 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:31:20 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:20 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[136ffd27-9a8c-49b1-b206-858c38938e1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00, portal: 172.16.0.220,3260]
Oct 20 10:31:20 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00, portal: 172.16.0.220,3260] successful.
Oct 20 10:31:20 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[773aceae-33d4-47c4-9d6b-24e064c69961]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb8e177-3a23-42c1-a47a-232bd2808621]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:31:20 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:20 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:31:20 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:20 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:31:20 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:31:20 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:20 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:31:20 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:20 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:31:20 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3919d7bd-2623-43de-8c09-93009fc32f2a]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnfLlaDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.615s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] <== connect_volume: return (1618ms) {'type': 'block', 'scsi_wwn': '23861386630656331', 'path': '/dev/sdc'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861386630656331', 'path': '/dev/sdc'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:31:21 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:31:21 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7501MB free_disk=25.058231353759766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.objects.instance [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'flavor' on Instance uuid 00f57349-a3b2-49a1-99f9-97510634f3b0 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:31:21 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:31:21 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:31:21 user nova-compute[74311]:   <target dev="vdc" bus="virtio"/>
Oct 20 10:31:21 user nova-compute[74311]:   <serial>c3bdfcdc-b429-4ce3-8eca-c04939001e00</serial>
Oct 20 10:31:21 user nova-compute[74311]: </disk>
Oct 20 10:31:21 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance b0b457b8-159b-4533-ac97-dab7ffe0945e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance cfc97865-6f94-4924-afc5-188d50543672 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 560c41a4-79a3-461d-976d-f260bc9086f8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 00f57349-a3b2-49a1-99f9-97510634f3b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2c91da9a-42ec-46b0-acbe-83b9fe36510a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 593a4f46-9b5b-4a3c-95c7-21712b081069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:31:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:31:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:31:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:31:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:31:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] No VIF found with MAC fa:16:3e:15:db:5c, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:31:22 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:31:22 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:31:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc8649a6-93fc-409d-921a-6eb879f17532 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.261s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:22 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:31:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "00f57349-a3b2-49a1-99f9-97510634f3b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:23 user nova-compute[74311]: INFO nova.compute.manager [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Detaching volume 55fe5db9-6873-4957-889a-a7df43721a62
Oct 20 10:31:23 user nova-compute[74311]: INFO nova.virt.block_device [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Attempting to driver detach volume 55fe5db9-6873-4957-889a-a7df43721a62 from mountpoint /dev/vdb
Oct 20 10:31:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Attempting to detach device vdb from instance 00f57349-a3b2-49a1-99f9-97510634f3b0 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:31:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:31:23 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:31:23 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:31:23 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:31:23 user nova-compute[74311]:   <serial>55fe5db9-6873-4957-889a-a7df43721a62</serial>
Oct 20 10:31:23 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:31:23 user nova-compute[74311]: </disk>
Oct 20 10:31:23 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:31:23 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Successfully detached device vdb from instance 00f57349-a3b2-49a1-99f9-97510634f3b0 from the persistent domain config.
Oct 20 10:31:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00f57349-a3b2-49a1-99f9-97510634f3b0 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:31:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:31:23 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:31:23 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:31:23 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:31:23 user nova-compute[74311]:   <serial>55fe5db9-6873-4957-889a-a7df43721a62</serial>
Oct 20 10:31:23 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:31:23 user nova-compute[74311]: </disk>
Oct 20 10:31:23 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:31:23 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:31:23 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:31:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00f57349-a3b2-49a1-99f9-97510634f3b0 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:31:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:24 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 is timed out.
Oct 20 10:31:24 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Successfully detached device vdb from instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 from the live domain config.
Oct 20 10:31:24 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQWXVjNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:31:24 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7121fd64-7eb9-4973-9863-121c79c73344]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:31:24 user nova-compute[74311]: No targets found.
Oct 20 10:31:24 user nova-compute[74311]: iSNS:
Oct 20 10:31:24 user nova-compute[74311]: No targets found.
Oct 20 10:31:24 user nova-compute[74311]: STATIC:
Oct 20 10:31:24 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62
Oct 20 10:31:24 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:24 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:24 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:31:24 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:24 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:24 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc
Oct 20 10:31:24 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:24 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:24 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00
Oct 20 10:31:24 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:24 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:24 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478
Oct 20 10:31:24 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:24 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:24 user nova-compute[74311]: FIRMWARE:
Oct 20 10:31:24 user nova-compute[74311]: No targets found.
Oct 20 10:31:24 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:31:24 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:31:24 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[55476c55-84d9-40da-8cb7-a12e8bdf7b7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[11037861-2ac7-425b-9166-9807b364ddb6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:31:24 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:24 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:31:24 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:24 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:31:24 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:31:24 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:24 user nova-compute[74311]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc (non-flash)
Oct 20 10:31:24 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:24 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:31:24 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1887a2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc'): ({'sdg'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Removing single pathed devices sdg {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bdb3f9-c088-4b62-85fe-cbd6d6f077c7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9b086d-47b3-457d-8991-c051b38b897b]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Flushing IO for device /dev/sdg {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2759d2-d258-4fb6-ba59-6a5724d923ac]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f35a86-125c-49e4-a8fd-6080c26f3252]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] SCSI volumes sdg have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6c5a11-1157-40f6-9ae3-61d9b6d93233]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae6361e-8382-47a1-86bf-3e9d1abac427]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc, portal: 172.16.0.220,3260]
Oct 20 10:31:24 user nova-compute[74311]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc, portal: 172.16.0.220,3260] successful.
Oct 20 10:31:24 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac503668-162e-484e-802b-c3c38764a2cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa85dae-06f0-4e9b-91de-d697bc873f00]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] <== disconnect_volume: return (318ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:31:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:25 user nova-compute[74311]: DEBUG nova.objects.instance [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lazy-loading 'flavor' on Instance uuid 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:31:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-91731de0-e963-4bca-93db-4430cfb6b6d4 tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.763s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:31:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:31:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:31:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:31:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rinUjgSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:31:31 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:31:31 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:31:31 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[483c3603-01cc-4ae9-911f-3e725220608c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:31:31 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf9bcbc-6eb8-4a4f-8e4a-b6181ec491d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe] added
Oct 20 10:31:31 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1c7738-2612-4453-b591-a1140f3d36a5]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ac09ed-fb32-4bd1-bff9-9d7d10482c54]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rinUjgSe {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rinUjgSe" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3a91c7-4220-4ac0-96e4-52e5978d64eb]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rinUjgSe'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7be0ec0-5298-4150-af25-227e8b970513]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b2f33a-12d5-4a94-a3a5-46454bffcc5a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:31:31 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:31 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:31 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:31:31 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:31:31 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:31 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:31 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:31:31 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[67df6b21-83f8-477d-89af-e06cc17f34d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe, portal: 172.16.0.220,3260]
Oct 20 10:31:31 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe, portal: 172.16.0.220,3260] successful.
Oct 20 10:31:31 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5741bbf8-9cce-4372-b219-fd00cdeb3eac]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b10cd4e-ee0f-417d-97c0-b57ee3e11d22]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:31:31 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:31 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:31 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:31:31 user nova-compute[74311]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe (non-flash)
Oct 20 10:31:31 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:31:31 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:31 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:31 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:31:31 user nova-compute[74311]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe (non-flash)
Oct 20 10:31:31 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.051s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8312b3bd-df56-4598-88db-ffaaaaa168c9]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:31:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rinUjgSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:31:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:31:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23035333737643338', 'path': '/dev/sdd'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:31:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035333737643338', 'path': '/dev/sdd'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:31:32 user nova-compute[74311]: DEBUG nova.objects.instance [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'flavor' on Instance uuid 2c91da9a-42ec-46b0-acbe-83b9fe36510a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:31:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:31:32 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:31:32 user nova-compute[74311]:   <source dev="/dev/sdd"/>
Oct 20 10:31:32 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:31:32 user nova-compute[74311]:   <serial>ec8a7672-cfcf-4d4c-9b76-68d8c4396efe</serial>
Oct 20 10:31:32 user nova-compute[74311]: </disk>
Oct 20 10:31:32 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:31:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:31:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:31:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No VIF found with MAC fa:16:3e:ae:4e:4e, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:31:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5cef52cb-3585-4dda-902d-74cb2bd4050a tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.735s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:34 user nova-compute[74311]: INFO nova.compute.manager [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Detaching volume ec8a7672-cfcf-4d4c-9b76-68d8c4396efe
Oct 20 10:31:34 user nova-compute[74311]: INFO nova.virt.block_device [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Attempting to driver detach volume ec8a7672-cfcf-4d4c-9b76-68d8c4396efe from mountpoint /dev/vdb
Oct 20 10:31:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Attempting to detach device vdb from instance 2c91da9a-42ec-46b0-acbe-83b9fe36510a from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:31:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:31:34 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:31:34 user nova-compute[74311]:   <source dev="/dev/sdd"/>
Oct 20 10:31:34 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:31:34 user nova-compute[74311]:   <serial>ec8a7672-cfcf-4d4c-9b76-68d8c4396efe</serial>
Oct 20 10:31:34 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:31:34 user nova-compute[74311]: </disk>
Oct 20 10:31:34 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:31:34 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Successfully detached device vdb from instance 2c91da9a-42ec-46b0-acbe-83b9fe36510a from the persistent domain config.
Oct 20 10:31:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c91da9a-42ec-46b0-acbe-83b9fe36510a from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:31:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:31:34 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:31:34 user nova-compute[74311]:   <source dev="/dev/sdd"/>
Oct 20 10:31:34 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:31:34 user nova-compute[74311]:   <serial>ec8a7672-cfcf-4d4c-9b76-68d8c4396efe</serial>
Oct 20 10:31:34 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:31:34 user nova-compute[74311]: </disk>
Oct 20 10:31:34 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:31:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c91da9a-42ec-46b0-acbe-83b9fe36510a {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:31:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "cfc97865-6f94-4924-afc5-188d50543672" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:40 user nova-compute[74311]: INFO nova.compute.manager [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Terminating instance
Oct 20 10:31:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "b0b457b8-159b-4533-ac97-dab7ffe0945e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-3345ca08-808a-45f9-9c92-eb6bfd3b3843 req-02fca245-fa53-441d-98a3-ec04b569fbcf service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-vif-unplugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3345ca08-808a-45f9-9c92-eb6bfd3b3843 req-02fca245-fa53-441d-98a3-ec04b569fbcf service nova] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3345ca08-808a-45f9-9c92-eb6bfd3b3843 req-02fca245-fa53-441d-98a3-ec04b569fbcf service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3345ca08-808a-45f9-9c92-eb6bfd3b3843 req-02fca245-fa53-441d-98a3-ec04b569fbcf service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-3345ca08-808a-45f9-9c92-eb6bfd3b3843 req-02fca245-fa53-441d-98a3-ec04b569fbcf service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] No waiting events found dispatching network-vif-unplugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:31:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-3345ca08-808a-45f9-9c92-eb6bfd3b3843 req-02fca245-fa53-441d-98a3-ec04b569fbcf service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-vif-unplugged-2e1b0047-2f93-4f83-a6e7-514659a2faae for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:31:40 user nova-compute[74311]: INFO nova.compute.manager [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Terminating instance
Oct 20 10:31:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: cfc97865-6f94-4924-afc5-188d50543672] Instance destroyed successfully.
Oct 20 10:31:41 user nova-compute[74311]: DEBUG nova.objects.instance [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'resources' on Instance uuid cfc97865-6f94-4924-afc5-188d50543672 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:15:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1074257695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1074257695',id=13,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:17:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090bd6a8a14d4a308e67be7a12e47ae6',ramdisk_id='',reservation_id='r-3t7g0pln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:19:40Z,user_data=None,user_id='0c6b76de1f054ca0973f2f9ba2eafaed',uuid=cfc97865-6f94-4924-afc5-188d50543672,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converting VIF {"id": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "address": "fa:16:3e:2d:59:4e", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e1b0047-2f", "ovs_interfaceid": "2e1b0047-2f93-4f83-a6e7-514659a2faae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:59:4e,bridge_name='br-int',has_traffic_filtering=True,id=2e1b0047-2f93-4f83-a6e7-514659a2faae,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1b0047-2f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_vif [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:59:4e,bridge_name='br-int',has_traffic_filtering=True,id=2e1b0047-2f93-4f83-a6e7-514659a2faae,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1b0047-2f') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e1b0047-2f, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1851655d-13e0-45ad-b1a5-c2b578f59403) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: INFO os_vif [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:59:4e,bridge_name='br-int',has_traffic_filtering=True,id=2e1b0047-2f93-4f83-a6e7-514659a2faae,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e1b0047-2f')
Oct 20 10:31:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTUvAacR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:31:41 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcda96d-cd0b-4ad6-97a8-9b3d25b933ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:31:41 user nova-compute[74311]: No targets found.
Oct 20 10:31:41 user nova-compute[74311]: iSNS:
Oct 20 10:31:41 user nova-compute[74311]: No targets found.
Oct 20 10:31:41 user nova-compute[74311]: STATIC:
Oct 20 10:31:41 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62
Oct 20 10:31:41 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:41 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:41 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa
Oct 20 10:31:41 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:41 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:41 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00
Oct 20 10:31:41 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:41 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:41 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478
Oct 20 10:31:41 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:41 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:41 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe
Oct 20 10:31:41 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:41 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:41 user nova-compute[74311]: FIRMWARE:
Oct 20 10:31:41 user nova-compute[74311]: No targets found.
Oct 20 10:31:41 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:31:41 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:31:41 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f16cae-2a88-45ce-8de2-323eaeafad77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[170821ac-bccb-4523-93f4-a39677f72108]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:31:41 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:41 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:41 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:31:41 user nova-compute[74311]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe (non-flash)
Oct 20 10:31:41 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa (non-flash)
Oct 20 10:31:41 user nova-compute[74311]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:41 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:41 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:31:41 user nova-compute[74311]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe (non-flash)
Oct 20 10:31:41 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164cf6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa'): ({'sdf'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Removing single pathed devices sdf {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02325e7-7a45-40ed-9889-0cabb85b27f6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[60742002-1935-4d90-9e2e-f5cd7e78e794]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Flushing IO for device /dev/sdf {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f878d5ca-bb7c-4ac1-8dbb-e15c220f83de]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f49f38-30f0-4d72-8c74-e1c84988fc31]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] SCSI volumes sdf have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc26c6b-e5d0-47d6-a240-4d536eeffc59]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:41 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Instance destroyed successfully.
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG nova.objects.instance [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lazy-loading 'resources' on Instance uuid b0b457b8-159b-4533-ac97-dab7ffe0945e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6548c5ae-7043-46e3-9d07-b641c7d1f3f4]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa, portal: 172.16.0.220,3260]
Oct 20 10:31:41 user nova-compute[74311]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa, portal: 172.16.0.220,3260] successful.
Oct 20 10:31:41 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2112979492',display_name='tempest-ServerActionsTestOtherA-server-2112979492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2112979492',id=5,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrV3Ete25j/fWp9se4mxMWH8BlUBzypkEKDQ+cEJ4VP8hCjsvoAfM2JugNca5+qdBC1FO7G9hMianDZcBDCqTf2/GGIFqvMCvoR42Lgy+aDjy2Ay+qKFAL51raC0WY1Gw==',key_name='tempest-keypair-317846828',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f61456f02bc4688b8cd9d66a2b1868d',ramdisk_id='',reservation_id='r-89k3vm79',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2000022938',owner_user_name='tempest-ServerActionsTestOtherA-2000022938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5eb8db6bee87451f95e4bfdc61854bc5',uuid=b0b457b8-159b-4533-ac97-dab7ffe0945e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converting VIF {"id": "097b3196-1731-46ef-a752-fcc882c73dfd", "address": "fa:16:3e:eb:4b:ed", "network": {"id": "de9d667d-254c-40e4-b975-66251b75e083", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1485600985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f61456f02bc4688b8cd9d66a2b1868d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap097b3196-17", "ovs_interfaceid": "097b3196-1731-46ef-a752-fcc882c73dfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:4b:ed,bridge_name='br-int',has_traffic_filtering=True,id=097b3196-1731-46ef-a752-fcc882c73dfd,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097b3196-17') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_vif [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:4b:ed,bridge_name='br-int',has_traffic_filtering=True,id=097b3196-1731-46ef-a752-fcc882c73dfd,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097b3196-17') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap097b3196-17, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4560bfac-0fae-4981-b0c7-2ba6594b84b5) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90e3e67e-92d0-4f73-992a-d967eafa7bfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:41 user nova-compute[74311]: INFO os_vif [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:4b:ed,bridge_name='br-int',has_traffic_filtering=True,id=097b3196-1731-46ef-a752-fcc882c73dfd,network=Network(de9d667d-254c-40e4-b975-66251b75e083),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap097b3196-17')
Oct 20 10:31:41 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Deleting instance files /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e_del
Oct 20 10:31:41 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Deletion of /opt/stack/data/nova/instances/b0b457b8-159b-4533-ac97-dab7ffe0945e_del complete
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[73984eb0-1251-4ace-a885-3ceccfeeda5b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] <== disconnect_volume: return (368ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:31:41 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Deleting instance files /opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672_del
Oct 20 10:31:41 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Deletion of /opt/stack/data/nova/instances/cfc97865-6f94-4924-afc5-188d50543672_del complete
Oct 20 10:31:41 user nova-compute[74311]: INFO nova.compute.manager [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:31:41 user nova-compute[74311]: INFO nova.compute.manager [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 20 10:31:41 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: cfc97865-6f94-4924-afc5-188d50543672] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:31:41 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: cfc97865-6f94-4924-afc5-188d50543672] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:31:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:42 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:31:42 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Took 0.42 seconds to deallocate network for instance.
Oct 20 10:31:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:42 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: cfc97865-6f94-4924-afc5-188d50543672] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:31:42 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: cfc97865-6f94-4924-afc5-188d50543672] Took 0.51 seconds to deallocate network for instance.
Oct 20 10:31:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-3f17eb45-5087-47e2-a8e9-4f4f3e9dd9e0 req-0cc81790-8b61-420e-ab0a-48f4de2c0520 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-vif-deleted-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:31:42 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:31:42 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:31:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:42 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Deleted allocations for instance b0b457b8-159b-4533-ac97-dab7ffe0945e
Oct 20 10:31:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-dac2df88-bf9e-4cc5-88ba-291b4bd2085d tempest-ServerActionsTestOtherA-2000022938 tempest-ServerActionsTestOtherA-2000022938-project-member] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.894s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] Acquiring lock "cfc97865-6f94-4924-afc5-188d50543672-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] Lock "cfc97865-6f94-4924-afc5-188d50543672-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] No waiting events found dispatching network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:31:43 user nova-compute[74311]: WARNING nova.compute.manager [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] [instance: cfc97865-6f94-4924-afc5-188d50543672] Received unexpected event network-vif-plugged-2e1b0047-2f93-4f83-a6e7-514659a2faae for instance with vm_state active and task_state deleting.
Oct 20 10:31:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Received event network-vif-unplugged-097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] Acquiring lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] No waiting events found dispatching network-vif-unplugged-097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:31:43 user nova-compute[74311]: WARNING nova.compute.manager [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Received unexpected event network-vif-unplugged-097b3196-1731-46ef-a752-fcc882c73dfd for instance with vm_state deleted and task_state None.
Oct 20 10:31:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Received event network-vif-plugged-097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] Acquiring lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] Lock "b0b457b8-159b-4533-ac97-dab7ffe0945e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] No waiting events found dispatching network-vif-plugged-097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:31:43 user nova-compute[74311]: WARNING nova.compute.manager [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Received unexpected event network-vif-plugged-097b3196-1731-46ef-a752-fcc882c73dfd for instance with vm_state deleted and task_state None.
Oct 20 10:31:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-7f5b9006-6ce7-492d-b7d8-d5329261c07a req-999dfdab-0ece-4ff1-ac91-55a77e1a0be6 service nova] [instance: b0b457b8-159b-4533-ac97-dab7ffe0945e] Received event network-vif-deleted-097b3196-1731-46ef-a752-fcc882c73dfd {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:31:43 user nova-compute[74311]: INFO nova.compute.manager [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: cfc97865-6f94-4924-afc5-188d50543672] Took 0.84 seconds to detach 1 volumes for instance.
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:31:43 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 00f57349-a3b2-49a1-99f9-97510634f3b0 is timed out.
Oct 20 10:31:43 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:31:43 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Successfully detached device vdb from instance 00f57349-a3b2-49a1-99f9-97510634f3b0 from the live domain config.
Oct 20 10:31:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mvPsAOtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:31:43 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc8bb48-3442-4f56-ade7-4b5b6c4faa14]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:31:43 user nova-compute[74311]: No targets found.
Oct 20 10:31:43 user nova-compute[74311]: iSNS:
Oct 20 10:31:43 user nova-compute[74311]: No targets found.
Oct 20 10:31:43 user nova-compute[74311]: STATIC:
Oct 20 10:31:43 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62
Oct 20 10:31:43 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:43 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:43 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00
Oct 20 10:31:43 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:43 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:43 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478
Oct 20 10:31:43 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:43 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:43 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe
Oct 20 10:31:43 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:43 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:43 user nova-compute[74311]: FIRMWARE:
Oct 20 10:31:43 user nova-compute[74311]: No targets found.
Oct 20 10:31:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:31:43 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:31:43 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f30f491-cee9-4619-a576-5d4747543410]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5985cf-3527-4676-8d68-868977d11119]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:43 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:43 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:31:43 user nova-compute[74311]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe (non-flash)
Oct 20 10:31:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:43 user nova-compute[74311]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 (non-flash)
Oct 20 10:31:43 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:31:43 user nova-compute[74311]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe (non-flash)
Oct 20 10:31:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164f368c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bb9a11-deed-4bd0-bd73-4ca6b573fca0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.650s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c4b748-ae51-4a8f-a1f1-233708325430]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[68afc068-59a9-4341-b682-283e53db43f0]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:43 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Deleted allocations for instance cfc97865-6f94-4924-afc5-188d50543672
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8219909f-72ab-4ecb-b513-434aa8f28d92]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8d0b5e-5038-4a6d-8677-652d05811314]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-08a4b471-70b9-404b-8e06-eb0f1520f949 tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "cfc97865-6f94-4924-afc5-188d50543672" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.474s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:44 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:44 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf9ce12-be54-4bc8-926e-26a030f9fa61]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:44 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62, portal: 172.16.0.220,3260]
Oct 20 10:31:44 user nova-compute[74311]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62, portal: 172.16.0.220,3260] successful.
Oct 20 10:31:44 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:44 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:44 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55fe5db9-6873-4957-889a-a7df43721a62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:44 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[643f2858-1adb-4b20-8338-2cac8a40f838]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:44 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:44 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:31:44 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] <== disconnect_volume: return (360ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:31:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:31:44 user nova-compute[74311]: DEBUG nova.objects.instance [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'flavor' on Instance uuid 00f57349-a3b2-49a1-99f9-97510634f3b0 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:31:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-10f3a42b-062a-4a3f-b7d5-50752488d2f6 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.745s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "00f57349-a3b2-49a1-99f9-97510634f3b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:46 user nova-compute[74311]: INFO nova.compute.manager [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Detaching volume c3bdfcdc-b429-4ce3-8eca-c04939001e00
Oct 20 10:31:46 user nova-compute[74311]: INFO nova.virt.block_device [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Attempting to driver detach volume c3bdfcdc-b429-4ce3-8eca-c04939001e00 from mountpoint /dev/vdc
Oct 20 10:31:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Attempting to detach device vdc from instance 00f57349-a3b2-49a1-99f9-97510634f3b0 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:31:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:31:46 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:31:46 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:31:46 user nova-compute[74311]:   <target dev="vdc" bus="virtio"/>
Oct 20 10:31:46 user nova-compute[74311]:   <serial>c3bdfcdc-b429-4ce3-8eca-c04939001e00</serial>
Oct 20 10:31:46 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 10:31:46 user nova-compute[74311]: </disk>
Oct 20 10:31:46 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:31:46 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Successfully detached device vdc from instance 00f57349-a3b2-49a1-99f9-97510634f3b0 from the persistent domain config.
Oct 20 10:31:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 00f57349-a3b2-49a1-99f9-97510634f3b0 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:31:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:31:46 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:31:46 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:31:46 user nova-compute[74311]:   <target dev="vdc" bus="virtio"/>
Oct 20 10:31:46 user nova-compute[74311]:   <serial>c3bdfcdc-b429-4ce3-8eca-c04939001e00</serial>
Oct 20 10:31:46 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 10:31:46 user nova-compute[74311]: </disk>
Oct 20 10:31:46 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:31:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 00f57349-a3b2-49a1-99f9-97510634f3b0 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:31:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:54 user nova-compute[74311]: INFO nova.compute.manager [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Terminating instance
Oct 20 10:31:54 user nova-compute[74311]: DEBUG nova.compute.manager [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-67c148fe-0083-485d-a57d-58452c2f6869 req-46ef1f0f-bfeb-46d3-bae8-4dca013178e6 service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Received event network-vif-unplugged-378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-67c148fe-0083-485d-a57d-58452c2f6869 req-46ef1f0f-bfeb-46d3-bae8-4dca013178e6 service nova] Acquiring lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-67c148fe-0083-485d-a57d-58452c2f6869 req-46ef1f0f-bfeb-46d3-bae8-4dca013178e6 service nova] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-67c148fe-0083-485d-a57d-58452c2f6869 req-46ef1f0f-bfeb-46d3-bae8-4dca013178e6 service nova] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-67c148fe-0083-485d-a57d-58452c2f6869 req-46ef1f0f-bfeb-46d3-bae8-4dca013178e6 service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] No waiting events found dispatching network-vif-unplugged-378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-67c148fe-0083-485d-a57d-58452c2f6869 req-46ef1f0f-bfeb-46d3-bae8-4dca013178e6 service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Received event network-vif-unplugged-378b4ae2-4ea8-498d-9ef0-6c3e96817646 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:31:54 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2c91da9a-42ec-46b0-acbe-83b9fe36510a is timed out.
Oct 20 10:31:54 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Successfully detached device vdb from instance 2c91da9a-42ec-46b0-acbe-83b9fe36510a from the live domain config.
Oct 20 10:31:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rinUjgSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:31:54 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fac272d-91be-42ef-824c-b152e95eede0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:31:54 user nova-compute[74311]: No targets found.
Oct 20 10:31:54 user nova-compute[74311]: iSNS:
Oct 20 10:31:54 user nova-compute[74311]: No targets found.
Oct 20 10:31:54 user nova-compute[74311]: STATIC:
Oct 20 10:31:54 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00
Oct 20 10:31:54 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:54 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:54 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478
Oct 20 10:31:54 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:54 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:54 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe
Oct 20 10:31:54 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:31:54 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:31:54 user nova-compute[74311]: FIRMWARE:
Oct 20 10:31:54 user nova-compute[74311]: No targets found.
Oct 20 10:31:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:31:54 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:31:54 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5e4c5c-35fc-43b0-95f1-d4e40c2c5318]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc530b3-df51-4254-aadd-0acd7fb8713e]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:54 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:31:54 user nova-compute[74311]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe (non-flash)
Oct 20 10:31:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:31:54 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:31:54 user nova-compute[74311]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe (non-flash)
Oct 20 10:31:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb188558310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe'): ({'sdd'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Removing single pathed devices sdd {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c59a8f7-306a-4698-aade-9c67507e231b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e46ecc8-0e22-407c-9e65-d919046a6342]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Flushing IO for device /dev/sdd {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad22ba4-9ddf-456d-926a-6b292a45a3b1]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b037a6-2809-4baa-bcdb-c0d25fefdd73]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa398c6-f8ce-4977-9376-764d4aaca5f1]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacd9cfa-42e0-4f96-90e3-068dcbe97acf]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe, portal: 172.16.0.220,3260]
Oct 20 10:31:54 user nova-compute[74311]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe, portal: 172.16.0.220,3260] successful.
Oct 20 10:31:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec8a7672-cfcf-4d4c-9b76-68d8c4396efe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fbba23-c414-402d-aa84-d00767ae681b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] <== disconnect_volume: return (341ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:31:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:31:55 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Instance destroyed successfully.
Oct 20 10:31:55 user nova-compute[74311]: DEBUG nova.objects.instance [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lazy-loading 'resources' on Instance uuid 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:27:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-661499792',display_name='tempest-TestServerVolumeAttachmentScenario-server-661499792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-661499792',id=33,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCd3sBOCPWK8bLw4k3o1N5LeRfSPlOSImgEHr/h8AxyqwOYZTDkzp5JFK7lYTjdBesPSZqQycSqxm18ywLdER8vSNaM7Eyq33NBMQZo8CQoeA3Ol2UgT5axxnClFL/Bf9w==',key_name='tempest-keypair-152994944',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:27:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c01bcaa34104f29ab8566e793779055',ramdisk_id='',reservation_id='r-0v5nj00p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2124604318',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2124604318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:27:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b695ede156f4dd7b3e20e23b09b8afe',uuid=28ec7283-8a34-4eb4-b458-ed9fe6723ec2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "address": "fa:16:3e:5a:e5:8e", "network": {"id": "73186602-4613-449b-b892-2aed0cad9aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-347025189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c01bcaa34104f29ab8566e793779055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378b4ae2-4e", "ovs_interfaceid": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Converting VIF {"id": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "address": "fa:16:3e:5a:e5:8e", "network": {"id": "73186602-4613-449b-b892-2aed0cad9aef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-347025189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c01bcaa34104f29ab8566e793779055", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378b4ae2-4e", "ovs_interfaceid": "378b4ae2-4ea8-498d-9ef0-6c3e96817646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:e5:8e,bridge_name='br-int',has_traffic_filtering=True,id=378b4ae2-4ea8-498d-9ef0-6c3e96817646,network=Network(73186602-4613-449b-b892-2aed0cad9aef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap378b4ae2-4e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG os_vif [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:e5:8e,bridge_name='br-int',has_traffic_filtering=True,id=378b4ae2-4ea8-498d-9ef0-6c3e96817646,network=Network(73186602-4613-449b-b892-2aed0cad9aef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap378b4ae2-4e') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap378b4ae2-4e, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc424497-05ff-4f82-a6c7-fde6d8dd1b14) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:31:55 user nova-compute[74311]: INFO os_vif [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:e5:8e,bridge_name='br-int',has_traffic_filtering=True,id=378b4ae2-4ea8-498d-9ef0-6c3e96817646,network=Network(73186602-4613-449b-b892-2aed0cad9aef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap378b4ae2-4e')
Oct 20 10:31:55 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Deleting instance files /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2_del
Oct 20 10:31:55 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Deletion of /opt/stack/data/nova/instances/28ec7283-8a34-4eb4-b458-ed9fe6723ec2_del complete
Oct 20 10:31:55 user nova-compute[74311]: INFO nova.compute.manager [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 10:31:55 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG nova.objects.instance [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'flavor' on Instance uuid 2c91da9a-42ec-46b0-acbe-83b9fe36510a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:31:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9e107356-18e5-4873-9591-d7cf0983298e tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.797s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:56 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:31:56 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Took 0.88 seconds to deallocate network for instance.
Oct 20 10:31:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-69790250-f075-41bf-b077-37881987eca6 req-3bce37b4-dae2-4597-9b72-2d5273ee3dba service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Received event network-vif-deleted-378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:31:56 user nova-compute[74311]: INFO nova.compute.manager [req-69790250-f075-41bf-b077-37881987eca6 req-3bce37b4-dae2-4597-9b72-2d5273ee3dba service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Neutron deleted interface 378b4ae2-4ea8-498d-9ef0-6c3e96817646; detaching it from the instance and deleting it from the info cache
Oct 20 10:31:56 user nova-compute[74311]: DEBUG nova.network.neutron [req-69790250-f075-41bf-b077-37881987eca6 req-3bce37b4-dae2-4597-9b72-2d5273ee3dba service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:31:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-69790250-f075-41bf-b077-37881987eca6 req-3bce37b4-dae2-4597-9b72-2d5273ee3dba service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Detach interface failed, port_id=378b4ae2-4ea8-498d-9ef0-6c3e96817646, reason: Instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2 could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:31:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:56 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:31:56 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:31:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:56 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Deleted allocations for instance 28ec7283-8a34-4eb4-b458-ed9fe6723ec2
Oct 20 10:31:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d8e551c3-bcb9-4a1c-90bd-fda2fee4888b tempest-TestServerVolumeAttachmentScenario-2124604318 tempest-TestServerVolumeAttachmentScenario-2124604318-project-member] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.287s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-4166c3ba-1d1e-4489-8626-9e4c0c0a1b05 req-0b22f66b-cd50-4349-8211-f2599181ce07 service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Received event network-vif-plugged-378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:31:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4166c3ba-1d1e-4489-8626-9e4c0c0a1b05 req-0b22f66b-cd50-4349-8211-f2599181ce07 service nova] Acquiring lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4166c3ba-1d1e-4489-8626-9e4c0c0a1b05 req-0b22f66b-cd50-4349-8211-f2599181ce07 service nova] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4166c3ba-1d1e-4489-8626-9e4c0c0a1b05 req-0b22f66b-cd50-4349-8211-f2599181ce07 service nova] Lock "28ec7283-8a34-4eb4-b458-ed9fe6723ec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-4166c3ba-1d1e-4489-8626-9e4c0c0a1b05 req-0b22f66b-cd50-4349-8211-f2599181ce07 service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] No waiting events found dispatching network-vif-plugged-378b4ae2-4ea8-498d-9ef0-6c3e96817646 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:31:56 user nova-compute[74311]: WARNING nova.compute.manager [req-4166c3ba-1d1e-4489-8626-9e4c0c0a1b05 req-0b22f66b-cd50-4349-8211-f2599181ce07 service nova] [instance: 28ec7283-8a34-4eb4-b458-ed9fe6723ec2] Received unexpected event network-vif-plugged-378b4ae2-4ea8-498d-9ef0-6c3e96817646 for instance with vm_state deleted and task_state None.
Oct 20 10:31:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "593a4f46-9b5b-4a3c-95c7-21712b081069" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:57 user nova-compute[74311]: DEBUG nova.objects.instance [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lazy-loading 'flavor' on Instance uuid 593a4f46-9b5b-4a3c-95c7-21712b081069 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:31:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:31:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "593a4f46-9b5b-4a3c-95c7-21712b081069" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:31:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:31:57 user nova-compute[74311]: INFO nova.compute.manager [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Attaching volume 095440b2-c402-49a5-b9f2-7fa39a2b7d70 to /dev/vdb
Oct 20 10:31:57 user nova-compute[74311]: DEBUG os_brick.utils [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:31:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8575c61b-193a-42a3-86ff-109f73dbc588]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2818693-67f1-42a0-baf5-cbcd79b4dbb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7944a93-3c1e-490e-b271-f89d5f5a892b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5e9c9a-d5d1-4a58-a56d-e456a787fd8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:31:58 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:31:58 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2e9f7b-8488-4bb6-9e4a-f36e6fcbbd2a]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG os_brick.utils [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Updating existing volume attachment record: 996a6d1d-61b7-4613-be4a-f0a92f573ef3 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-fd7a1ff5-fc74-4b05-8708-a1bf40b9912c req-c542f042-b3f7-4841-9735-c9810088bc05 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Received event network-changed-aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-fd7a1ff5-fc74-4b05-8708-a1bf40b9912c req-c542f042-b3f7-4841-9735-c9810088bc05 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Refreshing instance network info cache due to event network-changed-aba6ea09-c123-48e0-83d2-294027a059c6. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fd7a1ff5-fc74-4b05-8708-a1bf40b9912c req-c542f042-b3f7-4841-9735-c9810088bc05 service nova] Acquiring lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fd7a1ff5-fc74-4b05-8708-a1bf40b9912c req-c542f042-b3f7-4841-9735-c9810088bc05 service nova] Acquired lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG nova.network.neutron [req-fd7a1ff5-fc74-4b05-8708-a1bf40b9912c req-c542f042-b3f7-4841-9735-c9810088bc05 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Refreshing network info cache for port aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:31:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:31:59 user nova-compute[74311]: DEBUG nova.network.neutron [req-fd7a1ff5-fc74-4b05-8708-a1bf40b9912c req-c542f042-b3f7-4841-9735-c9810088bc05 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Updated VIF entry in instance network info cache for port aba6ea09-c123-48e0-83d2-294027a059c6. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:31:59 user nova-compute[74311]: DEBUG nova.network.neutron [req-fd7a1ff5-fc74-4b05-8708-a1bf40b9912c req-c542f042-b3f7-4841-9735-c9810088bc05 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Updating instance_info_cache with network_info: [{"id": "aba6ea09-c123-48e0-83d2-294027a059c6", "address": "fa:16:3e:8b:a4:67", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba6ea09-c1", "ovs_interfaceid": "aba6ea09-c123-48e0-83d2-294027a059c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:31:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fd7a1ff5-fc74-4b05-8708-a1bf40b9912c req-c542f042-b3f7-4841-9735-c9810088bc05 service nova] Releasing lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:32:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:05 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:32:05 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:32:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:32:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:32:05 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:32:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:05 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Updating instance_info_cache with network_info: [{"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:32:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-60618091-1d8e-477c-8ea8-63973626a7e2" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:32:05 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:32:06 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 00f57349-a3b2-49a1-99f9-97510634f3b0 is timed out.
Oct 20 10:32:06 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Successfully detached device vdc from instance 00f57349-a3b2-49a1-99f9-97510634f3b0 from the live domain config.
Oct 20 10:32:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnfLlaDs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:32:06 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f778fabe-ed44-4f9b-aa73-2ffc1a0c41df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:32:06 user nova-compute[74311]: No targets found.
Oct 20 10:32:06 user nova-compute[74311]: iSNS:
Oct 20 10:32:06 user nova-compute[74311]: No targets found.
Oct 20 10:32:06 user nova-compute[74311]: STATIC:
Oct 20 10:32:06 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00
Oct 20 10:32:06 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:32:06 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:32:06 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478
Oct 20 10:32:06 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:32:06 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:32:06 user nova-compute[74311]: FIRMWARE:
Oct 20 10:32:06 user nova-compute[74311]: No targets found.
Oct 20 10:32:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:32:06 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:32:06 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d177bba3-2604-4298-98aa-d4428b208f6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8ac2e7-475a-42e8-b39b-f47bfbf14d2b]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:32:06 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:32:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:32:06 user nova-compute[74311]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 (non-flash)
Oct 20 10:32:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1887a2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00'): ({'sdc'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Removing single pathed devices sdc {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b442aec1-6097-42cb-9b50-37b763d4cbdd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[412b5347-cd9c-47aa-a00a-d99744a257d2]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Flushing IO for device /dev/sdc {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d90da6e-26ef-4fa6-9365-1ea2e9ec3efb]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fba739-b8e2-49c3-a49d-493e1cf429d8]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d42a21-0264-4ae3-9148-308fc7824270]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[693d53c0-c7a9-4d5d-a8dc-378dbd3c2947]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00, portal: 172.16.0.220,3260]
Oct 20 10:32:06 user nova-compute[74311]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00, portal: 172.16.0.220,3260] successful.
Oct 20 10:32:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3bdfcdc-b429-4ce3-8eca-c04939001e00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0dc7dc-85b8-446f-ae3e-6d09158e9533]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] <== disconnect_volume: return (320ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:32:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "367d718d-35ed-4c04-97f1-518bd0e100e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:32:07 user nova-compute[74311]: INFO nova.compute.claims [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Claim successful on node user
Oct 20 10:32:07 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:32:07 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:32:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG nova.objects.instance [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'flavor' on Instance uuid 00f57349-a3b2-49a1-99f9-97510634f3b0 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG nova.policy [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe1aad9aa1e64a9db4f78c0c12779300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61fab5f8b38b490985cc614ade80f25a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ae45684c-0385-4d0b-9b8f-3ff7c74d4412 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.703s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:32:07 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Creating image(s)
Oct 20 10:32:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "/opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "/opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "/opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.187s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk 1073741824" returned: 0 in 0.052s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.167s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Checking if we can resize image /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG nova.network.neutron [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Successfully created port: b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Cannot resize image /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Ensure instance console log exists: /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "00f57349-a3b2-49a1-99f9-97510634f3b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:08 user nova-compute[74311]: INFO nova.compute.manager [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Terminating instance
Oct 20 10:32:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-5e3c5a02-be15-480f-9f8a-d4e83dc64662 req-6e666a12-8bdf-4495-9fdc-b6d569b9d280 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Received event network-vif-unplugged-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5e3c5a02-be15-480f-9f8a-d4e83dc64662 req-6e666a12-8bdf-4495-9fdc-b6d569b9d280 service nova] Acquiring lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5e3c5a02-be15-480f-9f8a-d4e83dc64662 req-6e666a12-8bdf-4495-9fdc-b6d569b9d280 service nova] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5e3c5a02-be15-480f-9f8a-d4e83dc64662 req-6e666a12-8bdf-4495-9fdc-b6d569b9d280 service nova] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-5e3c5a02-be15-480f-9f8a-d4e83dc64662 req-6e666a12-8bdf-4495-9fdc-b6d569b9d280 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] No waiting events found dispatching network-vif-unplugged-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-5e3c5a02-be15-480f-9f8a-d4e83dc64662 req-6e666a12-8bdf-4495-9fdc-b6d569b9d280 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Received event network-vif-unplugged-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.network.neutron [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Successfully updated port: b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquired lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.network.neutron [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-01b5f3d9-576e-479a-8d73-0628a3484e27 req-b2b37a1b-6a16-4718-91fe-97c94604289c service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received event network-changed-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-01b5f3d9-576e-479a-8d73-0628a3484e27 req-b2b37a1b-6a16-4718-91fe-97c94604289c service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Refreshing instance network info cache due to event network-changed-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01b5f3d9-576e-479a-8d73-0628a3484e27 req-b2b37a1b-6a16-4718-91fe-97c94604289c service nova] Acquiring lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.network.neutron [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:32:09 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Instance destroyed successfully.
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.objects.instance [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lazy-loading 'resources' on Instance uuid 00f57349-a3b2-49a1-99f9-97510634f3b0 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:28:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-650401654',display_name='tempest-AttachVolumeTestJSON-server-650401654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-650401654',id=35,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvjo82/ZL1p3p/pupx6h5Y6ehQwOdE3alS24LRXUXUNpGw6Mg7lgbIvwSyJGXZDy36jn5ShVHT0rnmlez6zmaobYJMfAkGNtHfm8gL1U9r9HAw5UgGC3vudZapf3h7MZg==',key_name='tempest-keypair-498238364',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f725dba626242d6ada4ccceab72c55c',ramdisk_id='',reservation_id='r-404gl9wb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1992975846',owner_user_name='tempest-AttachVolumeTestJSON-1992975846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:28:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3599c6c5ec984a3599dbdd732ffd0977',uuid=00f57349-a3b2-49a1-99f9-97510634f3b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "address": "fa:16:3e:15:db:5c", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe77cc0-8c", "ovs_interfaceid": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converting VIF {"id": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "address": "fa:16:3e:15:db:5c", "network": {"id": "9e9e11c1-4703-4686-bbcf-5fcbe7f2961c", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-295444387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f725dba626242d6ada4ccceab72c55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebe77cc0-8c", "ovs_interfaceid": "ebe77cc0-8ca0-4dd5-bca5-dc0794962702", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:db:5c,bridge_name='br-int',has_traffic_filtering=True,id=ebe77cc0-8ca0-4dd5-bca5-dc0794962702,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe77cc0-8c') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG os_vif [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:db:5c,bridge_name='br-int',has_traffic_filtering=True,id=ebe77cc0-8ca0-4dd5-bca5-dc0794962702,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe77cc0-8c') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebe77cc0-8c, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=863fc408-a3ee-4fa4-8763-8ef7dad68571) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:09 user nova-compute[74311]: INFO os_vif [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:db:5c,bridge_name='br-int',has_traffic_filtering=True,id=ebe77cc0-8ca0-4dd5-bca5-dc0794962702,network=Network(9e9e11c1-4703-4686-bbcf-5fcbe7f2961c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebe77cc0-8c')
Oct 20 10:32:09 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Deleting instance files /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0_del
Oct 20 10:32:09 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Deletion of /opt/stack/data/nova/instances/00f57349-a3b2-49a1-99f9-97510634f3b0_del complete
Oct 20 10:32:09 user nova-compute[74311]: INFO nova.compute.manager [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 20 10:32:09 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.network.neutron [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Updating instance_info_cache with network_info: [{"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Releasing lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.compute.manager [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Instance network_info: |[{"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01b5f3d9-576e-479a-8d73-0628a3484e27 req-b2b37a1b-6a16-4718-91fe-97c94604289c service nova] Acquired lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.network.neutron [req-01b5f3d9-576e-479a-8d73-0628a3484e27 req-b2b37a1b-6a16-4718-91fe-97c94604289c service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Refreshing network info cache for port b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Start _get_guest_xml network_info=[{"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:32:09 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:32:09 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1498909758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1498909758',id=38,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFAyNyoWbqBGNHspCEvJSsMifFaHIZT0jvn4njT9y2I+nD2XcODIHjztrXyWlfAc6OSESgmSstTATclIJ28rApf+mhllBPFUkRHyqMXHz5Qx0b0y8PhQHxZwmk17YvZog==',key_name='tempest-keypair-1460218868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61fab5f8b38b490985cc614ade80f25a',ramdisk_id='',reservation_id='r-fzi5czat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1592971712',owner_user_name='tempest-AttachVolumeShelveTestJSON-1592971712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:32:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1aad9aa1e64a9db4f78c0c12779300',uuid=367d718d-35ed-4c04-97f1-518bd0e100e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converting VIF {"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:50,bridge_name='br-int',has_traffic_filtering=True,id=b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cf7ba1-9f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.objects.instance [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lazy-loading 'pci_devices' on Instance uuid 367d718d-35ed-4c04-97f1-518bd0e100e1 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:32:09 user nova-compute[74311]:   <uuid>367d718d-35ed-4c04-97f1-518bd0e100e1</uuid>
Oct 20 10:32:09 user nova-compute[74311]:   <name>instance-00000026</name>
Oct 20 10:32:09 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:32:09 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:32:09 user nova-compute[74311]:   <metadata>
Oct 20 10:32:09 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:32:09 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:32:09 user nova-compute[74311]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1498909758</nova:name>
Oct 20 10:32:09 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:32:09</nova:creationTime>
Oct 20 10:32:09 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:32:09 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:32:09 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:32:09 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:32:09 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:32:09 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:32:09 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:32:09 user nova-compute[74311]:       <nova:owner>
Oct 20 10:32:09 user nova-compute[74311]:         <nova:user uuid="fe1aad9aa1e64a9db4f78c0c12779300">tempest-AttachVolumeShelveTestJSON-1592971712-project-member</nova:user>
Oct 20 10:32:09 user nova-compute[74311]:         <nova:project uuid="61fab5f8b38b490985cc614ade80f25a">tempest-AttachVolumeShelveTestJSON-1592971712</nova:project>
Oct 20 10:32:09 user nova-compute[74311]:       </nova:owner>
Oct 20 10:32:09 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:32:09 user nova-compute[74311]:       <nova:ports>
Oct 20 10:32:09 user nova-compute[74311]:         <nova:port uuid="b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7">
Oct 20 10:32:09 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 10:32:09 user nova-compute[74311]:         </nova:port>
Oct 20 10:32:09 user nova-compute[74311]:       </nova:ports>
Oct 20 10:32:09 user nova-compute[74311]:     </nova:instance>
Oct 20 10:32:09 user nova-compute[74311]:   </metadata>
Oct 20 10:32:09 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:32:09 user nova-compute[74311]:     <system>
Oct 20 10:32:09 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:32:09 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:32:09 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:32:09 user nova-compute[74311]:       <entry name="serial">367d718d-35ed-4c04-97f1-518bd0e100e1</entry>
Oct 20 10:32:09 user nova-compute[74311]:       <entry name="uuid">367d718d-35ed-4c04-97f1-518bd0e100e1</entry>
Oct 20 10:32:09 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:32:09 user nova-compute[74311]:     </system>
Oct 20 10:32:09 user nova-compute[74311]:   </sysinfo>
Oct 20 10:32:09 user nova-compute[74311]:   <os>
Oct 20 10:32:09 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:32:09 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:32:09 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:32:09 user nova-compute[74311]:   </os>
Oct 20 10:32:09 user nova-compute[74311]:   <features>
Oct 20 10:32:09 user nova-compute[74311]:     <acpi/>
Oct 20 10:32:09 user nova-compute[74311]:     <apic/>
Oct 20 10:32:09 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:32:09 user nova-compute[74311]:   </features>
Oct 20 10:32:09 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:32:09 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:32:09 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:32:09 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:32:09 user nova-compute[74311]:   </clock>
Oct 20 10:32:09 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:32:09 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:32:09 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:32:09 user nova-compute[74311]:   </cpu>
Oct 20 10:32:09 user nova-compute[74311]:   <devices>
Oct 20 10:32:09 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:32:09 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:32:09 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk"/>
Oct 20 10:32:09 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:32:09 user nova-compute[74311]:     </disk>
Oct 20 10:32:09 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:32:09 user nova-compute[74311]:       <mac address="fa:16:3e:79:37:50"/>
Oct 20 10:32:09 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:32:09 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:32:09 user nova-compute[74311]:       <target dev="tapb7cf7ba1-9f"/>
Oct 20 10:32:09 user nova-compute[74311]:     </interface>
Oct 20 10:32:09 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:32:09 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/console.log" append="off"/>
Oct 20 10:32:09 user nova-compute[74311]:     </serial>
Oct 20 10:32:09 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:32:09 user nova-compute[74311]:     <video>
Oct 20 10:32:09 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:32:09 user nova-compute[74311]:     </video>
Oct 20 10:32:09 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:32:09 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:32:09 user nova-compute[74311]:     </rng>
Oct 20 10:32:09 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:32:09 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:32:09 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:32:09 user nova-compute[74311]:     </memballoon>
Oct 20 10:32:09 user nova-compute[74311]:   </devices>
Oct 20 10:32:09 user nova-compute[74311]: </domain>
Oct 20 10:32:09 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1498909758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1498909758',id=38,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFAyNyoWbqBGNHspCEvJSsMifFaHIZT0jvn4njT9y2I+nD2XcODIHjztrXyWlfAc6OSESgmSstTATclIJ28rApf+mhllBPFUkRHyqMXHz5Qx0b0y8PhQHxZwmk17YvZog==',key_name='tempest-keypair-1460218868',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61fab5f8b38b490985cc614ade80f25a',ramdisk_id='',reservation_id='r-fzi5czat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1592971712',owner_user_name='tempest-AttachVolumeShelveTestJSON-1592971712-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:32:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1aad9aa1e64a9db4f78c0c12779300',uuid=367d718d-35ed-4c04-97f1-518bd0e100e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converting VIF {"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:50,bridge_name='br-int',has_traffic_filtering=True,id=b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cf7ba1-9f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG os_vif [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:50,bridge_name='br-int',has_traffic_filtering=True,id=b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cf7ba1-9f') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27760fc7-4260-5212-83e1-2a627f69f874', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7cf7ba1-9f, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7cf7ba1-9f, col_values=(('qos', UUID('b04b9c19-6ff8-4ad8-8ad7-078d167fad45')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7cf7ba1-9f, col_values=(('external_ids', {'iface-id': 'b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:37:50', 'vm-uuid': '367d718d-35ed-4c04-97f1-518bd0e100e1'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:32:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:32:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:10 user nova-compute[74311]: INFO os_vif [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:50,bridge_name='br-int',has_traffic_filtering=True,id=b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cf7ba1-9f')
Oct 20 10:32:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:32:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] No VIF found with MAC fa:16:3e:79:37:50, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:32:10 user nova-compute[74311]: DEBUG nova.network.neutron [req-01b5f3d9-576e-479a-8d73-0628a3484e27 req-b2b37a1b-6a16-4718-91fe-97c94604289c service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Updated VIF entry in instance network info cache for port b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:32:10 user nova-compute[74311]: DEBUG nova.network.neutron [req-01b5f3d9-576e-479a-8d73-0628a3484e27 req-b2b37a1b-6a16-4718-91fe-97c94604289c service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Updating instance_info_cache with network_info: [{"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:32:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01b5f3d9-576e-479a-8d73-0628a3484e27 req-b2b37a1b-6a16-4718-91fe-97c94604289c service nova] Releasing lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:32:10 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:32:10 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Took 0.84 seconds to deallocate network for instance.
Oct 20 10:32:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-95793b7e-8d02-42fe-a8e1-c02b9957c5d3 req-88a7cb10-95c3-48e5-8f96-98a26d1096ab service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Received event network-vif-deleted-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:32:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:10 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:32:10 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:32:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:11 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:32:11 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Deleted allocations for instance 00f57349-a3b2-49a1-99f9-97510634f3b0
Oct 20 10:32:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da278cd3-6878-4281-940c-18c51eff0660 tempest-AttachVolumeTestJSON-1992975846 tempest-AttachVolumeTestJSON-1992975846-project-member] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.241s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:11 user nova-compute[74311]: DEBUG nova.compute.manager [req-36b61f63-d31a-49f0-be9f-882c2b910c8a req-6a98cc25-c074-4ebc-9d21-68bb000d1e62 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received event network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:32:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-36b61f63-d31a-49f0-be9f-882c2b910c8a req-6a98cc25-c074-4ebc-9d21-68bb000d1e62 service nova] Acquiring lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-36b61f63-d31a-49f0-be9f-882c2b910c8a req-6a98cc25-c074-4ebc-9d21-68bb000d1e62 service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-36b61f63-d31a-49f0-be9f-882c2b910c8a req-6a98cc25-c074-4ebc-9d21-68bb000d1e62 service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:11 user nova-compute[74311]: DEBUG nova.compute.manager [req-36b61f63-d31a-49f0-be9f-882c2b910c8a req-6a98cc25-c074-4ebc-9d21-68bb000d1e62 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] No waiting events found dispatching network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:32:11 user nova-compute[74311]: WARNING nova.compute.manager [req-36b61f63-d31a-49f0-be9f-882c2b910c8a req-6a98cc25-c074-4ebc-9d21-68bb000d1e62 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received unexpected event network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 for instance with vm_state building and task_state spawning.
Oct 20 10:32:11 user nova-compute[74311]: DEBUG nova.compute.manager [req-455e6ea7-4336-4430-a061-651e6cf3e6b3 req-07eddf38-232d-42b9-8998-efbb8e0d23c1 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Received event network-vif-plugged-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:32:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-455e6ea7-4336-4430-a061-651e6cf3e6b3 req-07eddf38-232d-42b9-8998-efbb8e0d23c1 service nova] Acquiring lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-455e6ea7-4336-4430-a061-651e6cf3e6b3 req-07eddf38-232d-42b9-8998-efbb8e0d23c1 service nova] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-455e6ea7-4336-4430-a061-651e6cf3e6b3 req-07eddf38-232d-42b9-8998-efbb8e0d23c1 service nova] Lock "00f57349-a3b2-49a1-99f9-97510634f3b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:11 user nova-compute[74311]: DEBUG nova.compute.manager [req-455e6ea7-4336-4430-a061-651e6cf3e6b3 req-07eddf38-232d-42b9-8998-efbb8e0d23c1 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] No waiting events found dispatching network-vif-plugged-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:32:11 user nova-compute[74311]: WARNING nova.compute.manager [req-455e6ea7-4336-4430-a061-651e6cf3e6b3 req-07eddf38-232d-42b9-8998-efbb8e0d23c1 service nova] [instance: 00f57349-a3b2-49a1-99f9-97510634f3b0] Received unexpected event network-vif-plugged-ebe77cc0-8ca0-4dd5-bca5-dc0794962702 for instance with vm_state deleted and task_state None.
Oct 20 10:32:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:13 user nova-compute[74311]: DEBUG nova.compute.manager [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:32:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:32:13 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Instance spawned successfully.
Oct 20 10:32:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:32:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:32:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:32:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:32:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:32:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:32:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:32:13 user nova-compute[74311]: INFO nova.compute.manager [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Took 5.82 seconds to spawn the instance on the hypervisor.
Oct 20 10:32:13 user nova-compute[74311]: DEBUG nova.compute.manager [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:32:13 user nova-compute[74311]: INFO nova.compute.manager [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Took 6.59 seconds to build instance.
Oct 20 10:32:13 user nova-compute[74311]: DEBUG nova.compute.manager [req-f685afd4-95f4-46e7-9927-b42f08d0561c req-22ab89d9-ec8c-4221-9a4c-4daa8ae84484 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received event network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:32:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f685afd4-95f4-46e7-9927-b42f08d0561c req-22ab89d9-ec8c-4221-9a4c-4daa8ae84484 service nova] Acquiring lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f685afd4-95f4-46e7-9927-b42f08d0561c req-22ab89d9-ec8c-4221-9a4c-4daa8ae84484 service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f685afd4-95f4-46e7-9927-b42f08d0561c req-22ab89d9-ec8c-4221-9a4c-4daa8ae84484 service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:13 user nova-compute[74311]: DEBUG nova.compute.manager [req-f685afd4-95f4-46e7-9927-b42f08d0561c req-22ab89d9-ec8c-4221-9a4c-4daa8ae84484 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] No waiting events found dispatching network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:32:13 user nova-compute[74311]: WARNING nova.compute.manager [req-f685afd4-95f4-46e7-9927-b42f08d0561c req-22ab89d9-ec8c-4221-9a4c-4daa8ae84484 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received unexpected event network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 for instance with vm_state active and task_state None.
Oct 20 10:32:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d23e55f9-14a5-4519-95d9-6225975553ec tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.692s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:14 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:32:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSzpoBNj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:32:15 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:32:15 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:32:15 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[946eec9e-1dfe-4be9-94c1-5b82744ed773]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:32:15 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb99da82-9d1a-47f9-b788-c9a1d6382122]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70] added
Oct 20 10:32:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6ce35c-6fbc-48b2-9470-439cab831d25]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1683ad18-2c96-49bb-820d-df120bfc232b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nSzpoBNj {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nSzpoBNj" returned: 0 in 0.035s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bad9516-5298-4e6e-acdf-4c030d166538]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nSzpoBNj'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3c5197-1f65-4375-8b94-7e1d40586cd3]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[502f73c8-09c3-48af-ad8d-7a9896c6244d]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:32:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:32:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[85802bd7-b62e-4c33-bcf6-a346a68dc39a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70, portal: 172.16.0.220,3260]
Oct 20 10:32:15 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70, portal: 172.16.0.220,3260] successful.
Oct 20 10:32:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[db774bcd-0422-4dc8-ab6c-e0b2318aeb5a]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3469011b-8c42-49be-b041-3eae0c78ebf7]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:32:15 user nova-compute[74311]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 (non-flash)
Oct 20 10:32:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:32:15 user nova-compute[74311]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 (non-flash)
Oct 20 10:32:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa5e861-f3d9-413d-ac43-2e686f86c4cf]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSzpoBNj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:32:15 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:32:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:32:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23064333035616663', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:32:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064333035616663', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:32:16 user nova-compute[74311]: DEBUG nova.objects.instance [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lazy-loading 'flavor' on Instance uuid 593a4f46-9b5b-4a3c-95c7-21712b081069 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:32:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:32:16 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:32:16 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:32:16 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:32:16 user nova-compute[74311]:   <serial>095440b2-c402-49a5-b9f2-7fa39a2b7d70</serial>
Oct 20 10:32:16 user nova-compute[74311]: </disk>
Oct 20 10:32:16 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:32:17 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:32:17 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:32:17 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:32:17 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] No VIF found with MAC fa:16:3e:8b:a4:67, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:32:17 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-194ff6b1-0657-45c9-b8d6-31760ce40eb8 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.344s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:18 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:32:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:19 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:32:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:32:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "593a4f46-9b5b-4a3c-95c7-21712b081069" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:20 user nova-compute[74311]: INFO nova.compute.manager [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Detaching volume 095440b2-c402-49a5-b9f2-7fa39a2b7d70
Oct 20 10:32:20 user nova-compute[74311]: INFO nova.virt.block_device [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Attempting to driver detach volume 095440b2-c402-49a5-b9f2-7fa39a2b7d70 from mountpoint /dev/vdb
Oct 20 10:32:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Attempting to detach device vdb from instance 593a4f46-9b5b-4a3c-95c7-21712b081069 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:32:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:32:20 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:32:20 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:32:20 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:32:20 user nova-compute[74311]:   <serial>095440b2-c402-49a5-b9f2-7fa39a2b7d70</serial>
Oct 20 10:32:20 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:32:20 user nova-compute[74311]: </disk>
Oct 20 10:32:20 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:32:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:20 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Successfully detached device vdb from instance 593a4f46-9b5b-4a3c-95c7-21712b081069 from the persistent domain config.
Oct 20 10:32:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 593a4f46-9b5b-4a3c-95c7-21712b081069 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:32:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:32:20 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:32:20 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:32:20 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:32:20 user nova-compute[74311]:   <serial>095440b2-c402-49a5-b9f2-7fa39a2b7d70</serial>
Oct 20 10:32:20 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:32:20 user nova-compute[74311]: </disk>
Oct 20 10:32:20 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:32:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 593a4f46-9b5b-4a3c-95c7-21712b081069 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:32:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:32:23 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:32:23 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:32:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7965MB free_disk=25.161617279052734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 22d78096-bc6c-4d6b-93b6-845d596ed24b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 2c91da9a-42ec-46b0-acbe-83b9fe36510a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 593a4f46-9b5b-4a3c-95c7-21712b081069 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 367d718d-35ed-4c04-97f1-518bd0e100e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:24 user nova-compute[74311]: INFO nova.compute.manager [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Terminating instance
Oct 20 10:32:24 user nova-compute[74311]: DEBUG nova.compute.manager [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-abcbb975-9fe7-4e1c-bbf1-aaadf0431bb4 req-1c3d3e15-05af-4b58-994d-de31ef7510e2 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Received event network-vif-unplugged-0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-abcbb975-9fe7-4e1c-bbf1-aaadf0431bb4 req-1c3d3e15-05af-4b58-994d-de31ef7510e2 service nova] Acquiring lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-abcbb975-9fe7-4e1c-bbf1-aaadf0431bb4 req-1c3d3e15-05af-4b58-994d-de31ef7510e2 service nova] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-abcbb975-9fe7-4e1c-bbf1-aaadf0431bb4 req-1c3d3e15-05af-4b58-994d-de31ef7510e2 service nova] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-abcbb975-9fe7-4e1c-bbf1-aaadf0431bb4 req-1c3d3e15-05af-4b58-994d-de31ef7510e2 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] No waiting events found dispatching network-vif-unplugged-0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:32:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-abcbb975-9fe7-4e1c-bbf1-aaadf0431bb4 req-1c3d3e15-05af-4b58-994d-de31ef7510e2 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Received event network-vif-unplugged-0f62e9d8-7d48-4066-b706-a7fb7bc61869 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:25 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Instance destroyed successfully.
Oct 20 10:32:25 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'resources' on Instance uuid 2c91da9a-42ec-46b0-acbe-83b9fe36510a {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:29:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-365882943',display_name='tempest-AttachVolumeNegativeTest-server-365882943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-365882943',id=36,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiTyOPfYeDLwZNQ3G84CsnJCrMYI81h9WQ9mhTCgeiJlJ3UBZdY8bFAC+KG05s/Rc9zxXxcvQfOdBGXH+RSmaf1S1QLvTtEtJoAYN8NzaUGlniYQSzY7H9UDL9YjgE1nQ==',key_name='tempest-keypair-1042428170',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:29:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e99de7cef4b4569a497f77325515680',ramdisk_id='',reservation_id='r-k1y92mm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-543930091',owner_user_name='tempest-AttachVolumeNegativeTest-543930091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:29:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497267775cc747b8b65b8bcb276806ba',uuid=2c91da9a-42ec-46b0-acbe-83b9fe36510a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "address": "fa:16:3e:ae:4e:4e", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f62e9d8-7d", "ovs_interfaceid": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converting VIF {"id": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "address": "fa:16:3e:ae:4e:4e", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f62e9d8-7d", "ovs_interfaceid": "0f62e9d8-7d48-4066-b706-a7fb7bc61869", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:4e:4e,bridge_name='br-int',has_traffic_filtering=True,id=0f62e9d8-7d48-4066-b706-a7fb7bc61869,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f62e9d8-7d') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG os_vif [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:4e:4e,bridge_name='br-int',has_traffic_filtering=True,id=0f62e9d8-7d48-4066-b706-a7fb7bc61869,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f62e9d8-7d') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f62e9d8-7d, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da9723ef-64e6-45c5-adbd-89709bbd57bb) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:25 user nova-compute[74311]: INFO os_vif [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:4e:4e,bridge_name='br-int',has_traffic_filtering=True,id=0f62e9d8-7d48-4066-b706-a7fb7bc61869,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f62e9d8-7d')
Oct 20 10:32:25 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Deleting instance files /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a_del
Oct 20 10:32:25 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Deletion of /opt/stack/data/nova/instances/2c91da9a-42ec-46b0-acbe-83b9fe36510a_del complete
Oct 20 10:32:25 user nova-compute[74311]: INFO nova.compute.manager [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 20 10:32:25 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:32:25 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:32:26 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:32:26 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Took 0.68 seconds to deallocate network for instance.
Oct 20 10:32:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:26 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:32:26 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:32:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:26 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Deleted allocations for instance 2c91da9a-42ec-46b0-acbe-83b9fe36510a
Oct 20 10:32:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7a14ea69-8122-4259-ae39-24dcba889807 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.182s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-89f02268-6292-4038-82e5-b25a45b79ed0 req-3fe49382-0e5f-48c5-8cbd-b81ab16997a3 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Received event network-vif-plugged-0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:32:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-89f02268-6292-4038-82e5-b25a45b79ed0 req-3fe49382-0e5f-48c5-8cbd-b81ab16997a3 service nova] Acquiring lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-89f02268-6292-4038-82e5-b25a45b79ed0 req-3fe49382-0e5f-48c5-8cbd-b81ab16997a3 service nova] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-89f02268-6292-4038-82e5-b25a45b79ed0 req-3fe49382-0e5f-48c5-8cbd-b81ab16997a3 service nova] Lock "2c91da9a-42ec-46b0-acbe-83b9fe36510a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-89f02268-6292-4038-82e5-b25a45b79ed0 req-3fe49382-0e5f-48c5-8cbd-b81ab16997a3 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] No waiting events found dispatching network-vif-plugged-0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:32:26 user nova-compute[74311]: WARNING nova.compute.manager [req-89f02268-6292-4038-82e5-b25a45b79ed0 req-3fe49382-0e5f-48c5-8cbd-b81ab16997a3 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Received unexpected event network-vif-plugged-0f62e9d8-7d48-4066-b706-a7fb7bc61869 for instance with vm_state deleted and task_state None.
Oct 20 10:32:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-89f02268-6292-4038-82e5-b25a45b79ed0 req-3fe49382-0e5f-48c5-8cbd-b81ab16997a3 service nova] [instance: 2c91da9a-42ec-46b0-acbe-83b9fe36510a] Received event network-vif-deleted-0f62e9d8-7d48-4066-b706-a7fb7bc61869 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:32:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-1fd5d3b6-bbbf-491b-a5c4-13f065c39d32 req-06c10cfa-45c3-4cd0-ac3b-b3106cde0afa service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-changed-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:32:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-1fd5d3b6-bbbf-491b-a5c4-13f065c39d32 req-06c10cfa-45c3-4cd0-ac3b-b3106cde0afa service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Refreshing instance network info cache due to event network-changed-3e3e5d7a-8868-4b3f-b874-62faba374f3b. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:32:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1fd5d3b6-bbbf-491b-a5c4-13f065c39d32 req-06c10cfa-45c3-4cd0-ac3b-b3106cde0afa service nova] Acquiring lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:32:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1fd5d3b6-bbbf-491b-a5c4-13f065c39d32 req-06c10cfa-45c3-4cd0-ac3b-b3106cde0afa service nova] Acquired lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:32:30 user nova-compute[74311]: DEBUG nova.network.neutron [req-1fd5d3b6-bbbf-491b-a5c4-13f065c39d32 req-06c10cfa-45c3-4cd0-ac3b-b3106cde0afa service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Refreshing network info cache for port 3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "22d78096-bc6c-4d6b-93b6-845d596ed24b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:31 user nova-compute[74311]: INFO nova.compute.manager [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Terminating instance
Oct 20 10:32:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:31 user nova-compute[74311]: INFO nova.compute.manager [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Detaching volume a2c32e3c-4140-4758-8553-022bf9bed478
Oct 20 10:32:31 user nova-compute[74311]: DEBUG nova.network.neutron [req-1fd5d3b6-bbbf-491b-a5c4-13f065c39d32 req-06c10cfa-45c3-4cd0-ac3b-b3106cde0afa service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updated VIF entry in instance network info cache for port 3e3e5d7a-8868-4b3f-b874-62faba374f3b. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG nova.network.neutron [req-1fd5d3b6-bbbf-491b-a5c4-13f065c39d32 req-06c10cfa-45c3-4cd0-ac3b-b3106cde0afa service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updating instance_info_cache with network_info: [{"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:32:31 user nova-compute[74311]: INFO nova.virt.block_device [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Attempting to driver detach volume a2c32e3c-4140-4758-8553-022bf9bed478 from mountpoint /dev/vdb
Oct 20 10:32:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1fd5d3b6-bbbf-491b-a5c4-13f065c39d32 req-06c10cfa-45c3-4cd0-ac3b-b3106cde0afa service nova] Releasing lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Attempting to detach device vdb from instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:32:31 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:32:31 user nova-compute[74311]:   <source dev="/dev/sde"/>
Oct 20 10:32:31 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:32:31 user nova-compute[74311]:   <serial>a2c32e3c-4140-4758-8553-022bf9bed478</serial>
Oct 20 10:32:31 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:32:31 user nova-compute[74311]: </disk>
Oct 20 10:32:31 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:32:31 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Successfully detached device vdb from instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e from the persistent domain config.
Oct 20 10:32:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:32:31 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:32:31 user nova-compute[74311]:   <source dev="/dev/sde"/>
Oct 20 10:32:31 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:32:31 user nova-compute[74311]:   <serial>a2c32e3c-4140-4758-8553-022bf9bed478</serial>
Oct 20 10:32:31 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:32:31 user nova-compute[74311]: </disk>
Oct 20 10:32:31 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:32:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Instance destroyed successfully.
Oct 20 10:32:32 user nova-compute[74311]: DEBUG nova.objects.instance [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lazy-loading 'resources' on Instance uuid 22d78096-bc6c-4d6b-93b6-845d596ed24b {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:12:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2023935930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2023935930',id=2,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:12:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090bd6a8a14d4a308e67be7a12e47ae6',ramdisk_id='',reservation_id='r-0p926s0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:14:00Z,user_data=None,user_id='0c6b76de1f054ca0973f2f9ba2eafaed',uuid=22d78096-bc6c-4d6b-93b6-845d596ed24b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a618325-862e-4c54-a654-6d3284cb8bf3", "address": "fa:16:3e:e2:bf:e1", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a618325-86", "ovs_interfaceid": "3a618325-862e-4c54-a654-6d3284cb8bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converting VIF {"id": "3a618325-862e-4c54-a654-6d3284cb8bf3", "address": "fa:16:3e:e2:bf:e1", "network": {"id": "06f47a45-e9b4-45fb-b1ff-684a603b96f8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1691905006-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090bd6a8a14d4a308e67be7a12e47ae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a618325-86", "ovs_interfaceid": "3a618325-862e-4c54-a654-6d3284cb8bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:bf:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a618325-862e-4c54-a654-6d3284cb8bf3,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a618325-86') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG os_vif [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:bf:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a618325-862e-4c54-a654-6d3284cb8bf3,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a618325-86') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a618325-86, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e92f45bf-6084-435d-a069-43e6e2bfb05d) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:32:32 user nova-compute[74311]: INFO os_vif [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:bf:e1,bridge_name='br-int',has_traffic_filtering=True,id=3a618325-862e-4c54-a654-6d3284cb8bf3,network=Network(06f47a45-e9b4-45fb-b1ff-684a603b96f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a618325-86')
Oct 20 10:32:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Deleting instance files /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b_del
Oct 20 10:32:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Deletion of /opt/stack/data/nova/instances/22d78096-bc6c-4d6b-93b6-845d596ed24b_del complete
Oct 20 10:32:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-aa231ee2-274a-4f58-852e-a5deefc9922a req-fad67a8c-df47-4816-88f5-053348a766e7 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Received event network-vif-unplugged-3a618325-862e-4c54-a654-6d3284cb8bf3 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-aa231ee2-274a-4f58-852e-a5deefc9922a req-fad67a8c-df47-4816-88f5-053348a766e7 service nova] Acquiring lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-aa231ee2-274a-4f58-852e-a5deefc9922a req-fad67a8c-df47-4816-88f5-053348a766e7 service nova] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-aa231ee2-274a-4f58-852e-a5deefc9922a req-fad67a8c-df47-4816-88f5-053348a766e7 service nova] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-aa231ee2-274a-4f58-852e-a5deefc9922a req-fad67a8c-df47-4816-88f5-053348a766e7 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] No waiting events found dispatching network-vif-unplugged-3a618325-862e-4c54-a654-6d3284cb8bf3 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-aa231ee2-274a-4f58-852e-a5deefc9922a req-fad67a8c-df47-4816-88f5-053348a766e7 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Received event network-vif-unplugged-3a618325-862e-4c54-a654-6d3284cb8bf3 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:32:32 user nova-compute[74311]: INFO nova.compute.manager [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 20 10:32:32 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-6f9e7f35-f983-4a04-bdb0-e3eed44305a1 req-3b4a0a9b-3740-45b7-955b-ee7e3d7bbd5e service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-changed-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-6f9e7f35-f983-4a04-bdb0-e3eed44305a1 req-3b4a0a9b-3740-45b7-955b-ee7e3d7bbd5e service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Refreshing instance network info cache due to event network-changed-3e3e5d7a-8868-4b3f-b874-62faba374f3b. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6f9e7f35-f983-4a04-bdb0-e3eed44305a1 req-3b4a0a9b-3740-45b7-955b-ee7e3d7bbd5e service nova] Acquiring lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6f9e7f35-f983-4a04-bdb0-e3eed44305a1 req-3b4a0a9b-3740-45b7-955b-ee7e3d7bbd5e service nova] Acquired lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG nova.network.neutron [req-6f9e7f35-f983-4a04-bdb0-e3eed44305a1 req-3b4a0a9b-3740-45b7-955b-ee7e3d7bbd5e service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Refreshing network info cache for port 3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:32:33 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Took 0.75 seconds to deallocate network for instance.
Oct 20 10:32:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-29f15057-ea48-46d9-8504-fde38a283ef0 req-496202c1-6a85-4adf-af3f-0868809ef22b service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Received event network-vif-deleted-3a618325-862e-4c54-a654-6d3284cb8bf3 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:33 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Deleted allocations for instance 22d78096-bc6c-4d6b-93b6-845d596ed24b
Oct 20 10:32:33 user nova-compute[74311]: DEBUG nova.network.neutron [req-6f9e7f35-f983-4a04-bdb0-e3eed44305a1 req-3b4a0a9b-3740-45b7-955b-ee7e3d7bbd5e service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updated VIF entry in instance network info cache for port 3e3e5d7a-8868-4b3f-b874-62faba374f3b. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG nova.network.neutron [req-6f9e7f35-f983-4a04-bdb0-e3eed44305a1 req-3b4a0a9b-3740-45b7-955b-ee7e3d7bbd5e service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updating instance_info_cache with network_info: [{"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6f9e7f35-f983-4a04-bdb0-e3eed44305a1 req-3b4a0a9b-3740-45b7-955b-ee7e3d7bbd5e service nova] Releasing lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4cd6c191-6e1c-40ef-a0f2-499ab170905d tempest-ServerBootFromVolumeStableRescueTest-2019341345 tempest-ServerBootFromVolumeStableRescueTest-2019341345-project-member] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.383s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-76b2376b-07ad-4965-bcd0-36a4dd724595 req-de953911-eaa9-4fc6-bb53-117d5608ef33 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Received event network-vif-plugged-3a618325-862e-4c54-a654-6d3284cb8bf3 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:32:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-76b2376b-07ad-4965-bcd0-36a4dd724595 req-de953911-eaa9-4fc6-bb53-117d5608ef33 service nova] Acquiring lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-76b2376b-07ad-4965-bcd0-36a4dd724595 req-de953911-eaa9-4fc6-bb53-117d5608ef33 service nova] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-76b2376b-07ad-4965-bcd0-36a4dd724595 req-de953911-eaa9-4fc6-bb53-117d5608ef33 service nova] Lock "22d78096-bc6c-4d6b-93b6-845d596ed24b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-76b2376b-07ad-4965-bcd0-36a4dd724595 req-de953911-eaa9-4fc6-bb53-117d5608ef33 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] No waiting events found dispatching network-vif-plugged-3a618325-862e-4c54-a654-6d3284cb8bf3 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:32:34 user nova-compute[74311]: WARNING nova.compute.manager [req-76b2376b-07ad-4965-bcd0-36a4dd724595 req-de953911-eaa9-4fc6-bb53-117d5608ef33 service nova] [instance: 22d78096-bc6c-4d6b-93b6-845d596ed24b] Received unexpected event network-vif-plugged-3a618325-862e-4c54-a654-6d3284cb8bf3 for instance with vm_state deleted and task_state None.
Oct 20 10:32:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:40 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 593a4f46-9b5b-4a3c-95c7-21712b081069 is timed out.
Oct 20 10:32:40 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Successfully detached device vdb from instance 593a4f46-9b5b-4a3c-95c7-21712b081069 from the live domain config.
Oct 20 10:32:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nSzpoBNj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:32:40 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:32:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.060s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[09edc594-90e2-4fed-b697-e1d34763661b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:32:40 user nova-compute[74311]: No targets found.
Oct 20 10:32:40 user nova-compute[74311]: iSNS:
Oct 20 10:32:40 user nova-compute[74311]: No targets found.
Oct 20 10:32:40 user nova-compute[74311]: STATIC:
Oct 20 10:32:40 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478
Oct 20 10:32:40 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:32:40 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:32:40 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70
Oct 20 10:32:40 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:32:40 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:32:40 user nova-compute[74311]: FIRMWARE:
Oct 20 10:32:40 user nova-compute[74311]: No targets found.
Oct 20 10:32:40 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:32:40 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:32:40 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a85a79-3778-4e90-be37-f46b8d9b8dbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fd9b5f-40a6-49c6-92ae-3a3d0d0fe997]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:32:40 user nova-compute[74311]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 (non-flash)
Oct 20 10:32:40 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:32:40 user nova-compute[74311]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 (non-flash)
Oct 20 10:32:40 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164fc24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d04fae-203c-48d8-9f45-e3cf6fceb59b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff9c0b0-1819-44a5-8c6b-0e152ca4b6d9]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bdf4e8-3f1a-4eb6-b63f-ac0a135f481f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:32:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.294s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc062af-6a2d-49cf-95ef-05dbfc27aa5b]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[28505681-4bfb-4b8c-b82e-b43ba2150196]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[077015e7-fb89-460a-bc5f-ba702a3a7265]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70, portal: 172.16.0.220,3260]
Oct 20 10:32:41 user nova-compute[74311]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70, portal: 172.16.0.220,3260] successful.
Oct 20 10:32:41 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095440b2-c402-49a5-b9f2-7fa39a2b7d70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cac1b7-344e-4a71-a0b9-dc544ab567d0]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.599s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] <== disconnect_volume: return (600ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:32:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:32:42 user nova-compute[74311]: DEBUG nova.objects.instance [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lazy-loading 'flavor' on Instance uuid 593a4f46-9b5b-4a3c-95c7-21712b081069 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:32:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-759d9003-4238-4bbd-910c-2fee59e3126d tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.091s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:52 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e is timed out.
Oct 20 10:32:52 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Successfully detached device vdb from instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e from the live domain config.
Oct 20 10:32:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBLXuRZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:32:52 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3da8f4-c44a-424b-a039-d8ed1d0703e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:32:52 user nova-compute[74311]: No targets found.
Oct 20 10:32:52 user nova-compute[74311]: iSNS:
Oct 20 10:32:52 user nova-compute[74311]: No targets found.
Oct 20 10:32:52 user nova-compute[74311]: STATIC:
Oct 20 10:32:52 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478
Oct 20 10:32:52 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:32:52 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:32:52 user nova-compute[74311]: FIRMWARE:
Oct 20 10:32:52 user nova-compute[74311]: No targets found.
Oct 20 10:32:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:32:52 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:32:52 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e93afe-c07f-40b4-b391-6fd488b523e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4affd193-0f42-4cec-96e3-ce6918932e60]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:32:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 (non-flash)
Oct 20 10:32:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164fad750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478'): ({'sde'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Removing single pathed devices sde {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c764cee-8be6-4a87-9c83-fb1f3852bed1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cee9ecf-04c4-4570-9e62-2e639ccce0d1]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Flushing IO for device /dev/sde {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ffab7e-d554-4acd-8af6-27063f5053d4]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a4b6d2-22b9-4b71-a826-bf37c96165db]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] SCSI volumes sde have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ce1474-5a05-4c4f-8691-57b8ebb3cce7]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b922a0f-082f-4ddc-8494-f21de92e2d22]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478, portal: 172.16.0.220,3260]
Oct 20 10:32:52 user nova-compute[74311]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478, portal: 172.16.0.220,3260] successful.
Oct 20 10:32:52 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2c32e3c-4140-4758-8553-022bf9bed478 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1f064d-2ad0-4f89-a279-dca81b0e50e1]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] <== disconnect_volume: return (282ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:32:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:32:55 user nova-compute[74311]: DEBUG nova.objects.instance [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'flavor' on Instance uuid ce052ea1-5937-43d6-9ff9-694ff15b7f3e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:32:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-10b2ec7e-7a43-4243-8668-23c1c64f3fa9 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.637s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:32:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:32:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:32:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:32:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:32:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:32:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:59 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:32:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:32:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:32:59 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:32:59 user nova-compute[74311]: INFO nova.compute.claims [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Claim successful on node user
Oct 20 10:33:00 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:33:00 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:33:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:33:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:33:00 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:33:00 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:33:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:33:00 user nova-compute[74311]: DEBUG nova.policy [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9634a3daf064bf2aad6ea38454f7639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7a52d2fa8243fabc22baa8694e14d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:33:00 user nova-compute[74311]: INFO nova.virt.block_device [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Booting with volume snapshot 141ab9d5-4ba9-4878-8a41-4617cbe5eace at /dev/vda
Oct 20 10:33:01 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Successfully created port: e853f99d-3932-4c66-9ad8-abfd70236a52 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:33:01 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Successfully updated port: e853f99d-3932-4c66-9ad8-abfd70236a52 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:33:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "refresh_cache-ddc14ed0-b767-49c6-b88f-fdc8a04261cc" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:33:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquired lock "refresh_cache-ddc14ed0-b767-49c6-b88f-fdc8a04261cc" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:33:01 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:33:01 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:33:02 user nova-compute[74311]: DEBUG nova.compute.manager [req-91a3c77b-ee10-4a05-af39-3091059f6dcf req-8b198653-d22b-4f41-8f83-5e9dc11cd507 service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Received event network-changed-e853f99d-3932-4c66-9ad8-abfd70236a52 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:33:02 user nova-compute[74311]: DEBUG nova.compute.manager [req-91a3c77b-ee10-4a05-af39-3091059f6dcf req-8b198653-d22b-4f41-8f83-5e9dc11cd507 service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Refreshing instance network info cache due to event network-changed-e853f99d-3932-4c66-9ad8-abfd70236a52. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:33:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-91a3c77b-ee10-4a05-af39-3091059f6dcf req-8b198653-d22b-4f41-8f83-5e9dc11cd507 service nova] Acquiring lock "refresh_cache-ddc14ed0-b767-49c6-b88f-fdc8a04261cc" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:33:02 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Updating instance_info_cache with network_info: [{"id": "e853f99d-3932-4c66-9ad8-abfd70236a52", "address": "fa:16:3e:77:a0:8a", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape853f99d-39", "ovs_interfaceid": "e853f99d-3932-4c66-9ad8-abfd70236a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:33:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Releasing lock "refresh_cache-ddc14ed0-b767-49c6-b88f-fdc8a04261cc" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:33:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Instance network_info: |[{"id": "e853f99d-3932-4c66-9ad8-abfd70236a52", "address": "fa:16:3e:77:a0:8a", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape853f99d-39", "ovs_interfaceid": "e853f99d-3932-4c66-9ad8-abfd70236a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:33:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-91a3c77b-ee10-4a05-af39-3091059f6dcf req-8b198653-d22b-4f41-8f83-5e9dc11cd507 service nova] Acquired lock "refresh_cache-ddc14ed0-b767-49c6-b88f-fdc8a04261cc" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:33:02 user nova-compute[74311]: DEBUG nova.network.neutron [req-91a3c77b-ee10-4a05-af39-3091059f6dcf req-8b198653-d22b-4f41-8f83-5e9dc11cd507 service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Refreshing network info cache for port e853f99d-3932-4c66-9ad8-abfd70236a52 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:33:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:02 user nova-compute[74311]: DEBUG nova.network.neutron [req-91a3c77b-ee10-4a05-af39-3091059f6dcf req-8b198653-d22b-4f41-8f83-5e9dc11cd507 service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Updated VIF entry in instance network info cache for port e853f99d-3932-4c66-9ad8-abfd70236a52. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:33:02 user nova-compute[74311]: DEBUG nova.network.neutron [req-91a3c77b-ee10-4a05-af39-3091059f6dcf req-8b198653-d22b-4f41-8f83-5e9dc11cd507 service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Updating instance_info_cache with network_info: [{"id": "e853f99d-3932-4c66-9ad8-abfd70236a52", "address": "fa:16:3e:77:a0:8a", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape853f99d-39", "ovs_interfaceid": "e853f99d-3932-4c66-9ad8-abfd70236a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:33:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-91a3c77b-ee10-4a05-af39-3091059f6dcf req-8b198653-d22b-4f41-8f83-5e9dc11cd507 service nova] Releasing lock "refresh_cache-ddc14ed0-b767-49c6-b88f-fdc8a04261cc" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:33:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG os_brick.utils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4fdc61-44e1-4dd4-9fc4-fe27e0b329a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f23c64-bade-4cf5-abcc-178d8958796b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c18cbba-eedc-482c-b228-fcbcfd2035b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec6a5b7-0bc6-46a3-bf12-6b111113a672]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:33:06 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:33:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f99c8e6-eb62-4bfd-b92f-9ba677aa3a14]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG os_brick.utils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:33:06 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Updating existing volume attachment record: 9ea9a916-467a-4365-a300-98532869d96d {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:33:07 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:33:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:33:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:33:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:33:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:33:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updating instance_info_cache with network_info: [{"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:33:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-ce052ea1-5937-43d6-9ff9-694ff15b7f3e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:33:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:33:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:12 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:33:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:14 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:33:15 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:33:15 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:33:16 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:33:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "58bba07b-6122-47f7-9cea-44cebe840ced" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "58bba07b-6122-47f7-9cea-44cebe840ced" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG nova.compute.manager [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:33:19 user nova-compute[74311]: INFO nova.compute.claims [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Claim successful on node user
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Refreshing inventories for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Updating ProviderTree inventory for provider 77cac819-3c22-4fec-a59d-0525ac40a90b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 10:33:19 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Updating inventory in ProviderTree for provider 77cac819-3c22-4fec-a59d-0525ac40a90b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Refreshing aggregate associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, aggregates: None {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Refreshing trait associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3 {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.724s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:33:20 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:33:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG nova.policy [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '497267775cc747b8b65b8bcb276806ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e99de7cef4b4569a497f77325515680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:33:20 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Creating image(s)
Oct 20 10:33:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "/opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "/opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "/opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.314s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.327s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG nova.compute.manager [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk 1073741824" returned: 0 in 0.141s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.497s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:21 user nova-compute[74311]: INFO nova.compute.manager [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] instance snapshotting
Oct 20 10:33:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.280s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:22 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Beginning live snapshot process
Oct 20 10:33:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:22 user nova-compute[74311]: INFO nova.compute.manager [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Terminating instance
Oct 20 10:33:22 user nova-compute[74311]: DEBUG nova.compute.manager [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e/disk --force-share --output=json" returned: 0 in 0.338s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Cannot resize image /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Ensure instance console log exists: /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.network.neutron [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Successfully created port: 2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:23 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:33:23 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8207MB free_disk=25.273109436035156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:23 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Instance destroyed successfully.
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.objects.instance [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'resources' on Instance uuid ce052ea1-5937-43d6-9ff9-694ff15b7f3e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:26:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1295854338',display_name='tempest-ServerRescueNegativeTestJSON-server-1295854338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1295854338',id=32,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyu5kH6h3CMySukZ4xYw3WRv8PPFiosuSGC1QUW+H0JC2aBbjS8QlGQc+KOukJmdnZqV8LAzxGqK3l3vxdKR4Exoa6KSvU7gjrjaAd92zAtyVLhJNetUMdmWcoXhIfgjA==',key_name='tempest-keypair-793510087',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:28:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07b7c2a684a3466eba4799473c725066',ramdisk_id='',reservation_id='r-7gmb5360',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-320006607',owner_user_name='tempest-ServerRescueNegativeTestJSON-320006607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='302a265253b14a19be48546953baaebf',uuid=ce052ea1-5937-43d6-9ff9-694ff15b7f3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converting VIF {"id": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "address": "fa:16:3e:ce:fd:01", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e3e5d7a-88", "ovs_interfaceid": "3e3e5d7a-8868-4b3f-b874-62faba374f3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=3e3e5d7a-8868-4b3f-b874-62faba374f3b,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3e5d7a-88') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG os_vif [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=3e3e5d7a-8868-4b3f-b874-62faba374f3b,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3e5d7a-88') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e3e5d7a-88, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4bef9c3d-14d7-4336-90be-bb9827ae12c7) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:33:23 user nova-compute[74311]: INFO os_vif [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:fd:01,bridge_name='br-int',has_traffic_filtering=True,id=3e3e5d7a-8868-4b3f-b874-62faba374f3b,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e3e5d7a-88')
Oct 20 10:33:23 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Deleting instance files /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e_del
Oct 20 10:33:23 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Deletion of /opt/stack/data/nova/instances/ce052ea1-5937-43d6-9ff9-694ff15b7f3e_del complete
Oct 20 10:33:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json -f qcow2 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:23 user nova-compute[74311]: INFO nova.compute.manager [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Took 1.46 seconds to destroy the instance on the hypervisor.
Oct 20 10:33:23 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-e5f7f9e1-8d75-4f58-92b7-22d65e99f318 req-8d491017-b8d5-4434-b671-41cc85e23500 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-vif-unplugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e5f7f9e1-8d75-4f58-92b7-22d65e99f318 req-8d491017-b8d5-4434-b671-41cc85e23500 service nova] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e5f7f9e1-8d75-4f58-92b7-22d65e99f318 req-8d491017-b8d5-4434-b671-41cc85e23500 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e5f7f9e1-8d75-4f58-92b7-22d65e99f318 req-8d491017-b8d5-4434-b671-41cc85e23500 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-e5f7f9e1-8d75-4f58-92b7-22d65e99f318 req-8d491017-b8d5-4434-b671-41cc85e23500 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] No waiting events found dispatching network-vif-unplugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.compute.manager [req-e5f7f9e1-8d75-4f58-92b7-22d65e99f318 req-8d491017-b8d5-4434-b671-41cc85e23500 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-vif-unplugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 593a4f46-9b5b-4a3c-95c7-21712b081069 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 367d718d-35ed-4c04-97f1-518bd0e100e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ddc14ed0-b767-49c6-b88f-fdc8a04261cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 58bba07b-6122-47f7-9cea-44cebe840ced actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json -f qcow2" returned: 0 in 0.272s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json -f qcow2 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json -f qcow2" returned: 0 in 0.237s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:24 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:33:24 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:33:24 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:33:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.781s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.226s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqk4z8zw7/47089ba8d1794213a9f7505e2e9adc0f.delta 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqk4z8zw7/47089ba8d1794213a9f7505e2e9adc0f.delta 1073741824" returned: 0 in 0.076s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:24 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 10:33:25 user nova-compute[74311]: DEBUG nova.network.neutron [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Successfully updated port: 2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "refresh_cache-58bba07b-6122-47f7-9cea-44cebe840ced" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquired lock "refresh_cache-58bba07b-6122-47f7-9cea-44cebe840ced" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG nova.network.neutron [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-6aedc581-3800-4be3-a4a0-2ab99d30c00d req-334ad0ba-fd31-407b-9b74-b95c956635bd service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Received event network-changed-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-6aedc581-3800-4be3-a4a0-2ab99d30c00d req-334ad0ba-fd31-407b-9b74-b95c956635bd service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Refreshing instance network info cache due to event network-changed-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6aedc581-3800-4be3-a4a0-2ab99d30c00d req-334ad0ba-fd31-407b-9b74-b95c956635bd service nova] Acquiring lock "refresh_cache-58bba07b-6122-47f7-9cea-44cebe840ced" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] COPY block job progress, current cursor: 458752 final cursor: 75563008 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG nova.network.neutron [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-61bc2406-5a1b-484f-9964-bcb76b5ef637 req-33590685-b1ec-4903-ba59-d561de30295c service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-vif-deleted-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:33:25 user nova-compute[74311]: INFO nova.compute.manager [req-61bc2406-5a1b-484f-9964-bcb76b5ef637 req-33590685-b1ec-4903-ba59-d561de30295c service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Neutron deleted interface 3e3e5d7a-8868-4b3f-b874-62faba374f3b; detaching it from the instance and deleting it from the info cache
Oct 20 10:33:25 user nova-compute[74311]: DEBUG nova.network.neutron [req-61bc2406-5a1b-484f-9964-bcb76b5ef637 req-33590685-b1ec-4903-ba59-d561de30295c service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:33:25 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Took 2.05 seconds to deallocate network for instance.
Oct 20 10:33:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-61bc2406-5a1b-484f-9964-bcb76b5ef637 req-33590685-b1ec-4903-ba59-d561de30295c service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Detach interface failed, port_id=3e3e5d7a-8868-4b3f-b874-62faba374f3b, reason: Instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] COPY block job progress, current cursor: 27066368 final cursor: 75563008 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-5f876a19-57d0-4c2a-aa22-f1adc22290d4 req-d20d9cfe-bc64-4aa5-a3d2-210f64997ac1 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5f876a19-57d0-4c2a-aa22-f1adc22290d4 req-d20d9cfe-bc64-4aa5-a3d2-210f64997ac1 service nova] Acquiring lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5f876a19-57d0-4c2a-aa22-f1adc22290d4 req-d20d9cfe-bc64-4aa5-a3d2-210f64997ac1 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5f876a19-57d0-4c2a-aa22-f1adc22290d4 req-d20d9cfe-bc64-4aa5-a3d2-210f64997ac1 service nova] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-5f876a19-57d0-4c2a-aa22-f1adc22290d4 req-d20d9cfe-bc64-4aa5-a3d2-210f64997ac1 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] No waiting events found dispatching network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:33:25 user nova-compute[74311]: WARNING nova.compute.manager [req-5f876a19-57d0-4c2a-aa22-f1adc22290d4 req-d20d9cfe-bc64-4aa5-a3d2-210f64997ac1 service nova] [instance: ce052ea1-5937-43d6-9ff9-694ff15b7f3e] Received unexpected event network-vif-plugged-3e3e5d7a-8868-4b3f-b874-62faba374f3b for instance with vm_state active and task_state deleting.
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.network.neutron [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Updating instance_info_cache with network_info: [{"id": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "address": "fa:16:3e:e2:9d:6f", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2290e0-26", "ovs_interfaceid": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Releasing lock "refresh_cache-58bba07b-6122-47f7-9cea-44cebe840ced" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Instance network_info: |[{"id": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "address": "fa:16:3e:e2:9d:6f", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2290e0-26", "ovs_interfaceid": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6aedc581-3800-4be3-a4a0-2ab99d30c00d req-334ad0ba-fd31-407b-9b74-b95c956635bd service nova] Acquired lock "refresh_cache-58bba07b-6122-47f7-9cea-44cebe840ced" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.network.neutron [req-6aedc581-3800-4be3-a4a0-2ab99d30c00d req-334ad0ba-fd31-407b-9b74-b95c956635bd service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Refreshing network info cache for port 2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Start _get_guest_xml network_info=[{"id": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "address": "fa:16:3e:e2:9d:6f", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2290e0-26", "ovs_interfaceid": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:33:26 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:33:26 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-656887913',display_name='tempest-AttachVolumeNegativeTest-server-656887913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-656887913',id=40,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwwhObZmM6ufxyfuoM0Z9AbnThkVvN05epXXLMaeaLkOzSz3+aVK5lFN17gBjkNV/ObE2Zx+fx+TSvfWLpiKBP0hjrdPDS53LzSkpacNOQK9BRuB0iiiYgfo79hgNcGkA==',key_name='tempest-keypair-1660765320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e99de7cef4b4569a497f77325515680',ramdisk_id='',reservation_id='r-5bkw3seq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-543930091',owner_user_name='tempest-AttachVolumeNegativeTest-543930091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497267775cc747b8b65b8bcb276806ba',uuid=58bba07b-6122-47f7-9cea-44cebe840ced,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "address": "fa:16:3e:e2:9d:6f", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2290e0-26", "ovs_interfaceid": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converting VIF {"id": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "address": "fa:16:3e:e2:9d:6f", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2290e0-26", "ovs_interfaceid": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:9d:6f,bridge_name='br-int',has_traffic_filtering=True,id=2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2290e0-26') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.objects.instance [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'pci_devices' on Instance uuid 58bba07b-6122-47f7-9cea-44cebe840ced {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:33:26 user nova-compute[74311]:   <uuid>58bba07b-6122-47f7-9cea-44cebe840ced</uuid>
Oct 20 10:33:26 user nova-compute[74311]:   <name>instance-00000028</name>
Oct 20 10:33:26 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:33:26 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:33:26 user nova-compute[74311]:   <metadata>
Oct 20 10:33:26 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:33:26 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:33:26 user nova-compute[74311]:       <nova:name>tempest-AttachVolumeNegativeTest-server-656887913</nova:name>
Oct 20 10:33:26 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:33:26</nova:creationTime>
Oct 20 10:33:26 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:33:26 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:33:26 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:33:26 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:33:26 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:33:26 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:33:26 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:33:26 user nova-compute[74311]:       <nova:owner>
Oct 20 10:33:26 user nova-compute[74311]:         <nova:user uuid="497267775cc747b8b65b8bcb276806ba">tempest-AttachVolumeNegativeTest-543930091-project-member</nova:user>
Oct 20 10:33:26 user nova-compute[74311]:         <nova:project uuid="4e99de7cef4b4569a497f77325515680">tempest-AttachVolumeNegativeTest-543930091</nova:project>
Oct 20 10:33:26 user nova-compute[74311]:       </nova:owner>
Oct 20 10:33:26 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:33:26 user nova-compute[74311]:       <nova:ports>
Oct 20 10:33:26 user nova-compute[74311]:         <nova:port uuid="2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2">
Oct 20 10:33:26 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 10:33:26 user nova-compute[74311]:         </nova:port>
Oct 20 10:33:26 user nova-compute[74311]:       </nova:ports>
Oct 20 10:33:26 user nova-compute[74311]:     </nova:instance>
Oct 20 10:33:26 user nova-compute[74311]:   </metadata>
Oct 20 10:33:26 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:33:26 user nova-compute[74311]:     <system>
Oct 20 10:33:26 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:33:26 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:33:26 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:33:26 user nova-compute[74311]:       <entry name="serial">58bba07b-6122-47f7-9cea-44cebe840ced</entry>
Oct 20 10:33:26 user nova-compute[74311]:       <entry name="uuid">58bba07b-6122-47f7-9cea-44cebe840ced</entry>
Oct 20 10:33:26 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:33:26 user nova-compute[74311]:     </system>
Oct 20 10:33:26 user nova-compute[74311]:   </sysinfo>
Oct 20 10:33:26 user nova-compute[74311]:   <os>
Oct 20 10:33:26 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:33:26 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:33:26 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:33:26 user nova-compute[74311]:   </os>
Oct 20 10:33:26 user nova-compute[74311]:   <features>
Oct 20 10:33:26 user nova-compute[74311]:     <acpi/>
Oct 20 10:33:26 user nova-compute[74311]:     <apic/>
Oct 20 10:33:26 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:33:26 user nova-compute[74311]:   </features>
Oct 20 10:33:26 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:33:26 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:33:26 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:33:26 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:33:26 user nova-compute[74311]:   </clock>
Oct 20 10:33:26 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:33:26 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:33:26 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:33:26 user nova-compute[74311]:   </cpu>
Oct 20 10:33:26 user nova-compute[74311]:   <devices>
Oct 20 10:33:26 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:33:26 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:33:26 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk"/>
Oct 20 10:33:26 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:33:26 user nova-compute[74311]:     </disk>
Oct 20 10:33:26 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:33:26 user nova-compute[74311]:       <mac address="fa:16:3e:e2:9d:6f"/>
Oct 20 10:33:26 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:33:26 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:33:26 user nova-compute[74311]:       <target dev="tap2b2290e0-26"/>
Oct 20 10:33:26 user nova-compute[74311]:     </interface>
Oct 20 10:33:26 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:33:26 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/console.log" append="off"/>
Oct 20 10:33:26 user nova-compute[74311]:     </serial>
Oct 20 10:33:26 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:33:26 user nova-compute[74311]:     <video>
Oct 20 10:33:26 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:33:26 user nova-compute[74311]:     </video>
Oct 20 10:33:26 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:33:26 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:33:26 user nova-compute[74311]:     </rng>
Oct 20 10:33:26 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:33:26 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:33:26 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:33:26 user nova-compute[74311]:     </memballoon>
Oct 20 10:33:26 user nova-compute[74311]:   </devices>
Oct 20 10:33:26 user nova-compute[74311]: </domain>
Oct 20 10:33:26 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-656887913',display_name='tempest-AttachVolumeNegativeTest-server-656887913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-656887913',id=40,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwwhObZmM6ufxyfuoM0Z9AbnThkVvN05epXXLMaeaLkOzSz3+aVK5lFN17gBjkNV/ObE2Zx+fx+TSvfWLpiKBP0hjrdPDS53LzSkpacNOQK9BRuB0iiiYgfo79hgNcGkA==',key_name='tempest-keypair-1660765320',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e99de7cef4b4569a497f77325515680',ramdisk_id='',reservation_id='r-5bkw3seq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-543930091',owner_user_name='tempest-AttachVolumeNegativeTest-543930091-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497267775cc747b8b65b8bcb276806ba',uuid=58bba07b-6122-47f7-9cea-44cebe840ced,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "address": "fa:16:3e:e2:9d:6f", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2290e0-26", "ovs_interfaceid": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converting VIF {"id": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "address": "fa:16:3e:e2:9d:6f", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2290e0-26", "ovs_interfaceid": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:9d:6f,bridge_name='br-int',has_traffic_filtering=True,id=2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2290e0-26') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG os_vif [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:9d:6f,bridge_name='br-int',has_traffic_filtering=True,id=2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2290e0-26') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '75e1c661-0571-54bd-8a2d-aac55c5e0df2', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b2290e0-26, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b2290e0-26, col_values=(('qos', UUID('889f1cdb-fb1d-40fb-856a-b7d3c2788035')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b2290e0-26, col_values=(('external_ids', {'iface-id': '2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:9d:6f', 'vm-uuid': '58bba07b-6122-47f7-9cea-44cebe840ced'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:26 user nova-compute[74311]: INFO os_vif [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:9d:6f,bridge_name='br-int',has_traffic_filtering=True,id=2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2290e0-26')
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74311) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 10:33:26 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:33:26 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Creating image(s)
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Ensure instance console log exists: /opt/stack/data/nova/instances/ddc14ed0-b767-49c6-b88f-fdc8a04261cc/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Start _get_guest_xml network_info=[{"id": "e853f99d-3932-4c66-9ad8-abfd70236a52", "address": "fa:16:3e:77:a0:8a", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape853f99d-39", "ovs_interfaceid": "e853f99d-3932-4c66-9ad8-abfd70236a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '9ea9a916-467a-4365-a300-98532869d96d', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeuHXlGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ddc14ed0-b767-49c6-b88f-fdc8a04261cc', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4', 'serial': 'f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:33:26 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Deleted allocations for instance ce052ea1-5937-43d6-9ff9-694ff15b7f3e
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqk4z8zw7/47089ba8d1794213a9f7505e2e9adc0f.delta /opt/stack/data/nova/instances/snapshots/tmpqk4z8zw7/47089ba8d1794213a9f7505e2e9adc0f {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No VIF found with MAC fa:16:3e:e2:9d:6f, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:33:26 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:33:26 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeuHXlGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:33:26 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:33:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:33:26 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:33:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:33:26 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-62160663-01b7-4584-bc51-a9ce8425d9d7 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "ce052ea1-5937-43d6-9ff9-694ff15b7f3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.609s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[54883859-0eec-4191-acf3-b31932c6825c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:33:26 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc0d931-9e21-4316-befb-7bea04f277f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4] added
Oct 20 10:33:26 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.047s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d104526-7a07-425d-937c-2c443278f81b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:33:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.061s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[976511ae-a7b6-43c4-b54f-71670c806230]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EeuHXlGm {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EeuHXlGm" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25764f4-402e-4f82-9744-2dbb49f31643]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EeuHXlGm'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f073693e-9383-4266-8d62-4fb604981ade]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72c7654-6f08-44bf-85db-3b0b14ed58b0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:33:27 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:33:27 user nova-compute[74311]:  {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:33:27 user nova-compute[74311]: WARNING os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 10:33:27 user nova-compute[74311]: 
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[384f6d77-884d-40e0-89a5-5eb15507ac49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4, portal: 172.16.0.220,3260]
Oct 20 10:33:27 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4, portal: 172.16.0.220,3260] successful.
Oct 20 10:33:27 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.070s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2115b2-4b6b-4bff-8771-0467ff21992c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3671077-2a47-49e2-b144-b8b751cf0c01]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 (non-flash)
Oct 20 10:33:27 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 (non-flash)
Oct 20 10:33:27 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.451s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.082s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[55eb8afd-f1b8-4e5a-9d90-2cf76354991f]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:33:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqk4z8zw7/47089ba8d1794213a9f7505e2e9adc0f.delta /opt/stack/data/nova/instances/snapshots/tmpqk4z8zw7/47089ba8d1794213a9f7505e2e9adc0f" returned: 0 in 0.832s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:27 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Snapshot extracted, beginning image upload
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.network.neutron [req-6aedc581-3800-4be3-a4a0-2ab99d30c00d req-334ad0ba-fd31-407b-9b74-b95c956635bd service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Updated VIF entry in instance network info cache for port 2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.network.neutron [req-6aedc581-3800-4be3-a4a0-2ab99d30c00d req-334ad0ba-fd31-407b-9b74-b95c956635bd service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Updating instance_info_cache with network_info: [{"id": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "address": "fa:16:3e:e2:9d:6f", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2290e0-26", "ovs_interfaceid": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6aedc581-3800-4be3-a4a0-2ab99d30c00d req-334ad0ba-fd31-407b-9b74-b95c956635bd service nova] Releasing lock "refresh_cache-58bba07b-6122-47f7-9cea-44cebe840ced" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeuHXlGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.548s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== connect_volume: return (1550ms) {'type': 'block', 'scsi_wwn': '23134383132366430', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134383132366430', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1811429318',display_name='tempest-TestVolumeBootPattern-server-1811429318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1811429318',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-c6ayysfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:33:00Z,user_data=None,user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=ddc14ed0-b767-49c6-b88f-fdc8a04261cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e853f99d-3932-4c66-9ad8-abfd70236a52", "address": "fa:16:3e:77:a0:8a", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape853f99d-39", "ovs_interfaceid": "e853f99d-3932-4c66-9ad8-abfd70236a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "e853f99d-3932-4c66-9ad8-abfd70236a52", "address": "fa:16:3e:77:a0:8a", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape853f99d-39", "ovs_interfaceid": "e853f99d-3932-4c66-9ad8-abfd70236a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:a0:8a,bridge_name='br-int',has_traffic_filtering=True,id=e853f99d-3932-4c66-9ad8-abfd70236a52,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape853f99d-39') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.objects.instance [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lazy-loading 'pci_devices' on Instance uuid ddc14ed0-b767-49c6-b88f-fdc8a04261cc {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:33:28 user nova-compute[74311]:   <uuid>ddc14ed0-b767-49c6-b88f-fdc8a04261cc</uuid>
Oct 20 10:33:28 user nova-compute[74311]:   <name>instance-00000027</name>
Oct 20 10:33:28 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:33:28 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:33:28 user nova-compute[74311]:   <metadata>
Oct 20 10:33:28 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:33:28 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:33:28 user nova-compute[74311]:       <nova:name>tempest-TestVolumeBootPattern-server-1811429318</nova:name>
Oct 20 10:33:28 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:33:26</nova:creationTime>
Oct 20 10:33:28 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:33:28 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:33:28 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:33:28 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:33:28 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:33:28 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:33:28 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:33:28 user nova-compute[74311]:       <nova:owner>
Oct 20 10:33:28 user nova-compute[74311]:         <nova:user uuid="f9634a3daf064bf2aad6ea38454f7639">tempest-TestVolumeBootPattern-1419375529-project-member</nova:user>
Oct 20 10:33:28 user nova-compute[74311]:         <nova:project uuid="aa7a52d2fa8243fabc22baa8694e14d6">tempest-TestVolumeBootPattern-1419375529</nova:project>
Oct 20 10:33:28 user nova-compute[74311]:       </nova:owner>
Oct 20 10:33:28 user nova-compute[74311]:       <nova:ports>
Oct 20 10:33:28 user nova-compute[74311]:         <nova:port uuid="e853f99d-3932-4c66-9ad8-abfd70236a52">
Oct 20 10:33:28 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 10:33:28 user nova-compute[74311]:         </nova:port>
Oct 20 10:33:28 user nova-compute[74311]:       </nova:ports>
Oct 20 10:33:28 user nova-compute[74311]:     </nova:instance>
Oct 20 10:33:28 user nova-compute[74311]:   </metadata>
Oct 20 10:33:28 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:33:28 user nova-compute[74311]:     <system>
Oct 20 10:33:28 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:33:28 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:33:28 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:33:28 user nova-compute[74311]:       <entry name="serial">ddc14ed0-b767-49c6-b88f-fdc8a04261cc</entry>
Oct 20 10:33:28 user nova-compute[74311]:       <entry name="uuid">ddc14ed0-b767-49c6-b88f-fdc8a04261cc</entry>
Oct 20 10:33:28 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:33:28 user nova-compute[74311]:     </system>
Oct 20 10:33:28 user nova-compute[74311]:   </sysinfo>
Oct 20 10:33:28 user nova-compute[74311]:   <os>
Oct 20 10:33:28 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:33:28 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:33:28 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:33:28 user nova-compute[74311]:   </os>
Oct 20 10:33:28 user nova-compute[74311]:   <features>
Oct 20 10:33:28 user nova-compute[74311]:     <acpi/>
Oct 20 10:33:28 user nova-compute[74311]:     <apic/>
Oct 20 10:33:28 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:33:28 user nova-compute[74311]:   </features>
Oct 20 10:33:28 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:33:28 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:33:28 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:33:28 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:33:28 user nova-compute[74311]:   </clock>
Oct 20 10:33:28 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:33:28 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:33:28 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:33:28 user nova-compute[74311]:   </cpu>
Oct 20 10:33:28 user nova-compute[74311]:   <devices>
Oct 20 10:33:28 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:33:28 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:33:28 user nova-compute[74311]:       <source dev="/dev/sdb"/>
Oct 20 10:33:28 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:33:28 user nova-compute[74311]:       <serial>f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4</serial>
Oct 20 10:33:28 user nova-compute[74311]:     </disk>
Oct 20 10:33:28 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:33:28 user nova-compute[74311]:       <mac address="fa:16:3e:77:a0:8a"/>
Oct 20 10:33:28 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:33:28 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:33:28 user nova-compute[74311]:       <target dev="tape853f99d-39"/>
Oct 20 10:33:28 user nova-compute[74311]:     </interface>
Oct 20 10:33:28 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:33:28 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/ddc14ed0-b767-49c6-b88f-fdc8a04261cc/console.log" append="off"/>
Oct 20 10:33:28 user nova-compute[74311]:     </serial>
Oct 20 10:33:28 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:33:28 user nova-compute[74311]:     <video>
Oct 20 10:33:28 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:33:28 user nova-compute[74311]:     </video>
Oct 20 10:33:28 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:33:28 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:33:28 user nova-compute[74311]:     </rng>
Oct 20 10:33:28 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:33:28 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:33:28 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:33:28 user nova-compute[74311]:     </memballoon>
Oct 20 10:33:28 user nova-compute[74311]:   </devices>
Oct 20 10:33:28 user nova-compute[74311]: </domain>
Oct 20 10:33:28 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1811429318',display_name='tempest-TestVolumeBootPattern-server-1811429318',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1811429318',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-c6ayysfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:33:00Z,user_data=None,user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=ddc14ed0-b767-49c6-b88f-fdc8a04261cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e853f99d-3932-4c66-9ad8-abfd70236a52", "address": "fa:16:3e:77:a0:8a", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape853f99d-39", "ovs_interfaceid": "e853f99d-3932-4c66-9ad8-abfd70236a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "e853f99d-3932-4c66-9ad8-abfd70236a52", "address": "fa:16:3e:77:a0:8a", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape853f99d-39", "ovs_interfaceid": "e853f99d-3932-4c66-9ad8-abfd70236a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:a0:8a,bridge_name='br-int',has_traffic_filtering=True,id=e853f99d-3932-4c66-9ad8-abfd70236a52,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape853f99d-39') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG os_vif [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a0:8a,bridge_name='br-int',has_traffic_filtering=True,id=e853f99d-3932-4c66-9ad8-abfd70236a52,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape853f99d-39') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.compute.manager [req-45be409d-e177-4c91-b6e8-eb14c9b28b3a req-752c828e-21c1-4d9c-9acb-22dea475f17a service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Received event network-vif-plugged-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-45be409d-e177-4c91-b6e8-eb14c9b28b3a req-752c828e-21c1-4d9c-9acb-22dea475f17a service nova] Acquiring lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-45be409d-e177-4c91-b6e8-eb14c9b28b3a req-752c828e-21c1-4d9c-9acb-22dea475f17a service nova] Lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-45be409d-e177-4c91-b6e8-eb14c9b28b3a req-752c828e-21c1-4d9c-9acb-22dea475f17a service nova] Lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.compute.manager [req-45be409d-e177-4c91-b6e8-eb14c9b28b3a req-752c828e-21c1-4d9c-9acb-22dea475f17a service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] No waiting events found dispatching network-vif-plugged-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:33:28 user nova-compute[74311]: WARNING nova.compute.manager [req-45be409d-e177-4c91-b6e8-eb14c9b28b3a req-752c828e-21c1-4d9c-9acb-22dea475f17a service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Received unexpected event network-vif-plugged-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 for instance with vm_state building and task_state spawning.
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '058c8a2d-5442-5775-8c81-6a12c5666150', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape853f99d-39, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape853f99d-39, col_values=(('qos', UUID('6ab960f2-7064-4899-976a-ade643a09745')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape853f99d-39, col_values=(('external_ids', {'iface-id': 'e853f99d-3932-4c66-9ad8-abfd70236a52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:a0:8a', 'vm-uuid': 'ddc14ed0-b767-49c6-b88f-fdc8a04261cc'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:28 user nova-compute[74311]: INFO os_vif [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a0:8a,bridge_name='br-int',has_traffic_filtering=True,id=e853f99d-3932-4c66-9ad8-abfd70236a52,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape853f99d-39')
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] No VIF found with MAC fa:16:3e:77:a0:8a, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:33:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:30 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:33:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 10:33:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] There are 0 instances to clean {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 10:33:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-258a14d5-fdd7-480c-ad78-7978a3a93ee1 req-e0de6c5e-f111-4ebf-bd81-36423a8358a3 service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Received event network-vif-plugged-e853f99d-3932-4c66-9ad8-abfd70236a52 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:33:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-258a14d5-fdd7-480c-ad78-7978a3a93ee1 req-e0de6c5e-f111-4ebf-bd81-36423a8358a3 service nova] Acquiring lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-258a14d5-fdd7-480c-ad78-7978a3a93ee1 req-e0de6c5e-f111-4ebf-bd81-36423a8358a3 service nova] Lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-258a14d5-fdd7-480c-ad78-7978a3a93ee1 req-e0de6c5e-f111-4ebf-bd81-36423a8358a3 service nova] Lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-258a14d5-fdd7-480c-ad78-7978a3a93ee1 req-e0de6c5e-f111-4ebf-bd81-36423a8358a3 service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] No waiting events found dispatching network-vif-plugged-e853f99d-3932-4c66-9ad8-abfd70236a52 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:33:30 user nova-compute[74311]: WARNING nova.compute.manager [req-258a14d5-fdd7-480c-ad78-7978a3a93ee1 req-e0de6c5e-f111-4ebf-bd81-36423a8358a3 service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Received unexpected event network-vif-plugged-e853f99d-3932-4c66-9ad8-abfd70236a52 for instance with vm_state building and task_state spawning.
Oct 20 10:33:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-d2c3f397-5baf-4123-b64b-8e30a1da0062 req-baee49bf-6f98-49f2-a1fa-9043f2a9f13f service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Received event network-vif-plugged-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:33:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d2c3f397-5baf-4123-b64b-8e30a1da0062 req-baee49bf-6f98-49f2-a1fa-9043f2a9f13f service nova] Acquiring lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d2c3f397-5baf-4123-b64b-8e30a1da0062 req-baee49bf-6f98-49f2-a1fa-9043f2a9f13f service nova] Lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d2c3f397-5baf-4123-b64b-8e30a1da0062 req-baee49bf-6f98-49f2-a1fa-9043f2a9f13f service nova] Lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:30 user nova-compute[74311]: DEBUG nova.compute.manager [req-d2c3f397-5baf-4123-b64b-8e30a1da0062 req-baee49bf-6f98-49f2-a1fa-9043f2a9f13f service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] No waiting events found dispatching network-vif-plugged-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:33:30 user nova-compute[74311]: WARNING nova.compute.manager [req-d2c3f397-5baf-4123-b64b-8e30a1da0062 req-baee49bf-6f98-49f2-a1fa-9043f2a9f13f service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Received unexpected event network-vif-plugged-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 for instance with vm_state building and task_state spawning.
Oct 20 10:33:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:30 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Snapshot image upload complete
Oct 20 10:33:30 user nova-compute[74311]: INFO nova.compute.manager [None req-84041174-b080-45e7-8506-2304c1033d99 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Took 8.94 seconds to snapshot the instance on the hypervisor.
Oct 20 10:33:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:33:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:33:31 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Instance spawned successfully.
Oct 20 10:33:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:33:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:33:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:33:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:33:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:33:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:33:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:33:31 user nova-compute[74311]: INFO nova.compute.manager [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Took 10.69 seconds to spawn the instance on the hypervisor.
Oct 20 10:33:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:33:31 user nova-compute[74311]: INFO nova.compute.manager [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Took 12.23 seconds to build instance.
Oct 20 10:33:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70eca3e5-2024-4312-b3c4-2499db94a058 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "58bba07b-6122-47f7-9cea-44cebe840ced" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.480s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-062722b2-ec4c-4ad2-90a8-aa8c4868302c req-c4d73d47-c822-4c61-9353-f4524940fcdc service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Received event network-vif-plugged-e853f99d-3932-4c66-9ad8-abfd70236a52 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:33:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-062722b2-ec4c-4ad2-90a8-aa8c4868302c req-c4d73d47-c822-4c61-9353-f4524940fcdc service nova] Acquiring lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-062722b2-ec4c-4ad2-90a8-aa8c4868302c req-c4d73d47-c822-4c61-9353-f4524940fcdc service nova] Lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-062722b2-ec4c-4ad2-90a8-aa8c4868302c req-c4d73d47-c822-4c61-9353-f4524940fcdc service nova] Lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-062722b2-ec4c-4ad2-90a8-aa8c4868302c req-c4d73d47-c822-4c61-9353-f4524940fcdc service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] No waiting events found dispatching network-vif-plugged-e853f99d-3932-4c66-9ad8-abfd70236a52 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:33:32 user nova-compute[74311]: WARNING nova.compute.manager [req-062722b2-ec4c-4ad2-90a8-aa8c4868302c req-c4d73d47-c822-4c61-9353-f4524940fcdc service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Received unexpected event network-vif-plugged-e853f99d-3932-4c66-9ad8-abfd70236a52 for instance with vm_state building and task_state spawning.
Oct 20 10:33:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:33:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:33:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Instance spawned successfully.
Oct 20 10:33:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:33:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:33:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:33:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:33:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:33:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:33:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:33:32 user nova-compute[74311]: INFO nova.compute.manager [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Took 6.18 seconds to spawn the instance on the hypervisor.
Oct 20 10:33:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:33:32 user nova-compute[74311]: INFO nova.compute.manager [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Took 33.03 seconds to build instance.
Oct 20 10:33:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a9af14d5-2c11-4503-96b4-2c9623dc674c tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.147s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "30945ee9-c420-440b-b98d-8dc4922fd216" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "30945ee9-c420-440b-b98d-8dc4922fd216" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:33 user nova-compute[74311]: DEBUG nova.compute.manager [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:33:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:33 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:33:33 user nova-compute[74311]: INFO nova.compute.claims [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Claim successful on node user
Oct 20 10:33:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:33 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:33:33 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:33:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:34 user nova-compute[74311]: DEBUG nova.compute.manager [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:33:34 user nova-compute[74311]: DEBUG nova.compute.manager [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:33:34 user nova-compute[74311]: DEBUG nova.network.neutron [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:33:34 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:33:34 user nova-compute[74311]: DEBUG nova.compute.manager [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:33:34 user nova-compute[74311]: DEBUG nova.policy [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e90400e50b143a09e2936ed67ea5c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8eccbc22a0844e5864eb2e4d4c8f3f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:33:34 user nova-compute[74311]: DEBUG nova.compute.manager [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:33:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:33:34 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Creating image(s)
Oct 20 10:33:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "/opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "/opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "/opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "7b0a35bcc40d426ebbd72433b8afc05bab52e3ca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "7b0a35bcc40d426ebbd72433b8afc05bab52e3ca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca.part --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:36 user nova-compute[74311]: DEBUG nova.network.neutron [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Successfully created port: 368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:33:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca.part --force-share --output=json" returned: 0 in 0.200s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:36 user nova-compute[74311]: DEBUG nova.virt.images [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] 1bba3ee3-c88b-4c91-bb86-b43edb98c5e7 was qcow2, converting to raw {{(pid=74311) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 10:33:36 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:33:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca.part /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca.converted {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca.part /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca.converted" returned: 0 in 0.599s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca.converted --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG nova.network.neutron [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Successfully updated port: 368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "refresh_cache-30945ee9-c420-440b-b98d-8dc4922fd216" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquired lock "refresh_cache-30945ee9-c420-440b-b98d-8dc4922fd216" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG nova.network.neutron [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-1ce3a8d4-2d88-4550-9893-a53268e0250e req-28d7ad58-3bc4-4074-a04a-7291cc9b0434 service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Received event network-changed-368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-1ce3a8d4-2d88-4550-9893-a53268e0250e req-28d7ad58-3bc4-4074-a04a-7291cc9b0434 service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Refreshing instance network info cache due to event network-changed-368cb7d7-e072-416a-bf32-339c43e90aa2. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1ce3a8d4-2d88-4550-9893-a53268e0250e req-28d7ad58-3bc4-4074-a04a-7291cc9b0434 service nova] Acquiring lock "refresh_cache-30945ee9-c420-440b-b98d-8dc4922fd216" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca.converted --force-share --output=json" returned: 0 in 0.221s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "7b0a35bcc40d426ebbd72433b8afc05bab52e3ca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.921s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG nova.network.neutron [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca --force-share --output=json" returned: 0 in 0.235s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "7b0a35bcc40d426ebbd72433b8afc05bab52e3ca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "7b0a35bcc40d426ebbd72433b8afc05bab52e3ca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG nova.network.neutron [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Updating instance_info_cache with network_info: [{"id": "368cb7d7-e072-416a-bf32-339c43e90aa2", "address": "fa:16:3e:2c:ab:73", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368cb7d7-e0", "ovs_interfaceid": "368cb7d7-e072-416a-bf32-339c43e90aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Releasing lock "refresh_cache-30945ee9-c420-440b-b98d-8dc4922fd216" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG nova.compute.manager [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Instance network_info: |[{"id": "368cb7d7-e072-416a-bf32-339c43e90aa2", "address": "fa:16:3e:2c:ab:73", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368cb7d7-e0", "ovs_interfaceid": "368cb7d7-e072-416a-bf32-339c43e90aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1ce3a8d4-2d88-4550-9893-a53268e0250e req-28d7ad58-3bc4-4074-a04a-7291cc9b0434 service nova] Acquired lock "refresh_cache-30945ee9-c420-440b-b98d-8dc4922fd216" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG nova.network.neutron [req-1ce3a8d4-2d88-4550-9893-a53268e0250e req-28d7ad58-3bc4-4074-a04a-7291cc9b0434 service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Refreshing network info cache for port 368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca --force-share --output=json" returned: 0 in 0.249s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca,backing_fmt=raw /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca,backing_fmt=raw /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk 1073741824" returned: 0 in 0.061s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "7b0a35bcc40d426ebbd72433b8afc05bab52e3ca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.315s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74311) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca --force-share --output=json" returned: 0 in 0.242s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Ensure instance console log exists: /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Start _get_guest_xml network_info=[{"id": "368cb7d7-e072-416a-bf32-339c43e90aa2", "address": "fa:16:3e:2c:ab:73", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368cb7d7-e0", "ovs_interfaceid": "368cb7d7-e072-416a-bf32-339c43e90aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7688d955fb7d5d8574456b361a22131d',container_format='bare',created_at=2023-10-20T10:33:21Z,direct_url=<?>,disk_format='qcow2',id=1bba3ee3-c88b-4c91-bb86-b43edb98c5e7,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-280870027',owner='f8eccbc22a0844e5864eb2e4d4c8f3f9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T10:33:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '1bba3ee3-c88b-4c91-bb86-b43edb98c5e7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:33:38 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:33:38 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7688d955fb7d5d8574456b361a22131d',container_format='bare',created_at=2023-10-20T10:33:21Z,direct_url=<?>,disk_format='qcow2',id=1bba3ee3-c88b-4c91-bb86-b43edb98c5e7,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-280870027',owner='f8eccbc22a0844e5864eb2e4d4c8f3f9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T10:33:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:33:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-148394141',display_name='tempest-TestStampPattern-server-148394141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-148394141',id=41,image_ref='1bba3ee3-c88b-4c91-bb86-b43edb98c5e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxIz+AOQh5BFtvQDWoLXblBp+TB3fi3MeSA/3rUAks7ejyqHfrxlBfgqB6oyecw1P0xdLVr8KQzmCjxwt7BESaDUHM3Wwh/O99KdQsg36VfSYG5rbhAc/v9D0kkQRONKQ==',key_name='tempest-TestStampPattern-1298176157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8eccbc22a0844e5864eb2e4d4c8f3f9',ramdisk_id='',reservation_id='r-vcm0hvze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='593a4f46-9b5b-4a3c-95c7-21712b081069',image_min_disk='1',image_min_ram='0',image_owner_id='f8eccbc22a0844e5864eb2e4d4c8f3f9',image_owner_project_name='tempest-TestStampPattern-1787276252',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1787276252-project-member',image_user_id='3e90400e50b143a09e2936ed67ea5c77',network_allocated='True',owner_project_name='tempest-TestStampPattern-1787276252',owner_user_name='tempest-TestStampPattern-1787276252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:33:34Z,user_data=None,user_id='3e90400e50b143a09e2936ed67ea5c77',uuid=30945ee9-c420-440b-b98d-8dc4922fd216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "368cb7d7-e072-416a-bf32-339c43e90aa2", "address": "fa:16:3e:2c:ab:73", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368cb7d7-e0", "ovs_interfaceid": "368cb7d7-e072-416a-bf32-339c43e90aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Converting VIF {"id": "368cb7d7-e072-416a-bf32-339c43e90aa2", "address": "fa:16:3e:2c:ab:73", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368cb7d7-e0", "ovs_interfaceid": "368cb7d7-e072-416a-bf32-339c43e90aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=368cb7d7-e072-416a-bf32-339c43e90aa2,network=Network(e3e17086-dc82-40b0-8b51-655f5083b429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368cb7d7-e0') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.objects.instance [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lazy-loading 'pci_devices' on Instance uuid 30945ee9-c420-440b-b98d-8dc4922fd216 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:33:38 user nova-compute[74311]:   <uuid>30945ee9-c420-440b-b98d-8dc4922fd216</uuid>
Oct 20 10:33:38 user nova-compute[74311]:   <name>instance-00000029</name>
Oct 20 10:33:38 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:33:38 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:33:38 user nova-compute[74311]:   <metadata>
Oct 20 10:33:38 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:33:38 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:33:38 user nova-compute[74311]:       <nova:name>tempest-TestStampPattern-server-148394141</nova:name>
Oct 20 10:33:38 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:33:38</nova:creationTime>
Oct 20 10:33:38 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:33:38 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:33:38 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:33:38 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:33:38 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:33:38 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:33:38 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:33:38 user nova-compute[74311]:       <nova:owner>
Oct 20 10:33:38 user nova-compute[74311]:         <nova:user uuid="3e90400e50b143a09e2936ed67ea5c77">tempest-TestStampPattern-1787276252-project-member</nova:user>
Oct 20 10:33:38 user nova-compute[74311]:         <nova:project uuid="f8eccbc22a0844e5864eb2e4d4c8f3f9">tempest-TestStampPattern-1787276252</nova:project>
Oct 20 10:33:38 user nova-compute[74311]:       </nova:owner>
Oct 20 10:33:38 user nova-compute[74311]:       <nova:root type="image" uuid="1bba3ee3-c88b-4c91-bb86-b43edb98c5e7"/>
Oct 20 10:33:38 user nova-compute[74311]:       <nova:ports>
Oct 20 10:33:38 user nova-compute[74311]:         <nova:port uuid="368cb7d7-e072-416a-bf32-339c43e90aa2">
Oct 20 10:33:38 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 10:33:38 user nova-compute[74311]:         </nova:port>
Oct 20 10:33:38 user nova-compute[74311]:       </nova:ports>
Oct 20 10:33:38 user nova-compute[74311]:     </nova:instance>
Oct 20 10:33:38 user nova-compute[74311]:   </metadata>
Oct 20 10:33:38 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:33:38 user nova-compute[74311]:     <system>
Oct 20 10:33:38 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:33:38 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:33:38 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:33:38 user nova-compute[74311]:       <entry name="serial">30945ee9-c420-440b-b98d-8dc4922fd216</entry>
Oct 20 10:33:38 user nova-compute[74311]:       <entry name="uuid">30945ee9-c420-440b-b98d-8dc4922fd216</entry>
Oct 20 10:33:38 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:33:38 user nova-compute[74311]:     </system>
Oct 20 10:33:38 user nova-compute[74311]:   </sysinfo>
Oct 20 10:33:38 user nova-compute[74311]:   <os>
Oct 20 10:33:38 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:33:38 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:33:38 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:33:38 user nova-compute[74311]:   </os>
Oct 20 10:33:38 user nova-compute[74311]:   <features>
Oct 20 10:33:38 user nova-compute[74311]:     <acpi/>
Oct 20 10:33:38 user nova-compute[74311]:     <apic/>
Oct 20 10:33:38 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:33:38 user nova-compute[74311]:   </features>
Oct 20 10:33:38 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:33:38 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:33:38 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:33:38 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:33:38 user nova-compute[74311]:   </clock>
Oct 20 10:33:38 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:33:38 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:33:38 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:33:38 user nova-compute[74311]:   </cpu>
Oct 20 10:33:38 user nova-compute[74311]:   <devices>
Oct 20 10:33:38 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:33:38 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:33:38 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk"/>
Oct 20 10:33:38 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:33:38 user nova-compute[74311]:     </disk>
Oct 20 10:33:38 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:33:38 user nova-compute[74311]:       <mac address="fa:16:3e:2c:ab:73"/>
Oct 20 10:33:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:33:38 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:33:38 user nova-compute[74311]:       <target dev="tap368cb7d7-e0"/>
Oct 20 10:33:38 user nova-compute[74311]:     </interface>
Oct 20 10:33:38 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:33:38 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/console.log" append="off"/>
Oct 20 10:33:38 user nova-compute[74311]:     </serial>
Oct 20 10:33:38 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:33:38 user nova-compute[74311]:     <video>
Oct 20 10:33:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:33:38 user nova-compute[74311]:     </video>
Oct 20 10:33:38 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:33:38 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:33:38 user nova-compute[74311]:     </rng>
Oct 20 10:33:38 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:33:38 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:33:38 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:33:38 user nova-compute[74311]:     </memballoon>
Oct 20 10:33:38 user nova-compute[74311]:   </devices>
Oct 20 10:33:38 user nova-compute[74311]: </domain>
Oct 20 10:33:38 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:33:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-148394141',display_name='tempest-TestStampPattern-server-148394141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-148394141',id=41,image_ref='1bba3ee3-c88b-4c91-bb86-b43edb98c5e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxIz+AOQh5BFtvQDWoLXblBp+TB3fi3MeSA/3rUAks7ejyqHfrxlBfgqB6oyecw1P0xdLVr8KQzmCjxwt7BESaDUHM3Wwh/O99KdQsg36VfSYG5rbhAc/v9D0kkQRONKQ==',key_name='tempest-TestStampPattern-1298176157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8eccbc22a0844e5864eb2e4d4c8f3f9',ramdisk_id='',reservation_id='r-vcm0hvze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='593a4f46-9b5b-4a3c-95c7-21712b081069',image_min_disk='1',image_min_ram='0',image_owner_id='f8eccbc22a0844e5864eb2e4d4c8f3f9',image_owner_project_name='tempest-TestStampPattern-1787276252',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1787276252-project-member',image_user_id='3e90400e50b143a09e2936ed67ea5c77',network_allocated='True',owner_project_name='tempest-TestStampPattern-1787276252',owner_user_name='tempest-TestStampPattern-1787276252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:33:34Z,user_data=None,user_id='3e90400e50b143a09e2936ed67ea5c77',uuid=30945ee9-c420-440b-b98d-8dc4922fd216,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "368cb7d7-e072-416a-bf32-339c43e90aa2", "address": "fa:16:3e:2c:ab:73", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368cb7d7-e0", "ovs_interfaceid": "368cb7d7-e072-416a-bf32-339c43e90aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Converting VIF {"id": "368cb7d7-e072-416a-bf32-339c43e90aa2", "address": "fa:16:3e:2c:ab:73", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368cb7d7-e0", "ovs_interfaceid": "368cb7d7-e072-416a-bf32-339c43e90aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=368cb7d7-e072-416a-bf32-339c43e90aa2,network=Network(e3e17086-dc82-40b0-8b51-655f5083b429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368cb7d7-e0') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG os_vif [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=368cb7d7-e072-416a-bf32-339c43e90aa2,network=Network(e3e17086-dc82-40b0-8b51-655f5083b429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368cb7d7-e0') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd264cef4-4a3f-5d05-8c7f-9bcf98ae3153', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap368cb7d7-e0, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap368cb7d7-e0, col_values=(('qos', UUID('a4b41460-3bb0-4628-8c4d-c09feab74809')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap368cb7d7-e0, col_values=(('external_ids', {'iface-id': '368cb7d7-e072-416a-bf32-339c43e90aa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:ab:73', 'vm-uuid': '30945ee9-c420-440b-b98d-8dc4922fd216'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:38 user nova-compute[74311]: INFO os_vif [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=368cb7d7-e072-416a-bf32-339c43e90aa2,network=Network(e3e17086-dc82-40b0-8b51-655f5083b429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368cb7d7-e0')
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] No VIF found with MAC fa:16:3e:2c:ab:73, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.network.neutron [req-1ce3a8d4-2d88-4550-9893-a53268e0250e req-28d7ad58-3bc4-4074-a04a-7291cc9b0434 service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Updated VIF entry in instance network info cache for port 368cb7d7-e072-416a-bf32-339c43e90aa2. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG nova.network.neutron [req-1ce3a8d4-2d88-4550-9893-a53268e0250e req-28d7ad58-3bc4-4074-a04a-7291cc9b0434 service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Updating instance_info_cache with network_info: [{"id": "368cb7d7-e072-416a-bf32-339c43e90aa2", "address": "fa:16:3e:2c:ab:73", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368cb7d7-e0", "ovs_interfaceid": "368cb7d7-e072-416a-bf32-339c43e90aa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:33:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1ce3a8d4-2d88-4550-9893-a53268e0250e req-28d7ad58-3bc4-4074-a04a-7291cc9b0434 service nova] Releasing lock "refresh_cache-30945ee9-c420-440b-b98d-8dc4922fd216" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:33:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-f9c2c229-8703-4ebb-8596-cd3044b8f2c7 req-0fb56d2b-0adc-4a85-a356-5fa53e60956f service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Received event network-vif-plugged-368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:33:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f9c2c229-8703-4ebb-8596-cd3044b8f2c7 req-0fb56d2b-0adc-4a85-a356-5fa53e60956f service nova] Acquiring lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f9c2c229-8703-4ebb-8596-cd3044b8f2c7 req-0fb56d2b-0adc-4a85-a356-5fa53e60956f service nova] Lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f9c2c229-8703-4ebb-8596-cd3044b8f2c7 req-0fb56d2b-0adc-4a85-a356-5fa53e60956f service nova] Lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-f9c2c229-8703-4ebb-8596-cd3044b8f2c7 req-0fb56d2b-0adc-4a85-a356-5fa53e60956f service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] No waiting events found dispatching network-vif-plugged-368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:33:40 user nova-compute[74311]: WARNING nova.compute.manager [req-f9c2c229-8703-4ebb-8596-cd3044b8f2c7 req-0fb56d2b-0adc-4a85-a356-5fa53e60956f service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Received unexpected event network-vif-plugged-368cb7d7-e072-416a-bf32-339c43e90aa2 for instance with vm_state building and task_state spawning.
Oct 20 10:33:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-a9e8d6eb-41df-407c-83cf-b50a3500c22b req-187a7205-77ba-4277-85d6-7e4f8a01691c service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Received event network-vif-plugged-368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:33:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a9e8d6eb-41df-407c-83cf-b50a3500c22b req-187a7205-77ba-4277-85d6-7e4f8a01691c service nova] Acquiring lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:33:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a9e8d6eb-41df-407c-83cf-b50a3500c22b req-187a7205-77ba-4277-85d6-7e4f8a01691c service nova] Lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:33:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a9e8d6eb-41df-407c-83cf-b50a3500c22b req-187a7205-77ba-4277-85d6-7e4f8a01691c service nova] Lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-a9e8d6eb-41df-407c-83cf-b50a3500c22b req-187a7205-77ba-4277-85d6-7e4f8a01691c service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] No waiting events found dispatching network-vif-plugged-368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:33:42 user nova-compute[74311]: WARNING nova.compute.manager [req-a9e8d6eb-41df-407c-83cf-b50a3500c22b req-187a7205-77ba-4277-85d6-7e4f8a01691c service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Received unexpected event network-vif-plugged-368cb7d7-e072-416a-bf32-339c43e90aa2 for instance with vm_state building and task_state spawning.
Oct 20 10:33:42 user nova-compute[74311]: DEBUG nova.compute.manager [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:33:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:33:42 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Instance spawned successfully.
Oct 20 10:33:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:33:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:33:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:33:42 user nova-compute[74311]: INFO nova.compute.manager [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Took 8.31 seconds to spawn the instance on the hypervisor.
Oct 20 10:33:42 user nova-compute[74311]: DEBUG nova.compute.manager [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:33:42 user nova-compute[74311]: INFO nova.compute.manager [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Took 9.40 seconds to build instance.
Oct 20 10:33:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51c79838-20e8-40ff-b795-2a4981889331 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "30945ee9-c420-440b-b98d-8dc4922fd216" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.593s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:33:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-1dfe4093-ae26-480c-80dc-6957999991d9 req-8b7b428b-c21f-4b14-b90e-3447bc672eec service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received event network-changed-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:33:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-1dfe4093-ae26-480c-80dc-6957999991d9 req-8b7b428b-c21f-4b14-b90e-3447bc672eec service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Refreshing instance network info cache due to event network-changed-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:33:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1dfe4093-ae26-480c-80dc-6957999991d9 req-8b7b428b-c21f-4b14-b90e-3447bc672eec service nova] Acquiring lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:33:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1dfe4093-ae26-480c-80dc-6957999991d9 req-8b7b428b-c21f-4b14-b90e-3447bc672eec service nova] Acquired lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:33:58 user nova-compute[74311]: DEBUG nova.network.neutron [req-1dfe4093-ae26-480c-80dc-6957999991d9 req-8b7b428b-c21f-4b14-b90e-3447bc672eec service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Refreshing network info cache for port b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:33:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:33:58 user nova-compute[74311]: DEBUG nova.network.neutron [req-1dfe4093-ae26-480c-80dc-6957999991d9 req-8b7b428b-c21f-4b14-b90e-3447bc672eec service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Updated VIF entry in instance network info cache for port b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:33:58 user nova-compute[74311]: DEBUG nova.network.neutron [req-1dfe4093-ae26-480c-80dc-6957999991d9 req-8b7b428b-c21f-4b14-b90e-3447bc672eec service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Updating instance_info_cache with network_info: [{"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:33:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-1dfe4093-ae26-480c-80dc-6957999991d9 req-8b7b428b-c21f-4b14-b90e-3447bc672eec service nova] Releasing lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:34:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "367d718d-35ed-4c04-97f1-518bd0e100e1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:05 user nova-compute[74311]: INFO nova.compute.manager [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Shelving
Oct 20 10:34:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:06 user nova-compute[74311]: DEBUG nova.compute.manager [req-7aba7390-02b8-46d0-85ce-29efa3b9a468 req-daa1df78-78cd-4524-b8e8-71905fbd9c67 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received event network-vif-unplugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:34:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7aba7390-02b8-46d0-85ce-29efa3b9a468 req-daa1df78-78cd-4524-b8e8-71905fbd9c67 service nova] Acquiring lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7aba7390-02b8-46d0-85ce-29efa3b9a468 req-daa1df78-78cd-4524-b8e8-71905fbd9c67 service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7aba7390-02b8-46d0-85ce-29efa3b9a468 req-daa1df78-78cd-4524-b8e8-71905fbd9c67 service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:06 user nova-compute[74311]: DEBUG nova.compute.manager [req-7aba7390-02b8-46d0-85ce-29efa3b9a468 req-daa1df78-78cd-4524-b8e8-71905fbd9c67 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] No waiting events found dispatching network-vif-unplugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:34:06 user nova-compute[74311]: WARNING nova.compute.manager [req-7aba7390-02b8-46d0-85ce-29efa3b9a468 req-daa1df78-78cd-4524-b8e8-71905fbd9c67 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received unexpected event network-vif-unplugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 for instance with vm_state active and task_state shelving.
Oct 20 10:34:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:06 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Instance destroyed successfully.
Oct 20 10:34:06 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Beginning cold snapshot process
Oct 20 10:34:07 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:34:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk /opt/stack/data/nova/instances/snapshots/tmpw7n3owaw/1b547adcb6d340849f396f0a82ff3669 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:08 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:34:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:34:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Didn't find any instances for network info cache update. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 10:34:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk /opt/stack/data/nova/instances/snapshots/tmpw7n3owaw/1b547adcb6d340849f396f0a82ff3669" returned: 0 in 0.967s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:08 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Snapshot extracted, beginning image upload
Oct 20 10:34:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-40f8e1ba-a6b6-40f2-aea6-118552a34f07 req-e0221902-db88-40b1-8c50-f85449fa1852 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received event network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:34:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40f8e1ba-a6b6-40f2-aea6-118552a34f07 req-e0221902-db88-40b1-8c50-f85449fa1852 service nova] Acquiring lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40f8e1ba-a6b6-40f2-aea6-118552a34f07 req-e0221902-db88-40b1-8c50-f85449fa1852 service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-40f8e1ba-a6b6-40f2-aea6-118552a34f07 req-e0221902-db88-40b1-8c50-f85449fa1852 service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-40f8e1ba-a6b6-40f2-aea6-118552a34f07 req-e0221902-db88-40b1-8c50-f85449fa1852 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] No waiting events found dispatching network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:34:08 user nova-compute[74311]: WARNING nova.compute.manager [req-40f8e1ba-a6b6-40f2-aea6-118552a34f07 req-e0221902-db88-40b1-8c50-f85449fa1852 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received unexpected event network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 10:34:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:10 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Snapshot image upload complete
Oct 20 10:34:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:34:10 user nova-compute[74311]: INFO nova.compute.manager [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Shelve offloading
Oct 20 10:34:10 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Instance destroyed successfully.
Oct 20 10:34:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:34:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:34:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquired lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:34:10 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:34:11 user nova-compute[74311]: DEBUG nova.network.neutron [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Updating instance_info_cache with network_info: [{"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:34:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Releasing lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:34:12 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Instance destroyed successfully.
Oct 20 10:34:12 user nova-compute[74311]: DEBUG nova.objects.instance [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lazy-loading 'resources' on Instance uuid 367d718d-35ed-4c04-97f1-518bd0e100e1 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1498909758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1498909758',id=38,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFAyNyoWbqBGNHspCEvJSsMifFaHIZT0jvn4njT9y2I+nD2XcODIHjztrXyWlfAc6OSESgmSstTATclIJ28rApf+mhllBPFUkRHyqMXHz5Qx0b0y8PhQHxZwmk17YvZog==',key_name='tempest-keypair-1460218868',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:32:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='61fab5f8b38b490985cc614ade80f25a',ramdisk_id='',reservation_id='r-fzi5czat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1592971712',owner_user_name='tempest-AttachVolumeShelveTestJSON-1592971712-project-member',shelved_at='2023-10-20T10:34:10.860487',shelved_host='user',shelved_image_id='24ef6c88-7bce-4deb-9235-21160658bea3'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:34:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1aad9aa1e64a9db4f78c0c12779300',uuid=367d718d-35ed-4c04-97f1-518bd0e100e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converting VIF {"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:50,bridge_name='br-int',has_traffic_filtering=True,id=b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cf7ba1-9f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG os_vif [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:50,bridge_name='br-int',has_traffic_filtering=True,id=b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cf7ba1-9f') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7cf7ba1-9f, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-aa36632b-65a0-41c5-b7ab-f3cd180727ce req-f6347c64-8e22-4d35-ba92-233b2c089940 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received event network-changed-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-aa36632b-65a0-41c5-b7ab-f3cd180727ce req-f6347c64-8e22-4d35-ba92-233b2c089940 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Refreshing instance network info cache due to event network-changed-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-aa36632b-65a0-41c5-b7ab-f3cd180727ce req-f6347c64-8e22-4d35-ba92-233b2c089940 service nova] Acquiring lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-aa36632b-65a0-41c5-b7ab-f3cd180727ce req-f6347c64-8e22-4d35-ba92-233b2c089940 service nova] Acquired lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG nova.network.neutron [req-aa36632b-65a0-41c5-b7ab-f3cd180727ce req-f6347c64-8e22-4d35-ba92-233b2c089940 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Refreshing network info cache for port b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b04b9c19-6ff8-4ad8-8ad7-078d167fad45) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:34:12 user nova-compute[74311]: INFO os_vif [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:50,bridge_name='br-int',has_traffic_filtering=True,id=b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cf7ba1-9f')
Oct 20 10:34:12 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Deleting instance files /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1_del
Oct 20 10:34:12 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Deletion of /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1_del complete
Oct 20 10:34:12 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Deleted allocations for instance 367d718d-35ed-4c04-97f1-518bd0e100e1
Oct 20 10:34:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG nova.objects.instance [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lazy-loading 'numa_topology' on Instance uuid 367d718d-35ed-4c04-97f1-518bd0e100e1 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:34:12 user nova-compute[74311]: DEBUG nova.objects.base [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Object Instance<367d718d-35ed-4c04-97f1-518bd0e100e1> lazy-loaded attributes: resources,numa_topology {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:34:13 user nova-compute[74311]: DEBUG nova.network.neutron [req-aa36632b-65a0-41c5-b7ab-f3cd180727ce req-f6347c64-8e22-4d35-ba92-233b2c089940 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Updated VIF entry in instance network info cache for port b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:34:13 user nova-compute[74311]: DEBUG nova.network.neutron [req-aa36632b-65a0-41c5-b7ab-f3cd180727ce req-f6347c64-8e22-4d35-ba92-233b2c089940 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Updating instance_info_cache with network_info: [{"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:34:13 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:34:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-aa36632b-65a0-41c5-b7ab-f3cd180727ce req-f6347c64-8e22-4d35-ba92-233b2c089940 service nova] Releasing lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:34:13 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:34:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b53c4d1a-a30a-45f5-8dbb-a3dc0f7e9a23 tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.370s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:16 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:34:16 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:34:17 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:34:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:20 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:34:21 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:34:21 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:34:21 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:34:21 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:34:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:34:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.306s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:23 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:34:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:24 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:34:24 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:34:24 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=7927MB free_disk=25.092227935791016GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:34:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:24 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:34:24 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 60618091-1d8e-477c-8ea8-63973626a7e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:34:24 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 593a4f46-9b5b-4a3c-95c7-21712b081069 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:34:24 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance ddc14ed0-b767-49c6-b88f-fdc8a04261cc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:34:24 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 58bba07b-6122-47f7-9cea-44cebe840ced actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:34:24 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 30945ee9-c420-440b-b98d-8dc4922fd216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:34:24 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:34:24 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:34:25 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:34:25 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:34:25 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:34:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:26 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:34:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:34:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:34:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:34:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:34:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:34:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:34:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:34:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "60618091-1d8e-477c-8ea8-63973626a7e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "60618091-1d8e-477c-8ea8-63973626a7e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:34 user nova-compute[74311]: INFO nova.compute.manager [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Terminating instance
Oct 20 10:34:34 user nova-compute[74311]: DEBUG nova.compute.manager [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-0926d2c6-f049-460c-ae6f-eecf07fdc5ae req-ae5ee084-c813-43ec-8cda-1f0e6a6a53f3 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received event network-vif-unplugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0926d2c6-f049-460c-ae6f-eecf07fdc5ae req-ae5ee084-c813-43ec-8cda-1f0e6a6a53f3 service nova] Acquiring lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0926d2c6-f049-460c-ae6f-eecf07fdc5ae req-ae5ee084-c813-43ec-8cda-1f0e6a6a53f3 service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0926d2c6-f049-460c-ae6f-eecf07fdc5ae req-ae5ee084-c813-43ec-8cda-1f0e6a6a53f3 service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-0926d2c6-f049-460c-ae6f-eecf07fdc5ae req-ae5ee084-c813-43ec-8cda-1f0e6a6a53f3 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] No waiting events found dispatching network-vif-unplugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-0926d2c6-f049-460c-ae6f-eecf07fdc5ae req-ae5ee084-c813-43ec-8cda-1f0e6a6a53f3 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received event network-vif-unplugged-395a6652-12b5-404b-81e4-2beb52c164ca for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:34 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Instance destroyed successfully.
Oct 20 10:34:34 user nova-compute[74311]: DEBUG nova.objects.instance [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'resources' on Instance uuid 60618091-1d8e-477c-8ea8-63973626a7e2 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-920633096',display_name='tempest-ServerRescueNegativeTestJSON-server-920633096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-920633096',id=20,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:19:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07b7c2a684a3466eba4799473c725066',ramdisk_id='',reservation_id='r-2icjmpaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-320006607',owner_user_name='tempest-ServerRescueNegativeTestJSON-320006607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:19:35Z,user_data=None,user_id='302a265253b14a19be48546953baaebf',uuid=60618091-1d8e-477c-8ea8-63973626a7e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converting VIF {"id": "395a6652-12b5-404b-81e4-2beb52c164ca", "address": "fa:16:3e:3f:dc:8a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap395a6652-12", "ovs_interfaceid": "395a6652-12b5-404b-81e4-2beb52c164ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:dc:8a,bridge_name='br-int',has_traffic_filtering=True,id=395a6652-12b5-404b-81e4-2beb52c164ca,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395a6652-12') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG os_vif [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:dc:8a,bridge_name='br-int',has_traffic_filtering=True,id=395a6652-12b5-404b-81e4-2beb52c164ca,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395a6652-12') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap395a6652-12, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9e7a49e-ca50-4f56-9bed-2ca1e09164fb) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:34:34 user nova-compute[74311]: INFO os_vif [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:dc:8a,bridge_name='br-int',has_traffic_filtering=True,id=395a6652-12b5-404b-81e4-2beb52c164ca,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap395a6652-12')
Oct 20 10:34:34 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Deleting instance files /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2_del
Oct 20 10:34:34 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Deletion of /opt/stack/data/nova/instances/60618091-1d8e-477c-8ea8-63973626a7e2_del complete
Oct 20 10:34:34 user nova-compute[74311]: INFO nova.compute.manager [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Took 0.75 seconds to destroy the instance on the hypervisor.
Oct 20 10:34:34 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:34:34 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:34:35 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:34:35 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Took 0.47 seconds to deallocate network for instance.
Oct 20 10:34:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:35 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:34:35 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:34:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:35 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Deleted allocations for instance 60618091-1d8e-477c-8ea8-63973626a7e2
Oct 20 10:34:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-70971d7b-23de-411d-b80d-e996648220d4 tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "60618091-1d8e-477c-8ea8-63973626a7e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.802s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:36 user nova-compute[74311]: DEBUG nova.compute.manager [req-2f47702d-5fb4-4dfa-871f-74b9d638c658 req-a1a6a11f-86a8-4e97-9ee4-d6482a511ee8 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received event network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:34:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2f47702d-5fb4-4dfa-871f-74b9d638c658 req-a1a6a11f-86a8-4e97-9ee4-d6482a511ee8 service nova] Acquiring lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2f47702d-5fb4-4dfa-871f-74b9d638c658 req-a1a6a11f-86a8-4e97-9ee4-d6482a511ee8 service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2f47702d-5fb4-4dfa-871f-74b9d638c658 req-a1a6a11f-86a8-4e97-9ee4-d6482a511ee8 service nova] Lock "60618091-1d8e-477c-8ea8-63973626a7e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:36 user nova-compute[74311]: DEBUG nova.compute.manager [req-2f47702d-5fb4-4dfa-871f-74b9d638c658 req-a1a6a11f-86a8-4e97-9ee4-d6482a511ee8 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] No waiting events found dispatching network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:34:36 user nova-compute[74311]: WARNING nova.compute.manager [req-2f47702d-5fb4-4dfa-871f-74b9d638c658 req-a1a6a11f-86a8-4e97-9ee4-d6482a511ee8 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received unexpected event network-vif-plugged-395a6652-12b5-404b-81e4-2beb52c164ca for instance with vm_state deleted and task_state None.
Oct 20 10:34:36 user nova-compute[74311]: DEBUG nova.compute.manager [req-2f47702d-5fb4-4dfa-871f-74b9d638c658 req-a1a6a11f-86a8-4e97-9ee4-d6482a511ee8 service nova] [instance: 60618091-1d8e-477c-8ea8-63973626a7e2] Received event network-vif-deleted-395a6652-12b5-404b-81e4-2beb52c164ca {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:34:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:50 user nova-compute[74311]: INFO nova.compute.manager [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Terminating instance
Oct 20 10:34:50 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG nova.compute.manager [req-60cef48f-20d6-4015-946f-d2b57817416d req-21e0205c-3d83-45c7-ab79-452af0c5eb78 service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Received event network-vif-unplugged-e853f99d-3932-4c66-9ad8-abfd70236a52 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-60cef48f-20d6-4015-946f-d2b57817416d req-21e0205c-3d83-45c7-ab79-452af0c5eb78 service nova] Acquiring lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-60cef48f-20d6-4015-946f-d2b57817416d req-21e0205c-3d83-45c7-ab79-452af0c5eb78 service nova] Lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-60cef48f-20d6-4015-946f-d2b57817416d req-21e0205c-3d83-45c7-ab79-452af0c5eb78 service nova] Lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG nova.compute.manager [req-60cef48f-20d6-4015-946f-d2b57817416d req-21e0205c-3d83-45c7-ab79-452af0c5eb78 service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] No waiting events found dispatching network-vif-unplugged-e853f99d-3932-4c66-9ad8-abfd70236a52 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:34:50 user nova-compute[74311]: DEBUG nova.compute.manager [req-60cef48f-20d6-4015-946f-d2b57817416d req-21e0205c-3d83-45c7-ab79-452af0c5eb78 service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Received event network-vif-unplugged-e853f99d-3932-4c66-9ad8-abfd70236a52 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:34:51 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Instance destroyed successfully.
Oct 20 10:34:51 user nova-compute[74311]: DEBUG nova.objects.instance [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lazy-loading 'resources' on Instance uuid ddc14ed0-b767-49c6-b88f-fdc8a04261cc {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1811429318',display_name='tempest-TestVolumeBootPattern-server-1811429318',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1811429318',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-c6ayysfd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:33:33Z,user_data=None,user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=ddc14ed0-b767-49c6-b88f-fdc8a04261cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e853f99d-3932-4c66-9ad8-abfd70236a52", "address": "fa:16:3e:77:a0:8a", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape853f99d-39", "ovs_interfaceid": "e853f99d-3932-4c66-9ad8-abfd70236a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "e853f99d-3932-4c66-9ad8-abfd70236a52", "address": "fa:16:3e:77:a0:8a", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape853f99d-39", "ovs_interfaceid": "e853f99d-3932-4c66-9ad8-abfd70236a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:a0:8a,bridge_name='br-int',has_traffic_filtering=True,id=e853f99d-3932-4c66-9ad8-abfd70236a52,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape853f99d-39') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_vif [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a0:8a,bridge_name='br-int',has_traffic_filtering=True,id=e853f99d-3932-4c66-9ad8-abfd70236a52,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape853f99d-39') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape853f99d-39, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ab960f2-7064-4899-976a-ade643a09745) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:34:51 user nova-compute[74311]: INFO os_vif [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a0:8a,bridge_name='br-int',has_traffic_filtering=True,id=e853f99d-3932-4c66-9ad8-abfd70236a52,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape853f99d-39')
Oct 20 10:34:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EeuHXlGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:34:51 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f756de4-95f9-4fde-99db-8c7500219509]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:34:51 user nova-compute[74311]: No targets found.
Oct 20 10:34:51 user nova-compute[74311]: iSNS:
Oct 20 10:34:51 user nova-compute[74311]: No targets found.
Oct 20 10:34:51 user nova-compute[74311]: STATIC:
Oct 20 10:34:51 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4
Oct 20 10:34:51 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:34:51 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:34:51 user nova-compute[74311]: FIRMWARE:
Oct 20 10:34:51 user nova-compute[74311]: No targets found.
Oct 20 10:34:51 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:34:51 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:34:51 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1093fa6-eb65-4bf4-a011-6ff1fdb864ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff40fdd-6c43-4f41-a2fc-083b3b08371e]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 (non-flash)
Oct 20 10:34:51 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 (non-flash)
Oct 20 10:34:51 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1884f37f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fb1e33-8a08-4e47-904d-988b8d38dbed]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea231cbc-d926-483c-9fd3-c3b6f17d3fc3]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a082ffb-3e7b-44c6-9b3b-779e945da34d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a68c73-ffb2-404b-9f3b-1b8389b9542b]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23134383132366430', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_93b0372', '/dev/disk/by-id/scsi-1SCST_BIO93b0372-148126d0d284743b') {{(pid=85589) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54ec1a5-3823-4436-8a01-3f2ca407b187]: (4, None) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb59c9d-b809-4661-b28c-80edcd2853fb]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[433a8075-1fd6-4580-af3e-86a4a99d8449]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4, portal: 172.16.0.220,3260]
Oct 20 10:34:51 user nova-compute[74311]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4, portal: 172.16.0.220,3260] successful.
Oct 20 10:34:51 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cff5b25-3ba7-4b4b-b0c9-1ed1fe7b8cdc]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== disconnect_volume: return (326ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:34:51 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Deleting instance files /opt/stack/data/nova/instances/ddc14ed0-b767-49c6-b88f-fdc8a04261cc_del
Oct 20 10:34:51 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Deletion of /opt/stack/data/nova/instances/ddc14ed0-b767-49c6-b88f-fdc8a04261cc_del complete
Oct 20 10:34:51 user nova-compute[74311]: INFO nova.compute.manager [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 20 10:34:51 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:34:51 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:34:52 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:34:52 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Took 0.40 seconds to deallocate network for instance.
Oct 20 10:34:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-668b3354-11c0-4184-a08b-02812609fc46 req-1d185be8-6ad1-4be7-8dc6-63b0ecc04e5b service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Received event network-vif-plugged-e853f99d-3932-4c66-9ad8-abfd70236a52 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:34:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-668b3354-11c0-4184-a08b-02812609fc46 req-1d185be8-6ad1-4be7-8dc6-63b0ecc04e5b service nova] Acquiring lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-668b3354-11c0-4184-a08b-02812609fc46 req-1d185be8-6ad1-4be7-8dc6-63b0ecc04e5b service nova] Lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-668b3354-11c0-4184-a08b-02812609fc46 req-1d185be8-6ad1-4be7-8dc6-63b0ecc04e5b service nova] Lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-668b3354-11c0-4184-a08b-02812609fc46 req-1d185be8-6ad1-4be7-8dc6-63b0ecc04e5b service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] No waiting events found dispatching network-vif-plugged-e853f99d-3932-4c66-9ad8-abfd70236a52 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:34:52 user nova-compute[74311]: WARNING nova.compute.manager [req-668b3354-11c0-4184-a08b-02812609fc46 req-1d185be8-6ad1-4be7-8dc6-63b0ecc04e5b service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Received unexpected event network-vif-plugged-e853f99d-3932-4c66-9ad8-abfd70236a52 for instance with vm_state active and task_state deleting.
Oct 20 10:34:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-668b3354-11c0-4184-a08b-02812609fc46 req-1d185be8-6ad1-4be7-8dc6-63b0ecc04e5b service nova] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Received event network-vif-deleted-e853f99d-3932-4c66-9ad8-abfd70236a52 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:34:53 user nova-compute[74311]: INFO nova.compute.manager [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Took 0.91 seconds to detach 1 volumes for instance.
Oct 20 10:34:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: ddc14ed0-b767-49c6-b88f-fdc8a04261cc] Deleting volume: f0cca70b-9ea1-490d-af20-bcd0e9c1ebc4 {{(pid=74311) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 10:34:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:34:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:34:53 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:34:53 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:34:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:53 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Deleted allocations for instance ddc14ed0-b767-49c6-b88f-fdc8a04261cc
Oct 20 10:34:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0515733d-c066-41b9-8030-5eda2d68f479 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "ddc14ed0-b767-49c6-b88f-fdc8a04261cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.489s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:34:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:35:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG nova.objects.instance [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lazy-loading 'info_cache' on Instance uuid c0f944dd-b256-4b47-9e2e-7ba50188f636 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Updating instance_info_cache with network_info: [{"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-c0f944dd-b256-4b47-9e2e-7ba50188f636" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-6a2d5750-7373-40da-8c73-b53bd356ea6e req-1a9a0633-7309-4005-8043-ac23e1df6d9b service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Received event network-changed-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-6a2d5750-7373-40da-8c73-b53bd356ea6e req-1a9a0633-7309-4005-8043-ac23e1df6d9b service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Refreshing instance network info cache due to event network-changed-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6a2d5750-7373-40da-8c73-b53bd356ea6e req-1a9a0633-7309-4005-8043-ac23e1df6d9b service nova] Acquiring lock "refresh_cache-58bba07b-6122-47f7-9cea-44cebe840ced" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6a2d5750-7373-40da-8c73-b53bd356ea6e req-1a9a0633-7309-4005-8043-ac23e1df6d9b service nova] Acquired lock "refresh_cache-58bba07b-6122-47f7-9cea-44cebe840ced" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG nova.network.neutron [req-6a2d5750-7373-40da-8c73-b53bd356ea6e req-1a9a0633-7309-4005-8043-ac23e1df6d9b service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Refreshing network info cache for port 2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG nova.network.neutron [req-6a2d5750-7373-40da-8c73-b53bd356ea6e req-1a9a0633-7309-4005-8043-ac23e1df6d9b service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Updated VIF entry in instance network info cache for port 2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG nova.network.neutron [req-6a2d5750-7373-40da-8c73-b53bd356ea6e req-1a9a0633-7309-4005-8043-ac23e1df6d9b service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Updating instance_info_cache with network_info: [{"id": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "address": "fa:16:3e:e2:9d:6f", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2290e0-26", "ovs_interfaceid": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:35:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6a2d5750-7373-40da-8c73-b53bd356ea6e req-1a9a0633-7309-4005-8043-ac23e1df6d9b service nova] Releasing lock "refresh_cache-58bba07b-6122-47f7-9cea-44cebe840ced" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:35:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:35:12 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:35:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "58bba07b-6122-47f7-9cea-44cebe840ced" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "58bba07b-6122-47f7-9cea-44cebe840ced" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG nova.objects.instance [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'flavor' on Instance uuid 58bba07b-6122-47f7-9cea-44cebe840ced {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "58bba07b-6122-47f7-9cea-44cebe840ced" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "58bba07b-6122-47f7-9cea-44cebe840ced" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "58bba07b-6122-47f7-9cea-44cebe840ced" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:15 user nova-compute[74311]: INFO nova.compute.manager [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Attaching volume 168d2c4d-f35c-426a-9716-4ba4e37aefad to /dev/vdb
Oct 20 10:35:15 user nova-compute[74311]: DEBUG os_brick.utils [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b129bf6-9dc2-46c9-bdd8-a604270245d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b6edaa-a635-4012-8077-189fc9ef92e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7826f5-95f9-4e41-87e5-0d3a62927f12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd53c94-bc8c-4bdc-9a80-655083275037]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:35:15 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:35:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc0494b-5cce-44df-bd27-46b7e23f48f7]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG os_brick.utils [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:35:15 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Updating existing volume attachment record: dbdd7407-4867-4bac-a1d1-60abb1843097 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:35:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:17 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:35:17 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:35:17 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:35:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:21 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:35:21 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:35:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:35:21 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:35:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:22 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:23 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:35:23 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:35:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8364MB free_disk=25.11654281616211GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:35:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance c0f944dd-b256-4b47-9e2e-7ba50188f636 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:35:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 593a4f46-9b5b-4a3c-95c7-21712b081069 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:35:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 58bba07b-6122-47f7-9cea-44cebe840ced actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:35:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 30945ee9-c420-440b-b98d-8dc4922fd216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:35:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:35:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:35:23 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:35:23 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:35:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:35:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.350s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:35:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:35:24 user nova-compute[74311]: INFO nova.compute.manager [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Terminating instance
Oct 20 10:35:24 user nova-compute[74311]: DEBUG nova.compute.manager [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:35:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:24 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:35:24 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:35:24 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:35:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-024d0c39-20f3-499d-8b50-7c6f2181d255 req-5f117ec0-f16b-4f78-ad2b-d5d7c2c61d96 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-vif-unplugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-024d0c39-20f3-499d-8b50-7c6f2181d255 req-5f117ec0-f16b-4f78-ad2b-d5d7c2c61d96 service nova] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-024d0c39-20f3-499d-8b50-7c6f2181d255 req-5f117ec0-f16b-4f78-ad2b-d5d7c2c61d96 service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-024d0c39-20f3-499d-8b50-7c6f2181d255 req-5f117ec0-f16b-4f78-ad2b-d5d7c2c61d96 service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-024d0c39-20f3-499d-8b50-7c6f2181d255 req-5f117ec0-f16b-4f78-ad2b-d5d7c2c61d96 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] No waiting events found dispatching network-vif-unplugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-024d0c39-20f3-499d-8b50-7c6f2181d255 req-5f117ec0-f16b-4f78-ad2b-d5d7c2c61d96 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-vif-unplugged-131d4c92-ce07-4319-9261-609009fbdaee for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:25 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Instance destroyed successfully.
Oct 20 10:35:25 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lazy-loading 'resources' on Instance uuid c0f944dd-b256-4b47-9e2e-7ba50188f636 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:17:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-175292247',display_name='tempest-ServerRescueNegativeTestJSON-server-175292247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-175292247',id=19,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:22:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07b7c2a684a3466eba4799473c725066',ramdisk_id='',reservation_id='r-iqhej24v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-320006607',owner_user_name='tempest-ServerRescueNegativeTestJSON-320006607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:24:26Z,user_data=None,user_id='302a265253b14a19be48546953baaebf',uuid=c0f944dd-b256-4b47-9e2e-7ba50188f636,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converting VIF {"id": "131d4c92-ce07-4319-9261-609009fbdaee", "address": "fa:16:3e:8a:ce:2a", "network": {"id": "fc6c7576-2675-4ba8-9865-c5ba759ebd63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1082766314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07b7c2a684a3466eba4799473c725066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131d4c92-ce", "ovs_interfaceid": "131d4c92-ce07-4319-9261-609009fbdaee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:ce:2a,bridge_name='br-int',has_traffic_filtering=True,id=131d4c92-ce07-4319-9261-609009fbdaee,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d4c92-ce') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG os_vif [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:ce:2a,bridge_name='br-int',has_traffic_filtering=True,id=131d4c92-ce07-4319-9261-609009fbdaee,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d4c92-ce') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap131d4c92-ce, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18afaee0-6892-4c48-b79b-c19aae6fa2ba) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:35:25 user nova-compute[74311]: INFO os_vif [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:ce:2a,bridge_name='br-int',has_traffic_filtering=True,id=131d4c92-ce07-4319-9261-609009fbdaee,network=Network(fc6c7576-2675-4ba8-9865-c5ba759ebd63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131d4c92-ce')
Oct 20 10:35:25 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Deleting instance files /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636_del
Oct 20 10:35:25 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Deletion of /opt/stack/data/nova/instances/c0f944dd-b256-4b47-9e2e-7ba50188f636_del complete
Oct 20 10:35:25 user nova-compute[74311]: INFO nova.compute.manager [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Took 0.74 seconds to destroy the instance on the hypervisor.
Oct 20 10:35:25 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:35:25 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Took 0.48 seconds to deallocate network for instance.
Oct 20 10:35:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-7c5d6673-85a0-491c-afc5-189b196df733 req-3a2670aa-4186-43c1-98b8-7138345315c7 service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Received event network-changed-368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG nova.compute.manager [req-7c5d6673-85a0-491c-afc5-189b196df733 req-3a2670aa-4186-43c1-98b8-7138345315c7 service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Refreshing instance network info cache due to event network-changed-368cb7d7-e072-416a-bf32-339c43e90aa2. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c5d6673-85a0-491c-afc5-189b196df733 req-3a2670aa-4186-43c1-98b8-7138345315c7 service nova] Acquiring lock "refresh_cache-30945ee9-c420-440b-b98d-8dc4922fd216" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c5d6673-85a0-491c-afc5-189b196df733 req-3a2670aa-4186-43c1-98b8-7138345315c7 service nova] Acquired lock "refresh_cache-30945ee9-c420-440b-b98d-8dc4922fd216" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG nova.network.neutron [req-7c5d6673-85a0-491c-afc5-189b196df733 req-3a2670aa-4186-43c1-98b8-7138345315c7 service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Refreshing network info cache for port 368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:35:26 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Deleted allocations for instance c0f944dd-b256-4b47-9e2e-7ba50188f636
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e7d02d37-0641-4240-a109-f560637acc2b tempest-ServerRescueNegativeTestJSON-320006607 tempest-ServerRescueNegativeTestJSON-320006607-project-member] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.665s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG nova.network.neutron [req-7c5d6673-85a0-491c-afc5-189b196df733 req-3a2670aa-4186-43c1-98b8-7138345315c7 service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Updated VIF entry in instance network info cache for port 368cb7d7-e072-416a-bf32-339c43e90aa2. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG nova.network.neutron [req-7c5d6673-85a0-491c-afc5-189b196df733 req-3a2670aa-4186-43c1-98b8-7138345315c7 service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Updating instance_info_cache with network_info: [{"id": "368cb7d7-e072-416a-bf32-339c43e90aa2", "address": "fa:16:3e:2c:ab:73", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368cb7d7-e0", "ovs_interfaceid": "368cb7d7-e072-416a-bf32-339c43e90aa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7c5d6673-85a0-491c-afc5-189b196df733 req-3a2670aa-4186-43c1-98b8-7138345315c7 service nova] Releasing lock "refresh_cache-30945ee9-c420-440b-b98d-8dc4922fd216" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "30945ee9-c420-440b-b98d-8dc4922fd216" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "30945ee9-c420-440b-b98d-8dc4922fd216" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lazy-loading 'flavor' on Instance uuid 30945ee9-c420-440b-b98d-8dc4922fd216 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "30945ee9-c420-440b-b98d-8dc4922fd216" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "30945ee9-c420-440b-b98d-8dc4922fd216" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "30945ee9-c420-440b-b98d-8dc4922fd216" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:26 user nova-compute[74311]: INFO nova.compute.manager [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Attaching volume 42d44177-a8be-4ea4-aea6-0d1fce35a077 to /dev/vdb
Oct 20 10:35:26 user nova-compute[74311]: DEBUG os_brick.utils [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ec3234-f98a-4cd7-9b06-b208b7d6d922]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c30acf-a2b1-4247-8cc8-0835fb1b3d92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8991d50e-3691-43e4-9e2c-bf4ea8f73938]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[870859a2-a2ff-47e4-ab72-c81cefab6ade]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:35:26 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:35:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6aea38-4b2d-47cd-8708-df60f7997d98]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:35:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:35:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:35:27 user nova-compute[74311]: DEBUG os_brick.utils [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:35:27 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Updating existing volume attachment record: b880811a-29b0-43ea-9065-a7f549896d62 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:35:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-f41810e1-3d23-4826-b309-a9a8aff6ff00 req-28617527-2e6a-4959-9846-2c2f0b5de335 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:35:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f41810e1-3d23-4826-b309-a9a8aff6ff00 req-28617527-2e6a-4959-9846-2c2f0b5de335 service nova] Acquiring lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f41810e1-3d23-4826-b309-a9a8aff6ff00 req-28617527-2e6a-4959-9846-2c2f0b5de335 service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f41810e1-3d23-4826-b309-a9a8aff6ff00 req-28617527-2e6a-4959-9846-2c2f0b5de335 service nova] Lock "c0f944dd-b256-4b47-9e2e-7ba50188f636-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:35:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-f41810e1-3d23-4826-b309-a9a8aff6ff00 req-28617527-2e6a-4959-9846-2c2f0b5de335 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] No waiting events found dispatching network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:35:27 user nova-compute[74311]: WARNING nova.compute.manager [req-f41810e1-3d23-4826-b309-a9a8aff6ff00 req-28617527-2e6a-4959-9846-2c2f0b5de335 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received unexpected event network-vif-plugged-131d4c92-ce07-4319-9261-609009fbdaee for instance with vm_state deleted and task_state None.
Oct 20 10:35:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-f41810e1-3d23-4826-b309-a9a8aff6ff00 req-28617527-2e6a-4959-9846-2c2f0b5de335 service nova] [instance: c0f944dd-b256-4b47-9e2e-7ba50188f636] Received event network-vif-deleted-131d4c92-ce07-4319-9261-609009fbdaee {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:35:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvDVBnwt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:35:32 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:35:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:35:32 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:35:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:35:32 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[179227fb-3c37-4456-b7a6-f440780f63cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:35:32 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[186ab3b2-d7cb-4bb1-9836-0b67536cfc18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad] added
Oct 20 10:35:32 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f757c392-324c-48ff-9716-d4615d9a1974]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a964bc52-dda4-4d5d-8729-c5cd30b7ce31]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hvDVBnwt {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hvDVBnwt" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7380efab-90aa-4740-aaed-60e157d57554]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hvDVBnwt'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.069s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96f895a-8867-484e-b83d-4f4c2d73e472]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92ae987-7868-40f0-8fa3-2ff5e515fcc0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:35:33 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:35:33 user nova-compute[74311]:  {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:35:33 user nova-compute[74311]: WARNING os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 10:35:33 user nova-compute[74311]: 
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[017385b0-7a79-4e13-8dcf-7c7b02dc2312]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad, portal: 172.16.0.220,3260]
Oct 20 10:35:33 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad, portal: 172.16.0.220,3260] successful.
Oct 20 10:35:33 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff361d1-35cb-4994-9320-b3346f2d1a3a]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a41fe3b-bcb0-4807-838f-482a93b613eb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad (non-flash)
Oct 20 10:35:33 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad (non-flash)
Oct 20 10:35:33 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8b447b-a2ed-4b4c-a2ff-f75d5751d7ca]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:35:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:34 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:35:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvDVBnwt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:35:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:35:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26537346231653661', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:35:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537346231653661', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:35:34 user nova-compute[74311]: DEBUG nova.objects.instance [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'flavor' on Instance uuid 58bba07b-6122-47f7-9cea-44cebe840ced {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:35:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:35:34 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:35:34 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:35:34 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:35:34 user nova-compute[74311]:   <serial>168d2c4d-f35c-426a-9716-4ba4e37aefad</serial>
Oct 20 10:35:34 user nova-compute[74311]: </disk>
Oct 20 10:35:34 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:35:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:35:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:35:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] No VIF found with MAC fa:16:3e:e2:9d:6f, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:35:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-512b4702-c191-4fe7-9877-59bbef530523 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "58bba07b-6122-47f7-9cea-44cebe840ced" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.265s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:35:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "58bba07b-6122-47f7-9cea-44cebe840ced" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "58bba07b-6122-47f7-9cea-44cebe840ced" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:35 user nova-compute[74311]: INFO nova.compute.manager [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Detaching volume 168d2c4d-f35c-426a-9716-4ba4e37aefad
Oct 20 10:35:35 user nova-compute[74311]: INFO nova.virt.block_device [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Attempting to driver detach volume 168d2c4d-f35c-426a-9716-4ba4e37aefad from mountpoint /dev/vdb
Oct 20 10:35:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Attempting to detach device vdb from instance 58bba07b-6122-47f7-9cea-44cebe840ced from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:35:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:35:35 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:35:35 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:35:35 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:35:35 user nova-compute[74311]:   <serial>168d2c4d-f35c-426a-9716-4ba4e37aefad</serial>
Oct 20 10:35:35 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:35:35 user nova-compute[74311]: </disk>
Oct 20 10:35:35 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:35:35 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Successfully detached device vdb from instance 58bba07b-6122-47f7-9cea-44cebe840ced from the persistent domain config.
Oct 20 10:35:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 58bba07b-6122-47f7-9cea-44cebe840ced from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:35:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:35:35 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:35:35 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:35:35 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:35:35 user nova-compute[74311]:   <serial>168d2c4d-f35c-426a-9716-4ba4e37aefad</serial>
Oct 20 10:35:35 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:35:35 user nova-compute[74311]: </disk>
Oct 20 10:35:35 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:35:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 58bba07b-6122-47f7-9cea-44cebe840ced {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:35:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdLueFQD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:35:43 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:35:43 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:35:43 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f41622-0357-4eb7-ad71-82b4927a26cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:35:43 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0529810f-2036-4d4d-93d3-d77716d7729a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077] added
Oct 20 10:35:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d421ffa-9a73-4044-b2d7-f298b63a783c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96e01db-d8c3-4a5f-b2fb-0659d983e2ca]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TdLueFQD {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TdLueFQD" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[87261272-57ef-4633-824e-7a0b0a9d73b2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TdLueFQD'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[188c295f-48fe-43d8-8a08-e9e4c83127ba]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[80907dcc-19a4-47a8-aa6f-51be05b994d6]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad (non-flash)
Oct 20 10:35:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad (non-flash)
Oct 20 10:35:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eb8185-7631-489b-92fc-b912abef0d93]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077, portal: 172.16.0.220,3260]
Oct 20 10:35:43 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077, portal: 172.16.0.220,3260] successful.
Oct 20 10:35:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[880f704b-2d0c-487b-ac62-8e55233e84f1]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc665651-701a-4f63-8233-a73da3ffc487]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad (non-flash)
Oct 20 10:35:43 user nova-compute[74311]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 (non-flash)
Oct 20 10:35:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad (non-flash)
Oct 20 10:35:43 user nova-compute[74311]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 (non-flash)
Oct 20 10:35:43 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[697d5450-0754-4466-998e-13250cf7ec15]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:35:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:44 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:35:44 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdLueFQD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:35:44 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:35:44 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23735666335356538', 'path': '/dev/sdc'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:35:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735666335356538', 'path': '/dev/sdc'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:35:44 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lazy-loading 'flavor' on Instance uuid 30945ee9-c420-440b-b98d-8dc4922fd216 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:35:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:35:44 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:35:44 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:35:44 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:35:44 user nova-compute[74311]:   <serial>42d44177-a8be-4ea4-aea6-0d1fce35a077</serial>
Oct 20 10:35:44 user nova-compute[74311]: </disk>
Oct 20 10:35:44 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:35:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:35:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:35:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] No VIF found with MAC fa:16:3e:2c:ab:73, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:35:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e09fac06-fb48-49fc-86fe-e49c0dc426ae tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "30945ee9-c420-440b-b98d-8dc4922fd216" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.432s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:35:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "30945ee9-c420-440b-b98d-8dc4922fd216" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "30945ee9-c420-440b-b98d-8dc4922fd216" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:47 user nova-compute[74311]: INFO nova.compute.manager [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Detaching volume 42d44177-a8be-4ea4-aea6-0d1fce35a077
Oct 20 10:35:47 user nova-compute[74311]: INFO nova.virt.block_device [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Attempting to driver detach volume 42d44177-a8be-4ea4-aea6-0d1fce35a077 from mountpoint /dev/vdb
Oct 20 10:35:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Attempting to detach device vdb from instance 30945ee9-c420-440b-b98d-8dc4922fd216 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:35:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:35:47 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:35:47 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:35:47 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:35:47 user nova-compute[74311]:   <serial>42d44177-a8be-4ea4-aea6-0d1fce35a077</serial>
Oct 20 10:35:47 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:35:47 user nova-compute[74311]: </disk>
Oct 20 10:35:47 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:35:47 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Successfully detached device vdb from instance 30945ee9-c420-440b-b98d-8dc4922fd216 from the persistent domain config.
Oct 20 10:35:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 30945ee9-c420-440b-b98d-8dc4922fd216 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:35:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:35:47 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:35:47 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:35:47 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:35:47 user nova-compute[74311]:   <serial>42d44177-a8be-4ea4-aea6-0d1fce35a077</serial>
Oct 20 10:35:47 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:35:47 user nova-compute[74311]: </disk>
Oct 20 10:35:47 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:35:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 30945ee9-c420-440b-b98d-8dc4922fd216 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:35:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:56 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 58bba07b-6122-47f7-9cea-44cebe840ced is timed out.
Oct 20 10:35:56 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Successfully detached device vdb from instance 58bba07b-6122-47f7-9cea-44cebe840ced from the live domain config.
Oct 20 10:35:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hvDVBnwt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:35:56 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff17319-87c9-4d99-a007-1ff30da4a30c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:35:56 user nova-compute[74311]: No targets found.
Oct 20 10:35:56 user nova-compute[74311]: iSNS:
Oct 20 10:35:56 user nova-compute[74311]: No targets found.
Oct 20 10:35:56 user nova-compute[74311]: STATIC:
Oct 20 10:35:56 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad
Oct 20 10:35:56 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:35:56 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:35:56 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077
Oct 20 10:35:56 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:35:56 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:35:56 user nova-compute[74311]: FIRMWARE:
Oct 20 10:35:56 user nova-compute[74311]: No targets found.
Oct 20 10:35:56 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:35:56 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:35:56 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d55a48-2147-4f05-b8a2-f00b5942f2d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db7fc01-85ad-4c6f-ba42-12e1ded663dd]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad (non-flash)
Oct 20 10:35:56 user nova-compute[74311]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 (non-flash)
Oct 20 10:35:56 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad (non-flash)
Oct 20 10:35:56 user nova-compute[74311]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 (non-flash)
Oct 20 10:35:56 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb188628d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30a6223-677e-48c6-9376-446647321763]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ce092f-1713-49f9-86c4-92ac03fb52a6]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c28bd7b-0116-4aec-9a5f-a2ca5d5e90b5]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce59e010-434f-4ebb-b7e5-82e813055fef]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38beea9-6922-40a4-b3e0-274e56ba6ad7]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e006108-b72a-4ad5-8a90-24476171cfc9]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad, portal: 172.16.0.220,3260]
Oct 20 10:35:56 user nova-compute[74311]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad, portal: 172.16.0.220,3260] successful.
Oct 20 10:35:56 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:168d2c4d-f35c-426a-9716-4ba4e37aefad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8763c228-7309-4179-a17e-97ec6ed8ccd6]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] <== disconnect_volume: return (301ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:35:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:35:57 user nova-compute[74311]: DEBUG nova.objects.instance [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'flavor' on Instance uuid 58bba07b-6122-47f7-9cea-44cebe840ced {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:35:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-539f75a4-83e1-4765-b41f-76e4a5c1abc3 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "58bba07b-6122-47f7-9cea-44cebe840ced" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.139s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:35:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:35:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "367d718d-35ed-4c04-97f1-518bd0e100e1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:59 user nova-compute[74311]: INFO nova.compute.manager [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Unshelving
Oct 20 10:35:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:35:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:35:59 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lazy-loading 'pci_requests' on Instance uuid 367d718d-35ed-4c04-97f1-518bd0e100e1 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:35:59 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lazy-loading 'numa_topology' on Instance uuid 367d718d-35ed-4c04-97f1-518bd0e100e1 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:35:59 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:35:59 user nova-compute[74311]: INFO nova.compute.claims [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Claim successful on node user
Oct 20 10:35:59 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:35:59 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:35:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:35:59 user nova-compute[74311]: INFO nova.network.neutron [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Updating port b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquired lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG nova.network.neutron [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-2e9ee481-d524-466d-8250-e695c9d4fc74 req-07d94910-1133-4bb5-9feb-4cd2bd30b919 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received event network-changed-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-2e9ee481-d524-466d-8250-e695c9d4fc74 req-07d94910-1133-4bb5-9feb-4cd2bd30b919 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Refreshing instance network info cache due to event network-changed-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e9ee481-d524-466d-8250-e695c9d4fc74 req-07d94910-1133-4bb5-9feb-4cd2bd30b919 service nova] Acquiring lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG nova.network.neutron [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Updating instance_info_cache with network_info: [{"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Releasing lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:36:00 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Creating image(s)
Oct 20 10:36:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "/opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "/opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "/opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lazy-loading 'trusted_certs' on Instance uuid 367d718d-35ed-4c04-97f1-518bd0e100e1 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e9ee481-d524-466d-8250-e695c9d4fc74 req-07d94910-1133-4bb5-9feb-4cd2bd30b919 service nova] Acquired lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG nova.network.neutron [req-2e9ee481-d524-466d-8250-e695c9d4fc74 req-07d94910-1133-4bb5-9feb-4cd2bd30b919 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Refreshing network info cache for port b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG nova.objects.base [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Object Instance<367d718d-35ed-4c04-97f1-518bd0e100e1> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "0b8b5d735e983b7b9dc305a975928e1319543f19" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "0b8b5d735e983b7b9dc305a975928e1319543f19" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:01 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19.part --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19.part --force-share --output=json" returned: 0 in 0.196s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:02 user nova-compute[74311]: DEBUG nova.virt.images [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] 24ef6c88-7bce-4deb-9235-21160658bea3 was qcow2, converting to raw {{(pid=74311) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 10:36:02 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:36:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19.part /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19.converted {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:02 user nova-compute[74311]: DEBUG nova.network.neutron [req-2e9ee481-d524-466d-8250-e695c9d4fc74 req-07d94910-1133-4bb5-9feb-4cd2bd30b919 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Updated VIF entry in instance network info cache for port b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:36:02 user nova-compute[74311]: DEBUG nova.network.neutron [req-2e9ee481-d524-466d-8250-e695c9d4fc74 req-07d94910-1133-4bb5-9feb-4cd2bd30b919 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Updating instance_info_cache with network_info: [{"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:36:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2e9ee481-d524-466d-8250-e695c9d4fc74 req-07d94910-1133-4bb5-9feb-4cd2bd30b919 service nova] Releasing lock "refresh_cache-367d718d-35ed-4c04-97f1-518bd0e100e1" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:36:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19.part /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19.converted" returned: 0 in 0.682s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19.converted --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "0b8b5d735e983b7b9dc305a975928e1319543f19" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.316s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19 --force-share --output=json" returned: 0 in 0.214s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "0b8b5d735e983b7b9dc305a975928e1319543f19" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "0b8b5d735e983b7b9dc305a975928e1319543f19" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19 --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19,backing_fmt=raw /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19,backing_fmt=raw /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk 1073741824" returned: 0 in 0.050s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "0b8b5d735e983b7b9dc305a975928e1319543f19" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19 --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lazy-loading 'migration_context' on Instance uuid 367d718d-35ed-4c04-97f1-518bd0e100e1 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG nova.objects.base [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Object Instance<367d718d-35ed-4c04-97f1-518bd0e100e1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:36:03 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Rebasing disk image.
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.206s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:03 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 -F raw /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:36:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:36:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5006 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:36:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:36:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 -F raw /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk" returned: 0 in 2.349s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Ensure instance console log exists: /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Start _get_guest_xml network_info=[{"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e8bce3dabae9a55d2cdd4da2ce4086bb',container_format='bare',created_at=2023-10-20T10:34:06Z,direct_url=<?>,disk_format='qcow2',id=24ef6c88-7bce-4deb-9235-21160658bea3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1498909758-shelved',owner='61fab5f8b38b490985cc614ade80f25a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T10:34:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:36:06 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:36:06 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e8bce3dabae9a55d2cdd4da2ce4086bb',container_format='bare',created_at=2023-10-20T10:34:06Z,direct_url=<?>,disk_format='qcow2',id=24ef6c88-7bce-4deb-9235-21160658bea3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1498909758-shelved',owner='61fab5f8b38b490985cc614ade80f25a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T10:34:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lazy-loading 'vcpu_model' on Instance uuid 367d718d-35ed-4c04-97f1-518bd0e100e1 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.objects.base [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Object Instance<367d718d-35ed-4c04-97f1-518bd0e100e1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T10:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1498909758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1498909758',id=38,image_ref='24ef6c88-7bce-4deb-9235-21160658bea3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1460218868',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:32:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='61fab5f8b38b490985cc614ade80f25a',ramdisk_id='',reservation_id='r-fzi5czat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1592971712',owner_user_name='tempest-AttachVolumeShelveTestJSON-1592971712-project-member',shelved_at='2023-10-20T10:34:10.860487',shelved_host='user',shelved_image_id='24ef6c88-7bce-4deb-9235-21160658bea3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:35:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1aad9aa1e64a9db4f78c0c12779300',uuid=367d718d-35ed-4c04-97f1-518bd0e100e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converting VIF {"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:50,bridge_name='br-int',has_traffic_filtering=True,id=b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cf7ba1-9f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lazy-loading 'pci_devices' on Instance uuid 367d718d-35ed-4c04-97f1-518bd0e100e1 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.objects.base [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Object Instance<367d718d-35ed-4c04-97f1-518bd0e100e1> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:36:06 user nova-compute[74311]:   <uuid>367d718d-35ed-4c04-97f1-518bd0e100e1</uuid>
Oct 20 10:36:06 user nova-compute[74311]:   <name>instance-00000026</name>
Oct 20 10:36:06 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:36:06 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:36:06 user nova-compute[74311]:   <metadata>
Oct 20 10:36:06 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:36:06 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:36:06 user nova-compute[74311]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1498909758</nova:name>
Oct 20 10:36:06 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:36:06</nova:creationTime>
Oct 20 10:36:06 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:36:06 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:36:06 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:36:06 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:36:06 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:36:06 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:36:06 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:36:06 user nova-compute[74311]:       <nova:owner>
Oct 20 10:36:06 user nova-compute[74311]:         <nova:user uuid="fe1aad9aa1e64a9db4f78c0c12779300">tempest-AttachVolumeShelveTestJSON-1592971712-project-member</nova:user>
Oct 20 10:36:06 user nova-compute[74311]:         <nova:project uuid="61fab5f8b38b490985cc614ade80f25a">tempest-AttachVolumeShelveTestJSON-1592971712</nova:project>
Oct 20 10:36:06 user nova-compute[74311]:       </nova:owner>
Oct 20 10:36:06 user nova-compute[74311]:       <nova:root type="image" uuid="24ef6c88-7bce-4deb-9235-21160658bea3"/>
Oct 20 10:36:06 user nova-compute[74311]:       <nova:ports>
Oct 20 10:36:06 user nova-compute[74311]:         <nova:port uuid="b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7">
Oct 20 10:36:06 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 10:36:06 user nova-compute[74311]:         </nova:port>
Oct 20 10:36:06 user nova-compute[74311]:       </nova:ports>
Oct 20 10:36:06 user nova-compute[74311]:     </nova:instance>
Oct 20 10:36:06 user nova-compute[74311]:   </metadata>
Oct 20 10:36:06 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:36:06 user nova-compute[74311]:     <system>
Oct 20 10:36:06 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:36:06 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:36:06 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:36:06 user nova-compute[74311]:       <entry name="serial">367d718d-35ed-4c04-97f1-518bd0e100e1</entry>
Oct 20 10:36:06 user nova-compute[74311]:       <entry name="uuid">367d718d-35ed-4c04-97f1-518bd0e100e1</entry>
Oct 20 10:36:06 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:36:06 user nova-compute[74311]:     </system>
Oct 20 10:36:06 user nova-compute[74311]:   </sysinfo>
Oct 20 10:36:06 user nova-compute[74311]:   <os>
Oct 20 10:36:06 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:36:06 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:36:06 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:36:06 user nova-compute[74311]:   </os>
Oct 20 10:36:06 user nova-compute[74311]:   <features>
Oct 20 10:36:06 user nova-compute[74311]:     <acpi/>
Oct 20 10:36:06 user nova-compute[74311]:     <apic/>
Oct 20 10:36:06 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:36:06 user nova-compute[74311]:   </features>
Oct 20 10:36:06 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:36:06 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:36:06 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:36:06 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:36:06 user nova-compute[74311]:   </clock>
Oct 20 10:36:06 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:36:06 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:36:06 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:36:06 user nova-compute[74311]:   </cpu>
Oct 20 10:36:06 user nova-compute[74311]:   <devices>
Oct 20 10:36:06 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:36:06 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:36:06 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk"/>
Oct 20 10:36:06 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:36:06 user nova-compute[74311]:     </disk>
Oct 20 10:36:06 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:36:06 user nova-compute[74311]:       <mac address="fa:16:3e:79:37:50"/>
Oct 20 10:36:06 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:36:06 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:36:06 user nova-compute[74311]:       <target dev="tapb7cf7ba1-9f"/>
Oct 20 10:36:06 user nova-compute[74311]:     </interface>
Oct 20 10:36:06 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:36:06 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/console.log" append="off"/>
Oct 20 10:36:06 user nova-compute[74311]:     </serial>
Oct 20 10:36:06 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:36:06 user nova-compute[74311]:     <video>
Oct 20 10:36:06 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:36:06 user nova-compute[74311]:     </video>
Oct 20 10:36:06 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:36:06 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:36:06 user nova-compute[74311]:     </rng>
Oct 20 10:36:06 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:36:06 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:36:06 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:36:06 user nova-compute[74311]:     </memballoon>
Oct 20 10:36:06 user nova-compute[74311]:   </devices>
Oct 20 10:36:06 user nova-compute[74311]: </domain>
Oct 20 10:36:06 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T10:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1498909758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1498909758',id=38,image_ref='24ef6c88-7bce-4deb-9235-21160658bea3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1460218868',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:32:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='61fab5f8b38b490985cc614ade80f25a',ramdisk_id='',reservation_id='r-fzi5czat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1592971712',owner_user_name='tempest-AttachVolumeShelveTestJSON-1592971712-project-member',shelved_at='2023-10-20T10:34:10.860487',shelved_host='user',shelved_image_id='24ef6c88-7bce-4deb-9235-21160658bea3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:35:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1aad9aa1e64a9db4f78c0c12779300',uuid=367d718d-35ed-4c04-97f1-518bd0e100e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converting VIF {"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:50,bridge_name='br-int',has_traffic_filtering=True,id=b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cf7ba1-9f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG os_vif [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:50,bridge_name='br-int',has_traffic_filtering=True,id=b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cf7ba1-9f') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27760fc7-4260-5212-83e1-2a627f69f874', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7cf7ba1-9f, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7cf7ba1-9f, col_values=(('qos', UUID('2011de0c-7d5a-41a4-9aa3-3f40cbb117db')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7cf7ba1-9f, col_values=(('external_ids', {'iface-id': 'b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:37:50', 'vm-uuid': '367d718d-35ed-4c04-97f1-518bd0e100e1'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:06 user nova-compute[74311]: INFO os_vif [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:50,bridge_name='br-int',has_traffic_filtering=True,id=b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cf7ba1-9f')
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:36:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] No VIF found with MAC fa:16:3e:79:37:50, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:36:07 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 30945ee9-c420-440b-b98d-8dc4922fd216 is timed out.
Oct 20 10:36:07 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Successfully detached device vdb from instance 30945ee9-c420-440b-b98d-8dc4922fd216 from the live domain config.
Oct 20 10:36:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdLueFQD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:36:08 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[373d098f-d7b1-4645-bf77-f0ce66edf35b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:36:08 user nova-compute[74311]: No targets found.
Oct 20 10:36:08 user nova-compute[74311]: iSNS:
Oct 20 10:36:08 user nova-compute[74311]: No targets found.
Oct 20 10:36:08 user nova-compute[74311]: STATIC:
Oct 20 10:36:08 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077
Oct 20 10:36:08 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:36:08 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:36:08 user nova-compute[74311]: FIRMWARE:
Oct 20 10:36:08 user nova-compute[74311]: No targets found.
Oct 20 10:36:08 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:36:08 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:36:08 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9597e32b-f8d1-421c-a290-0f0e2c935208]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9c9a3e-b0a1-4eb6-aeeb-813e3c896da4]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 (non-flash)
Oct 20 10:36:08 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 (non-flash)
Oct 20 10:36:08 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1884c2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077'): ({'sdc'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Removing single pathed devices sdc {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddc3d67-a223-46f4-9a58-6214ea75652b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6496a801-a947-4154-91f2-d38ce3c0b2e2]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Flushing IO for device /dev/sdc {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3e8d12-0442-4eed-96e8-228fbc9372b9]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16e3db7-81dc-4679-bae8-979d1a3b9b3b]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[707fdcaf-a1bf-4b38-a616-b6e7f43df151]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-a685113f-c228-4136-b5d8-24d2a6621337 req-cca8286e-3dbc-46df-b5cf-4560d94d56b2 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received event network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a685113f-c228-4136-b5d8-24d2a6621337 req-cca8286e-3dbc-46df-b5cf-4560d94d56b2 service nova] Acquiring lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a685113f-c228-4136-b5d8-24d2a6621337 req-cca8286e-3dbc-46df-b5cf-4560d94d56b2 service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a685113f-c228-4136-b5d8-24d2a6621337 req-cca8286e-3dbc-46df-b5cf-4560d94d56b2 service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-a685113f-c228-4136-b5d8-24d2a6621337 req-cca8286e-3dbc-46df-b5cf-4560d94d56b2 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] No waiting events found dispatching network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:36:08 user nova-compute[74311]: WARNING nova.compute.manager [req-a685113f-c228-4136-b5d8-24d2a6621337 req-cca8286e-3dbc-46df-b5cf-4560d94d56b2 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received unexpected event network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77059a5-b474-418c-898e-08460cf9c20b]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077, portal: 172.16.0.220,3260]
Oct 20 10:36:08 user nova-compute[74311]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077, portal: 172.16.0.220,3260] successful.
Oct 20 10:36:08 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42d44177-a8be-4ea4-aea6-0d1fce35a077 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f34aff-922e-4e3e-b109-02dd3949243b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] <== disconnect_volume: return (323ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:09 user nova-compute[74311]: DEBUG nova.objects.instance [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lazy-loading 'flavor' on Instance uuid 30945ee9-c420-440b-b98d-8dc4922fd216 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:36:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c71e62bd-93c6-48ce-be4c-a3887dba5781 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "30945ee9-c420-440b-b98d-8dc4922fd216" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.819s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:36:10 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Instance spawned successfully.
Oct 20 10:36:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-3c9ede83-1bb4-4426-86a9-f86a81d1fe01 req-a47fb27d-9bae-4808-9ead-809b19532c5b service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received event network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3c9ede83-1bb4-4426-86a9-f86a81d1fe01 req-a47fb27d-9bae-4808-9ead-809b19532c5b service nova] Acquiring lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3c9ede83-1bb4-4426-86a9-f86a81d1fe01 req-a47fb27d-9bae-4808-9ead-809b19532c5b service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3c9ede83-1bb4-4426-86a9-f86a81d1fe01 req-a47fb27d-9bae-4808-9ead-809b19532c5b service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-3c9ede83-1bb4-4426-86a9-f86a81d1fe01 req-a47fb27d-9bae-4808-9ead-809b19532c5b service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] No waiting events found dispatching network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:36:10 user nova-compute[74311]: WARNING nova.compute.manager [req-3c9ede83-1bb4-4426-86a9-f86a81d1fe01 req-a47fb27d-9bae-4808-9ead-809b19532c5b service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received unexpected event network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 10:36:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Updating instance_info_cache with network_info: [{"id": "aba6ea09-c123-48e0-83d2-294027a059c6", "address": "fa:16:3e:8b:a4:67", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba6ea09-c1", "ovs_interfaceid": "aba6ea09-c123-48e0-83d2-294027a059c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e65d37d3-6067-4c5a-8975-532e455e7c5e tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.621s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:36:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:36:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:12 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:36:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:17 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:36:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:18 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:36:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:18 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:36:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:18 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:36:18 user nova-compute[74311]: INFO nova.compute.claims [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Claim successful on node user
Oct 20 10:36:18 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:36:18 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:36:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:18 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:36:18 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:36:18 user nova-compute[74311]: DEBUG nova.network.neutron [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:36:18 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:36:18 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:36:18 user nova-compute[74311]: DEBUG nova.policy [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9634a3daf064bf2aad6ea38454f7639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7a52d2fa8243fabc22baa8694e14d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:36:18 user nova-compute[74311]: INFO nova.virt.block_device [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Booting with volume 868bce24-4a1a-4f1b-ab42-63ff5a41cf6e at /dev/vda
Oct 20 10:36:19 user nova-compute[74311]: DEBUG os_brick.utils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b81703d-f5fe-4dde-a442-f9dd98d2d4cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[841d2aaa-a6b5-42fa-8c18-8c78fd355563]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a137bd39-1a7d-400d-a896-a2b090bc706a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b975fc19-07b5-43a0-8c63-8f92208c9cf9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:36:19 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4abdc3-5e4c-435c-be12-3ac2b97211d4]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG os_brick.utils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Updating existing volume attachment record: 7a04ebeb-8596-46bf-b2c8-6546d0ee9b5e {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG nova.network.neutron [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Successfully created port: 7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:36:19 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:36:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Successfully updated port: 7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:36:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:36:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquired lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:36:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:36:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-e1fc6251-8b46-4e8a-85c4-5f84919aca2c req-f0881437-0768-4dea-97b6-030602561859 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Received event network-changed-7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:36:20 user nova-compute[74311]: DEBUG nova.compute.manager [req-e1fc6251-8b46-4e8a-85c4-5f84919aca2c req-f0881437-0768-4dea-97b6-030602561859 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Refreshing instance network info cache due to event network-changed-7e285374-bb45-4df4-bdc1-c00d4f8a0cec. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:36:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e1fc6251-8b46-4e8a-85c4-5f84919aca2c req-f0881437-0768-4dea-97b6-030602561859 service nova] Acquiring lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:36:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:36:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Updating instance_info_cache with network_info: [{"id": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "address": "fa:16:3e:c0:ad:40", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e285374-bb", "ovs_interfaceid": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:36:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Releasing lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:36:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Instance network_info: |[{"id": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "address": "fa:16:3e:c0:ad:40", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e285374-bb", "ovs_interfaceid": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:36:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e1fc6251-8b46-4e8a-85c4-5f84919aca2c req-f0881437-0768-4dea-97b6-030602561859 service nova] Acquired lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:36:20 user nova-compute[74311]: DEBUG nova.network.neutron [req-e1fc6251-8b46-4e8a-85c4-5f84919aca2c req-f0881437-0768-4dea-97b6-030602561859 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Refreshing network info cache for port 7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:36:21 user nova-compute[74311]: DEBUG nova.network.neutron [req-e1fc6251-8b46-4e8a-85c4-5f84919aca2c req-f0881437-0768-4dea-97b6-030602561859 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Updated VIF entry in instance network info cache for port 7e285374-bb45-4df4-bdc1-c00d4f8a0cec. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:36:21 user nova-compute[74311]: DEBUG nova.network.neutron [req-e1fc6251-8b46-4e8a-85c4-5f84919aca2c req-f0881437-0768-4dea-97b6-030602561859 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Updating instance_info_cache with network_info: [{"id": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "address": "fa:16:3e:c0:ad:40", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e285374-bb", "ovs_interfaceid": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:36:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e1fc6251-8b46-4e8a-85c4-5f84919aca2c req-f0881437-0768-4dea-97b6-030602561859 service nova] Releasing lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:36:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:22 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:36:22 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:23 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:24 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:25 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:36:25 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:36:25 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8344MB free_disk=25.107513427734375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 593a4f46-9b5b-4a3c-95c7-21712b081069 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 58bba07b-6122-47f7-9cea-44cebe840ced actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 30945ee9-c420-440b-b98d-8dc4922fd216 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 367d718d-35ed-4c04-97f1-518bd0e100e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 8811e708-b8c0-4bad-9d97-2be84aef2cc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "58bba07b-6122-47f7-9cea-44cebe840ced" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "58bba07b-6122-47f7-9cea-44cebe840ced" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:25 user nova-compute[74311]: INFO nova.compute.manager [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Terminating instance
Oct 20 10:36:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-f50b6c9a-6cac-4157-b0ad-c4c961ce96b8 req-89db15cf-d930-405c-88c9-da5fe1d75cb7 service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Received event network-vif-unplugged-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f50b6c9a-6cac-4157-b0ad-c4c961ce96b8 req-89db15cf-d930-405c-88c9-da5fe1d75cb7 service nova] Acquiring lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f50b6c9a-6cac-4157-b0ad-c4c961ce96b8 req-89db15cf-d930-405c-88c9-da5fe1d75cb7 service nova] Lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f50b6c9a-6cac-4157-b0ad-c4c961ce96b8 req-89db15cf-d930-405c-88c9-da5fe1d75cb7 service nova] Lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-f50b6c9a-6cac-4157-b0ad-c4c961ce96b8 req-89db15cf-d930-405c-88c9-da5fe1d75cb7 service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] No waiting events found dispatching network-vif-unplugged-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-f50b6c9a-6cac-4157-b0ad-c4c961ce96b8 req-89db15cf-d930-405c-88c9-da5fe1d75cb7 service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Received event network-vif-unplugged-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:26 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Instance destroyed successfully.
Oct 20 10:36:26 user nova-compute[74311]: DEBUG nova.objects.instance [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lazy-loading 'resources' on Instance uuid 58bba07b-6122-47f7-9cea-44cebe840ced {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-656887913',display_name='tempest-AttachVolumeNegativeTest-server-656887913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-656887913',id=40,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwwhObZmM6ufxyfuoM0Z9AbnThkVvN05epXXLMaeaLkOzSz3+aVK5lFN17gBjkNV/ObE2Zx+fx+TSvfWLpiKBP0hjrdPDS53LzSkpacNOQK9BRuB0iiiYgfo79hgNcGkA==',key_name='tempest-keypair-1660765320',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:33:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e99de7cef4b4569a497f77325515680',ramdisk_id='',reservation_id='r-5bkw3seq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-543930091',owner_user_name='tempest-AttachVolumeNegativeTest-543930091-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='497267775cc747b8b65b8bcb276806ba',uuid=58bba07b-6122-47f7-9cea-44cebe840ced,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "address": "fa:16:3e:e2:9d:6f", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2290e0-26", "ovs_interfaceid": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converting VIF {"id": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "address": "fa:16:3e:e2:9d:6f", "network": {"id": "164538f7-1b65-4bf8-8a6c-31a1ea9c0379", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-507576088-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e99de7cef4b4569a497f77325515680", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b2290e0-26", "ovs_interfaceid": "2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:9d:6f,bridge_name='br-int',has_traffic_filtering=True,id=2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2290e0-26') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG os_vif [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:9d:6f,bridge_name='br-int',has_traffic_filtering=True,id=2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2290e0-26') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b2290e0-26, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=889f1cdb-fb1d-40fb-856a-b7d3c2788035) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:26 user nova-compute[74311]: INFO os_vif [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:9d:6f,bridge_name='br-int',has_traffic_filtering=True,id=2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2,network=Network(164538f7-1b65-4bf8-8a6c-31a1ea9c0379),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b2290e0-26')
Oct 20 10:36:26 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Deleting instance files /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced_del
Oct 20 10:36:26 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Deletion of /opt/stack/data/nova/instances/58bba07b-6122-47f7-9cea-44cebe840ced_del complete
Oct 20 10:36:26 user nova-compute[74311]: INFO nova.compute.manager [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 20 10:36:26 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:36:26 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:36:27 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:36:27 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Took 0.78 seconds to deallocate network for instance.
Oct 20 10:36:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-ffd32ec7-8f7a-4314-b4ed-f9e4ae412954 req-5a4a418f-2591-4ad5-9202-6681e10f3053 service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Received event network-vif-deleted-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:36:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:27 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:36:27 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:36:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:27 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Deleted allocations for instance 58bba07b-6122-47f7-9cea-44cebe840ced
Oct 20 10:36:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-b6344f3f-2cbd-4de4-b1e8-584fda6288a0 tempest-AttachVolumeNegativeTest-543930091 tempest-AttachVolumeNegativeTest-543930091-project-member] Lock "58bba07b-6122-47f7-9cea-44cebe840ced" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.206s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:28 user nova-compute[74311]: DEBUG nova.compute.manager [req-d14192ad-9204-4f55-97c9-ab5e04fbeefd req-a54c1e26-313c-4bb5-909c-9051b4765efe service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Received event network-vif-plugged-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:36:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d14192ad-9204-4f55-97c9-ab5e04fbeefd req-a54c1e26-313c-4bb5-909c-9051b4765efe service nova] Acquiring lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d14192ad-9204-4f55-97c9-ab5e04fbeefd req-a54c1e26-313c-4bb5-909c-9051b4765efe service nova] Lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d14192ad-9204-4f55-97c9-ab5e04fbeefd req-a54c1e26-313c-4bb5-909c-9051b4765efe service nova] Lock "58bba07b-6122-47f7-9cea-44cebe840ced-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:28 user nova-compute[74311]: DEBUG nova.compute.manager [req-d14192ad-9204-4f55-97c9-ab5e04fbeefd req-a54c1e26-313c-4bb5-909c-9051b4765efe service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] No waiting events found dispatching network-vif-plugged-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:36:28 user nova-compute[74311]: WARNING nova.compute.manager [req-d14192ad-9204-4f55-97c9-ab5e04fbeefd req-a54c1e26-313c-4bb5-909c-9051b4765efe service nova] [instance: 58bba07b-6122-47f7-9cea-44cebe840ced] Received unexpected event network-vif-plugged-2b2290e0-265b-4b5e-80dd-d3c13bd5b2b2 for instance with vm_state deleted and task_state None.
Oct 20 10:36:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:36:36 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Creating image(s)
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Ensure instance console log exists: /opt/stack/data/nova/instances/8811e708-b8c0-4bad-9d97-2be84aef2cc6/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Start _get_guest_xml network_info=[{"id": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "address": "fa:16:3e:c0:ad:40", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e285374-bb", "ovs_interfaceid": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '7a04ebeb-8596-46bf-b2c8-6546d0ee9b5e', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiHFhopz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8811e708-b8c0-4bad-9d97-2be84aef2cc6', 'attached_at': '', 'detached_at': '', 'volume_id': '868bce24-4a1a-4f1b-ab42-63ff5a41cf6e', 'serial': '868bce24-4a1a-4f1b-ab42-63ff5a41cf6e'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:36:36 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:36:36 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiHFhopz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:36:36 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:36:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:36:36 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:36:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:36:36 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0559b2f5-a5ae-424e-8623-bde34105d168]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:36:36 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f855aade-dafa-4be1-9961-b9608688fe2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e] added
Oct 20 10:36:36 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b75208b-e7a5-43e9-9497-4439d1740f13]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e9dd71-e9da-41b1-a3cb-b3ac44a2f4eb]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TiHFhopz {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TiHFhopz" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff80082a-1380-4477-a720-f74e0b2127f3]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TiHFhopz'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b7519a-bd88-4192-9290-3feb7d2a18b2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2d24ba-3d9e-46c9-91e7-bd3a374db258]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:36:36 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:36:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:36:36 user nova-compute[74311]:  {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:36:36 user nova-compute[74311]: WARNING os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 10:36:36 user nova-compute[74311]: 
Oct 20 10:36:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c853d188-e274-48f2-861b-cf723491b10e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e, portal: 172.16.0.220,3260]
Oct 20 10:36:37 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e, portal: 172.16.0.220,3260] successful.
Oct 20 10:36:37 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c730b64a-e614-4b0c-b5ba-9b3d56525ad0]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[48380ea8-985d-45b4-a233-c0ac81b55791]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)
Oct 20 10:36:37 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)
Oct 20 10:36:37 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6d07b5-0c67-4abe-a720-5303fc65b1e9]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:36:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiHFhopz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23534636135663866', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534636135663866', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1631446642',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1631446642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1631446642',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1sJyBjXjXv0pRBMw6yc3o2S51p0QTt1TWngjomhI0WAcwDzE9Aw8ZRqJf6z5nLH/cM0U5XbjAij1G2xJj2toy2ud+vtHTA/xbUQQhkd5hALRtCc3RDxc24CHIlvaWVVw==',key_name='tempest-keypair-973036274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-hkpalzej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:36:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=8811e708-b8c0-4bad-9d97-2be84aef2cc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "address": "fa:16:3e:c0:ad:40", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e285374-bb", "ovs_interfaceid": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "address": "fa:16:3e:c0:ad:40", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e285374-bb", "ovs_interfaceid": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ad:40,bridge_name='br-int',has_traffic_filtering=True,id=7e285374-bb45-4df4-bdc1-c00d4f8a0cec,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e285374-bb') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.objects.instance [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lazy-loading 'pci_devices' on Instance uuid 8811e708-b8c0-4bad-9d97-2be84aef2cc6 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:36:38 user nova-compute[74311]:   <uuid>8811e708-b8c0-4bad-9d97-2be84aef2cc6</uuid>
Oct 20 10:36:38 user nova-compute[74311]:   <name>instance-0000002a</name>
Oct 20 10:36:38 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:36:38 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:36:38 user nova-compute[74311]:   <metadata>
Oct 20 10:36:38 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:36:38 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:36:38 user nova-compute[74311]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1631446642</nova:name>
Oct 20 10:36:38 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:36:36</nova:creationTime>
Oct 20 10:36:38 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:36:38 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:36:38 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:36:38 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:36:38 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:36:38 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:36:38 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:36:38 user nova-compute[74311]:       <nova:owner>
Oct 20 10:36:38 user nova-compute[74311]:         <nova:user uuid="f9634a3daf064bf2aad6ea38454f7639">tempest-TestVolumeBootPattern-1419375529-project-member</nova:user>
Oct 20 10:36:38 user nova-compute[74311]:         <nova:project uuid="aa7a52d2fa8243fabc22baa8694e14d6">tempest-TestVolumeBootPattern-1419375529</nova:project>
Oct 20 10:36:38 user nova-compute[74311]:       </nova:owner>
Oct 20 10:36:38 user nova-compute[74311]:       <nova:ports>
Oct 20 10:36:38 user nova-compute[74311]:         <nova:port uuid="7e285374-bb45-4df4-bdc1-c00d4f8a0cec">
Oct 20 10:36:38 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 10:36:38 user nova-compute[74311]:         </nova:port>
Oct 20 10:36:38 user nova-compute[74311]:       </nova:ports>
Oct 20 10:36:38 user nova-compute[74311]:     </nova:instance>
Oct 20 10:36:38 user nova-compute[74311]:   </metadata>
Oct 20 10:36:38 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:36:38 user nova-compute[74311]:     <system>
Oct 20 10:36:38 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:36:38 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:36:38 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:36:38 user nova-compute[74311]:       <entry name="serial">8811e708-b8c0-4bad-9d97-2be84aef2cc6</entry>
Oct 20 10:36:38 user nova-compute[74311]:       <entry name="uuid">8811e708-b8c0-4bad-9d97-2be84aef2cc6</entry>
Oct 20 10:36:38 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:36:38 user nova-compute[74311]:     </system>
Oct 20 10:36:38 user nova-compute[74311]:   </sysinfo>
Oct 20 10:36:38 user nova-compute[74311]:   <os>
Oct 20 10:36:38 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:36:38 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:36:38 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:36:38 user nova-compute[74311]:   </os>
Oct 20 10:36:38 user nova-compute[74311]:   <features>
Oct 20 10:36:38 user nova-compute[74311]:     <acpi/>
Oct 20 10:36:38 user nova-compute[74311]:     <apic/>
Oct 20 10:36:38 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:36:38 user nova-compute[74311]:   </features>
Oct 20 10:36:38 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:36:38 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:36:38 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:36:38 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:36:38 user nova-compute[74311]:   </clock>
Oct 20 10:36:38 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:36:38 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:36:38 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:36:38 user nova-compute[74311]:   </cpu>
Oct 20 10:36:38 user nova-compute[74311]:   <devices>
Oct 20 10:36:38 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:36:38 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:36:38 user nova-compute[74311]:       <source dev="/dev/sdb"/>
Oct 20 10:36:38 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:36:38 user nova-compute[74311]:       <serial>868bce24-4a1a-4f1b-ab42-63ff5a41cf6e</serial>
Oct 20 10:36:38 user nova-compute[74311]:     </disk>
Oct 20 10:36:38 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:36:38 user nova-compute[74311]:       <mac address="fa:16:3e:c0:ad:40"/>
Oct 20 10:36:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:36:38 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:36:38 user nova-compute[74311]:       <target dev="tap7e285374-bb"/>
Oct 20 10:36:38 user nova-compute[74311]:     </interface>
Oct 20 10:36:38 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:36:38 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/8811e708-b8c0-4bad-9d97-2be84aef2cc6/console.log" append="off"/>
Oct 20 10:36:38 user nova-compute[74311]:     </serial>
Oct 20 10:36:38 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:36:38 user nova-compute[74311]:     <video>
Oct 20 10:36:38 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:36:38 user nova-compute[74311]:     </video>
Oct 20 10:36:38 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:36:38 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:36:38 user nova-compute[74311]:     </rng>
Oct 20 10:36:38 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:36:38 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:36:38 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:36:38 user nova-compute[74311]:     </memballoon>
Oct 20 10:36:38 user nova-compute[74311]:   </devices>
Oct 20 10:36:38 user nova-compute[74311]: </domain>
Oct 20 10:36:38 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1631446642',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1631446642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1631446642',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1sJyBjXjXv0pRBMw6yc3o2S51p0QTt1TWngjomhI0WAcwDzE9Aw8ZRqJf6z5nLH/cM0U5XbjAij1G2xJj2toy2ud+vtHTA/xbUQQhkd5hALRtCc3RDxc24CHIlvaWVVw==',key_name='tempest-keypair-973036274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-hkpalzej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:36:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=8811e708-b8c0-4bad-9d97-2be84aef2cc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "address": "fa:16:3e:c0:ad:40", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e285374-bb", "ovs_interfaceid": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "address": "fa:16:3e:c0:ad:40", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e285374-bb", "ovs_interfaceid": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ad:40,bridge_name='br-int',has_traffic_filtering=True,id=7e285374-bb45-4df4-bdc1-c00d4f8a0cec,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e285374-bb') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG os_vif [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ad:40,bridge_name='br-int',has_traffic_filtering=True,id=7e285374-bb45-4df4-bdc1-c00d4f8a0cec,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e285374-bb') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31bdb082-0e66-5871-a960-a5198a971464', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e285374-bb, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e285374-bb, col_values=(('qos', UUID('a7e53cf5-5603-4f20-870e-702ded686bdd')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e285374-bb, col_values=(('external_ids', {'iface-id': '7e285374-bb45-4df4-bdc1-c00d4f8a0cec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:ad:40', 'vm-uuid': '8811e708-b8c0-4bad-9d97-2be84aef2cc6'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:38 user nova-compute[74311]: INFO os_vif [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ad:40,bridge_name='br-int',has_traffic_filtering=True,id=7e285374-bb45-4df4-bdc1-c00d4f8a0cec,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e285374-bb')
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] No VIF found with MAC fa:16:3e:c0:ad:40, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.compute.manager [req-bd2161a2-8e8b-4b69-9de3-eb0f63f80b31 req-d8af0438-dd43-4296-b8dc-de694e3da2ee service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Received event network-changed-368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.compute.manager [req-bd2161a2-8e8b-4b69-9de3-eb0f63f80b31 req-d8af0438-dd43-4296-b8dc-de694e3da2ee service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Refreshing instance network info cache due to event network-changed-368cb7d7-e072-416a-bf32-339c43e90aa2. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bd2161a2-8e8b-4b69-9de3-eb0f63f80b31 req-d8af0438-dd43-4296-b8dc-de694e3da2ee service nova] Acquiring lock "refresh_cache-30945ee9-c420-440b-b98d-8dc4922fd216" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bd2161a2-8e8b-4b69-9de3-eb0f63f80b31 req-d8af0438-dd43-4296-b8dc-de694e3da2ee service nova] Acquired lock "refresh_cache-30945ee9-c420-440b-b98d-8dc4922fd216" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.network.neutron [req-bd2161a2-8e8b-4b69-9de3-eb0f63f80b31 req-d8af0438-dd43-4296-b8dc-de694e3da2ee service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Refreshing network info cache for port 368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "30945ee9-c420-440b-b98d-8dc4922fd216" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "30945ee9-c420-440b-b98d-8dc4922fd216" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:38 user nova-compute[74311]: INFO nova.compute.manager [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Terminating instance
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.network.neutron [req-bd2161a2-8e8b-4b69-9de3-eb0f63f80b31 req-d8af0438-dd43-4296-b8dc-de694e3da2ee service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Updated VIF entry in instance network info cache for port 368cb7d7-e072-416a-bf32-339c43e90aa2. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG nova.network.neutron [req-bd2161a2-8e8b-4b69-9de3-eb0f63f80b31 req-d8af0438-dd43-4296-b8dc-de694e3da2ee service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Updating instance_info_cache with network_info: [{"id": "368cb7d7-e072-416a-bf32-339c43e90aa2", "address": "fa:16:3e:2c:ab:73", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368cb7d7-e0", "ovs_interfaceid": "368cb7d7-e072-416a-bf32-339c43e90aa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bd2161a2-8e8b-4b69-9de3-eb0f63f80b31 req-d8af0438-dd43-4296-b8dc-de694e3da2ee service nova] Releasing lock "refresh_cache-30945ee9-c420-440b-b98d-8dc4922fd216" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:36:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:39 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Instance destroyed successfully.
Oct 20 10:36:39 user nova-compute[74311]: DEBUG nova.objects.instance [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lazy-loading 'resources' on Instance uuid 30945ee9-c420-440b-b98d-8dc4922fd216 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:36:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:33:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-148394141',display_name='tempest-TestStampPattern-server-148394141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-148394141',id=41,image_ref='1bba3ee3-c88b-4c91-bb86-b43edb98c5e7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxIz+AOQh5BFtvQDWoLXblBp+TB3fi3MeSA/3rUAks7ejyqHfrxlBfgqB6oyecw1P0xdLVr8KQzmCjxwt7BESaDUHM3Wwh/O99KdQsg36VfSYG5rbhAc/v9D0kkQRONKQ==',key_name='tempest-TestStampPattern-1298176157',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:33:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8eccbc22a0844e5864eb2e4d4c8f3f9',ramdisk_id='',reservation_id='r-vcm0hvze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='593a4f46-9b5b-4a3c-95c7-21712b081069',image_min_disk='1',image_min_ram='0',image_owner_id='f8eccbc22a0844e5864eb2e4d4c8f3f9',image_owner_project_name='tempest-TestStampPattern-1787276252',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1787276252-project-member',image_user_id='3e90400e50b143a09e2936ed67ea5c77',owner_project_name='tempest-TestStampPattern-1787276252',owner_user_name='tempest-TestStampPattern-1787276252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:33:43Z,user_data=None,user_id='3e90400e50b143a09e2936ed67ea5c77',uuid=30945ee9-c420-440b-b98d-8dc4922fd216,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "368cb7d7-e072-416a-bf32-339c43e90aa2", "address": "fa:16:3e:2c:ab:73", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368cb7d7-e0", "ovs_interfaceid": "368cb7d7-e072-416a-bf32-339c43e90aa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:36:39 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Converting VIF {"id": "368cb7d7-e072-416a-bf32-339c43e90aa2", "address": "fa:16:3e:2c:ab:73", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap368cb7d7-e0", "ovs_interfaceid": "368cb7d7-e072-416a-bf32-339c43e90aa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:36:39 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=368cb7d7-e072-416a-bf32-339c43e90aa2,network=Network(e3e17086-dc82-40b0-8b51-655f5083b429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368cb7d7-e0') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:36:39 user nova-compute[74311]: DEBUG os_vif [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=368cb7d7-e072-416a-bf32-339c43e90aa2,network=Network(e3e17086-dc82-40b0-8b51-655f5083b429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368cb7d7-e0') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:36:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap368cb7d7-e0, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:36:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4b41460-3bb0-4628-8c4d-c09feab74809) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:36:40 user nova-compute[74311]: INFO os_vif [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:ab:73,bridge_name='br-int',has_traffic_filtering=True,id=368cb7d7-e072-416a-bf32-339c43e90aa2,network=Network(e3e17086-dc82-40b0-8b51-655f5083b429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap368cb7d7-e0')
Oct 20 10:36:40 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Deleting instance files /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216_del
Oct 20 10:36:40 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Deletion of /opt/stack/data/nova/instances/30945ee9-c420-440b-b98d-8dc4922fd216_del complete
Oct 20 10:36:40 user nova-compute[74311]: INFO nova.compute.manager [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Took 1.65 seconds to destroy the instance on the hypervisor.
Oct 20 10:36:40 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Received event network-vif-unplugged-368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] Acquiring lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] Lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] Lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] No waiting events found dispatching network-vif-unplugged-368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Received event network-vif-unplugged-368cb7d7-e072-416a-bf32-339c43e90aa2 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Received event network-vif-plugged-368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] Acquiring lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] Lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] Lock "30945ee9-c420-440b-b98d-8dc4922fd216-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] No waiting events found dispatching network-vif-plugged-368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:36:40 user nova-compute[74311]: WARNING nova.compute.manager [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Received unexpected event network-vif-plugged-368cb7d7-e072-416a-bf32-339c43e90aa2 for instance with vm_state active and task_state deleting.
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Received event network-vif-plugged-7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] Acquiring lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] No waiting events found dispatching network-vif-plugged-7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:36:40 user nova-compute[74311]: WARNING nova.compute.manager [req-fe05f7b4-e6df-4476-81ca-cbb61c2a512d req-45821195-e06c-44eb-8184-27742ac59cbc service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Received unexpected event network-vif-plugged-7e285374-bb45-4df4-bdc1-c00d4f8a0cec for instance with vm_state building and task_state spawning.
Oct 20 10:36:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:36:40 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Took 0.56 seconds to deallocate network for instance.
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-b3bf0797-98eb-45df-9b5b-fc0e4629c03b req-ef4ed0b4-b132-4c91-b3f9-47ff798c998c service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Received event network-vif-deleted-368cb7d7-e072-416a-bf32-339c43e90aa2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:36:40 user nova-compute[74311]: INFO nova.compute.manager [req-b3bf0797-98eb-45df-9b5b-fc0e4629c03b req-ef4ed0b4-b132-4c91-b3f9-47ff798c998c service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Neutron deleted interface 368cb7d7-e072-416a-bf32-339c43e90aa2; detaching it from the instance and deleting it from the info cache
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.network.neutron [req-b3bf0797-98eb-45df-9b5b-fc0e4629c03b req-ef4ed0b4-b132-4c91-b3f9-47ff798c998c service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.compute.manager [req-b3bf0797-98eb-45df-9b5b-fc0e4629c03b req-ef4ed0b4-b132-4c91-b3f9-47ff798c998c service nova] [instance: 30945ee9-c420-440b-b98d-8dc4922fd216] Detach interface failed, port_id=368cb7d7-e072-416a-bf32-339c43e90aa2, reason: Instance 30945ee9-c420-440b-b98d-8dc4922fd216 could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:36:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:40 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Deleted allocations for instance 30945ee9-c420-440b-b98d-8dc4922fd216
Oct 20 10:36:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-d258a514-86d4-430f-bd35-198314e8758e tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "30945ee9-c420-440b-b98d-8dc4922fd216" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.596s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:42 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:36:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:36:42 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Instance spawned successfully.
Oct 20 10:36:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:36:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:36:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:36:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:36:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:36:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:36:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:36:42 user nova-compute[74311]: INFO nova.compute.manager [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Took 5.66 seconds to spawn the instance on the hypervisor.
Oct 20 10:36:42 user nova-compute[74311]: DEBUG nova.compute.manager [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:36:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-2b790666-bf37-47a2-be85-86baa9bca2eb req-403141ad-6d3d-4bca-9cf9-0c203af5fca1 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Received event network-vif-plugged-7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:36:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2b790666-bf37-47a2-be85-86baa9bca2eb req-403141ad-6d3d-4bca-9cf9-0c203af5fca1 service nova] Acquiring lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:36:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2b790666-bf37-47a2-be85-86baa9bca2eb req-403141ad-6d3d-4bca-9cf9-0c203af5fca1 service nova] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:36:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2b790666-bf37-47a2-be85-86baa9bca2eb req-403141ad-6d3d-4bca-9cf9-0c203af5fca1 service nova] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-2b790666-bf37-47a2-be85-86baa9bca2eb req-403141ad-6d3d-4bca-9cf9-0c203af5fca1 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] No waiting events found dispatching network-vif-plugged-7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:36:42 user nova-compute[74311]: WARNING nova.compute.manager [req-2b790666-bf37-47a2-be85-86baa9bca2eb req-403141ad-6d3d-4bca-9cf9-0c203af5fca1 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Received unexpected event network-vif-plugged-7e285374-bb45-4df4-bdc1-c00d4f8a0cec for instance with vm_state building and task_state spawning.
Oct 20 10:36:42 user nova-compute[74311]: INFO nova.compute.manager [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Took 24.21 seconds to build instance.
Oct 20 10:36:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-f8b9f6ed-676a-45dd-b518-70bd0cef9f12 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.335s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:36:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:36:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:36:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:13 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:37:13 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:37:13 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Didn't find any instances for network info cache update. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 10:37:13 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:37:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:18 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:37:18 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:37:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:37:20 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:37:23 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:37:24 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:37:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:37:26 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:37:26 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:37:26 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8479MB free_disk=25.13272476196289GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:37:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:37:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:37:26 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 593a4f46-9b5b-4a3c-95c7-21712b081069 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:37:26 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 367d718d-35ed-4c04-97f1-518bd0e100e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:37:26 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 8811e708-b8c0-4bad-9d97-2be84aef2cc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:37:26 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:37:26 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:37:26 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:37:26 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:37:26 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:37:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:37:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:37:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:37:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:37:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:37:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:37:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:37:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:37:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:37:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "367d718d-35ed-4c04-97f1-518bd0e100e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:37:49 user nova-compute[74311]: INFO nova.compute.manager [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Terminating instance
Oct 20 10:37:49 user nova-compute[74311]: DEBUG nova.compute.manager [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG nova.compute.manager [req-4fc9a17d-4a0d-44fb-9c09-fd81212f9c90 req-9b6e6c2a-40aa-4f9b-96f7-fd77a650481a service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received event network-vif-unplugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4fc9a17d-4a0d-44fb-9c09-fd81212f9c90 req-9b6e6c2a-40aa-4f9b-96f7-fd77a650481a service nova] Acquiring lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4fc9a17d-4a0d-44fb-9c09-fd81212f9c90 req-9b6e6c2a-40aa-4f9b-96f7-fd77a650481a service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4fc9a17d-4a0d-44fb-9c09-fd81212f9c90 req-9b6e6c2a-40aa-4f9b-96f7-fd77a650481a service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG nova.compute.manager [req-4fc9a17d-4a0d-44fb-9c09-fd81212f9c90 req-9b6e6c2a-40aa-4f9b-96f7-fd77a650481a service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] No waiting events found dispatching network-vif-unplugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG nova.compute.manager [req-4fc9a17d-4a0d-44fb-9c09-fd81212f9c90 req-9b6e6c2a-40aa-4f9b-96f7-fd77a650481a service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received event network-vif-unplugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG nova.compute.manager [req-01a97835-15a2-4e1d-9edb-052c43587c98 req-d60e529f-19ee-496c-89f7-de19530dfb98 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Received event network-changed-aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG nova.compute.manager [req-01a97835-15a2-4e1d-9edb-052c43587c98 req-d60e529f-19ee-496c-89f7-de19530dfb98 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Refreshing instance network info cache due to event network-changed-aba6ea09-c123-48e0-83d2-294027a059c6. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01a97835-15a2-4e1d-9edb-052c43587c98 req-d60e529f-19ee-496c-89f7-de19530dfb98 service nova] Acquiring lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01a97835-15a2-4e1d-9edb-052c43587c98 req-d60e529f-19ee-496c-89f7-de19530dfb98 service nova] Acquired lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG nova.network.neutron [req-01a97835-15a2-4e1d-9edb-052c43587c98 req-d60e529f-19ee-496c-89f7-de19530dfb98 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Refreshing network info cache for port aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:37:49 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Instance destroyed successfully.
Oct 20 10:37:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lazy-loading 'resources' on Instance uuid 367d718d-35ed-4c04-97f1-518bd0e100e1 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T10:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1498909758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1498909758',id=38,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFAyNyoWbqBGNHspCEvJSsMifFaHIZT0jvn4njT9y2I+nD2XcODIHjztrXyWlfAc6OSESgmSstTATclIJ28rApf+mhllBPFUkRHyqMXHz5Qx0b0y8PhQHxZwmk17YvZog==',key_name='tempest-keypair-1460218868',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:36:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61fab5f8b38b490985cc614ade80f25a',ramdisk_id='',reservation_id='r-fzi5czat',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1592971712',owner_user_name='tempest-AttachVolumeShelveTestJSON-1592971712-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:36:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fe1aad9aa1e64a9db4f78c0c12779300',uuid=367d718d-35ed-4c04-97f1-518bd0e100e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converting VIF {"id": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "address": "fa:16:3e:79:37:50", "network": {"id": "f18a7f08-d7e2-4b8d-a677-482d756e8ed3", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1807135517-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61fab5f8b38b490985cc614ade80f25a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7cf7ba1-9f", "ovs_interfaceid": "b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:50,bridge_name='br-int',has_traffic_filtering=True,id=b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cf7ba1-9f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG os_vif [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:50,bridge_name='br-int',has_traffic_filtering=True,id=b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cf7ba1-9f') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7cf7ba1-9f, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "593a4f46-9b5b-4a3c-95c7-21712b081069" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:37:49 user nova-compute[74311]: INFO nova.compute.manager [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Terminating instance
Oct 20 10:37:49 user nova-compute[74311]: DEBUG nova.compute.manager [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2011de0c-7d5a-41a4-9aa3-3f40cbb117db) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:37:49 user nova-compute[74311]: INFO os_vif [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:37:50,bridge_name='br-int',has_traffic_filtering=True,id=b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7,network=Network(f18a7f08-d7e2-4b8d-a677-482d756e8ed3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7cf7ba1-9f')
Oct 20 10:37:49 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Deleting instance files /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1_del
Oct 20 10:37:49 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Deletion of /opt/stack/data/nova/instances/367d718d-35ed-4c04-97f1-518bd0e100e1_del complete
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:49 user nova-compute[74311]: INFO nova.compute.manager [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Took 0.78 seconds to destroy the instance on the hypervisor.
Oct 20 10:37:49 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:37:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:50 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Instance destroyed successfully.
Oct 20 10:37:50 user nova-compute[74311]: DEBUG nova.objects.instance [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lazy-loading 'resources' on Instance uuid 593a4f46-9b5b-4a3c-95c7-21712b081069 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:30:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2049730992',display_name='tempest-TestStampPattern-server-2049730992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2049730992',id=37,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxIz+AOQh5BFtvQDWoLXblBp+TB3fi3MeSA/3rUAks7ejyqHfrxlBfgqB6oyecw1P0xdLVr8KQzmCjxwt7BESaDUHM3Wwh/O99KdQsg36VfSYG5rbhAc/v9D0kkQRONKQ==',key_name='tempest-TestStampPattern-1298176157',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:30:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8eccbc22a0844e5864eb2e4d4c8f3f9',ramdisk_id='',reservation_id='r-4aqr1zl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1787276252',owner_user_name='tempest-TestStampPattern-1787276252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:33:31Z,user_data=None,user_id='3e90400e50b143a09e2936ed67ea5c77',uuid=593a4f46-9b5b-4a3c-95c7-21712b081069,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aba6ea09-c123-48e0-83d2-294027a059c6", "address": "fa:16:3e:8b:a4:67", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba6ea09-c1", "ovs_interfaceid": "aba6ea09-c123-48e0-83d2-294027a059c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Converting VIF {"id": "aba6ea09-c123-48e0-83d2-294027a059c6", "address": "fa:16:3e:8b:a4:67", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba6ea09-c1", "ovs_interfaceid": "aba6ea09-c123-48e0-83d2-294027a059c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:a4:67,bridge_name='br-int',has_traffic_filtering=True,id=aba6ea09-c123-48e0-83d2-294027a059c6,network=Network(e3e17086-dc82-40b0-8b51-655f5083b429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba6ea09-c1') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG os_vif [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:a4:67,bridge_name='br-int',has_traffic_filtering=True,id=aba6ea09-c123-48e0-83d2-294027a059c6,network=Network(e3e17086-dc82-40b0-8b51-655f5083b429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba6ea09-c1') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaba6ea09-c1, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f582f21-fb9b-49bc-819f-b93aa9e6330f) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:50 user nova-compute[74311]: INFO os_vif [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:a4:67,bridge_name='br-int',has_traffic_filtering=True,id=aba6ea09-c123-48e0-83d2-294027a059c6,network=Network(e3e17086-dc82-40b0-8b51-655f5083b429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaba6ea09-c1')
Oct 20 10:37:50 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Deleting instance files /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069_del
Oct 20 10:37:50 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Deletion of /opt/stack/data/nova/instances/593a4f46-9b5b-4a3c-95c7-21712b081069_del complete
Oct 20 10:37:50 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:37:50 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Took 0.96 seconds to deallocate network for instance.
Oct 20 10:37:50 user nova-compute[74311]: INFO nova.compute.manager [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Took 1.09 seconds to destroy the instance on the hypervisor.
Oct 20 10:37:50 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:37:50 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-b5be3d2c-fcc6-467d-948b-75c80041936b req-2d0566c7-c768-4c81-8b9f-5a20c6e38670 service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received event network-vif-deleted-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.network.neutron [req-01a97835-15a2-4e1d-9edb-052c43587c98 req-d60e529f-19ee-496c-89f7-de19530dfb98 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Updated VIF entry in instance network info cache for port aba6ea09-c123-48e0-83d2-294027a059c6. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.network.neutron [req-01a97835-15a2-4e1d-9edb-052c43587c98 req-d60e529f-19ee-496c-89f7-de19530dfb98 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Updating instance_info_cache with network_info: [{"id": "aba6ea09-c123-48e0-83d2-294027a059c6", "address": "fa:16:3e:8b:a4:67", "network": {"id": "e3e17086-dc82-40b0-8b51-655f5083b429", "bridge": "br-int", "label": "tempest-TestStampPattern-1273640330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8eccbc22a0844e5864eb2e4d4c8f3f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaba6ea09-c1", "ovs_interfaceid": "aba6ea09-c123-48e0-83d2-294027a059c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-01a97835-15a2-4e1d-9edb-052c43587c98 req-d60e529f-19ee-496c-89f7-de19530dfb98 service nova] Releasing lock "refresh_cache-593a4f46-9b5b-4a3c-95c7-21712b081069" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:37:51 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Deleted allocations for instance 367d718d-35ed-4c04-97f1-518bd0e100e1
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-da6aab5e-c073-4d7b-9dcd-292054c1c1fc tempest-AttachVolumeShelveTestJSON-1592971712 tempest-AttachVolumeShelveTestJSON-1592971712-project-member] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received event network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] Acquiring lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] Lock "367d718d-35ed-4c04-97f1-518bd0e100e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] No waiting events found dispatching network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:37:51 user nova-compute[74311]: WARNING nova.compute.manager [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] [instance: 367d718d-35ed-4c04-97f1-518bd0e100e1] Received unexpected event network-vif-plugged-b7cf7ba1-9fae-42f7-afbf-a8823b40f3a7 for instance with vm_state deleted and task_state None.
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Received event network-vif-unplugged-aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] Acquiring lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] No waiting events found dispatching network-vif-unplugged-aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Received event network-vif-unplugged-aba6ea09-c123-48e0-83d2-294027a059c6 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Received event network-vif-plugged-aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] Acquiring lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.compute.manager [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] No waiting events found dispatching network-vif-plugged-aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:37:51 user nova-compute[74311]: WARNING nova.compute.manager [req-0646a183-f481-4060-b63e-c496e0a56b5d req-5aed6858-eda5-4fac-b4ac-50fe5337a45f service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Received unexpected event network-vif-plugged-aba6ea09-c123-48e0-83d2-294027a059c6 for instance with vm_state active and task_state deleting.
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:37:51 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Took 0.73 seconds to deallocate network for instance.
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:37:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:37:51 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Deleted allocations for instance 593a4f46-9b5b-4a3c-95c7-21712b081069
Oct 20 10:37:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c1fc6793-9307-4bf8-99a2-175674819572 tempest-TestStampPattern-1787276252 tempest-TestStampPattern-1787276252-project-member] Lock "593a4f46-9b5b-4a3c-95c7-21712b081069" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.193s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:37:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:37:53 user nova-compute[74311]: DEBUG nova.compute.manager [req-1c12f5f6-a7fc-4145-87fe-9bffe30f9255 req-3d170493-edca-451e-8b85-8f614ae1af66 service nova] [instance: 593a4f46-9b5b-4a3c-95c7-21712b081069] Received event network-vif-deleted-aba6ea09-c123-48e0-83d2-294027a059c6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:37:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:38:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:38:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:38:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:38:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-5f36601b-3a4b-41c6-a21e-e59edb8f7818 req-653f55e6-1d7f-4b82-804b-9721b1f2c8d4 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Received event network-changed-7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:38:09 user nova-compute[74311]: DEBUG nova.compute.manager [req-5f36601b-3a4b-41c6-a21e-e59edb8f7818 req-653f55e6-1d7f-4b82-804b-9721b1f2c8d4 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Refreshing instance network info cache due to event network-changed-7e285374-bb45-4df4-bdc1-c00d4f8a0cec. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:38:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5f36601b-3a4b-41c6-a21e-e59edb8f7818 req-653f55e6-1d7f-4b82-804b-9721b1f2c8d4 service nova] Acquiring lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:38:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5f36601b-3a4b-41c6-a21e-e59edb8f7818 req-653f55e6-1d7f-4b82-804b-9721b1f2c8d4 service nova] Acquired lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:38:09 user nova-compute[74311]: DEBUG nova.network.neutron [req-5f36601b-3a4b-41c6-a21e-e59edb8f7818 req-653f55e6-1d7f-4b82-804b-9721b1f2c8d4 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Refreshing network info cache for port 7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:38:10 user nova-compute[74311]: DEBUG nova.network.neutron [req-5f36601b-3a4b-41c6-a21e-e59edb8f7818 req-653f55e6-1d7f-4b82-804b-9721b1f2c8d4 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Updated VIF entry in instance network info cache for port 7e285374-bb45-4df4-bdc1-c00d4f8a0cec. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:38:10 user nova-compute[74311]: DEBUG nova.network.neutron [req-5f36601b-3a4b-41c6-a21e-e59edb8f7818 req-653f55e6-1d7f-4b82-804b-9721b1f2c8d4 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Updating instance_info_cache with network_info: [{"id": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "address": "fa:16:3e:c0:ad:40", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e285374-bb", "ovs_interfaceid": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:38:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5f36601b-3a4b-41c6-a21e-e59edb8f7818 req-653f55e6-1d7f-4b82-804b-9721b1f2c8d4 service nova] Releasing lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:38:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:12 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:38:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:38:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:38:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:38:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:38:12 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:38:12 user nova-compute[74311]: DEBUG nova.objects.instance [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lazy-loading 'info_cache' on Instance uuid 8811e708-b8c0-4bad-9d97-2be84aef2cc6 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:38:13 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Updating instance_info_cache with network_info: [{"id": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "address": "fa:16:3e:c0:ad:40", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e285374-bb", "ovs_interfaceid": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:38:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:38:13 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:38:13 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:38:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:18 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:38:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:20 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:38:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:22 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:38:23 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:38:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "748f9ac3-6911-4de4-99cc-af5949dc08c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:38:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:38:23 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:38:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:38:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:38:24 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:38:24 user nova-compute[74311]: INFO nova.compute.claims [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Claim successful on node user
Oct 20 10:38:24 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Refreshing inventories for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 10:38:24 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Updating ProviderTree inventory for provider 77cac819-3c22-4fec-a59d-0525ac40a90b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 10:38:24 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Updating inventory in ProviderTree for provider 77cac819-3c22-4fec-a59d-0525ac40a90b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 10:38:24 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Refreshing aggregate associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, aggregates: None {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 10:38:24 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Refreshing trait associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3 {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 10:38:24 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:38:24 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:38:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:38:24 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:38:24 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:38:24 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:38:24 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:38:24 user nova-compute[74311]: DEBUG nova.policy [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9634a3daf064bf2aad6ea38454f7639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7a52d2fa8243fabc22baa8694e14d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:38:24 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:38:24 user nova-compute[74311]: INFO nova.virt.block_device [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Booting with volume snapshot 21e6d0b7-a358-4e21-9306-f1ea54afd188 at /dev/vda
Oct 20 10:38:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "44395e02-246c-4923-b163-51289db5d1a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:38:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "44395e02-246c-4923-b163-51289db5d1a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:38:24 user nova-compute[74311]: DEBUG nova.compute.manager [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:38:25 user nova-compute[74311]: INFO nova.compute.claims [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Claim successful on node user
Oct 20 10:38:25 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Successfully created port: 80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG nova.network.neutron [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:38:25 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:38:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG nova.policy [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4dda3552abdb4cee967ce9cac71580ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e14e8b4071d4f0591e65fededd0f2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:38:25 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Creating image(s)
Oct 20 10:38:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "/opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "/opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "/opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.212s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.208s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:25 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk 1073741824" returned: 0 in 0.107s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Successfully updated port: 80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "refresh_cache-748f9ac3-6911-4de4-99cc-af5949dc08c8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquired lock "refresh_cache-748f9ac3-6911-4de4-99cc-af5949dc08c8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-624cb89d-e216-4afc-9d8e-ec267a9a91c0 req-8942c291-365a-406f-8dd8-b13e7f761dff service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Received event network-changed-80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-624cb89d-e216-4afc-9d8e-ec267a9a91c0 req-8942c291-365a-406f-8dd8-b13e7f761dff service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Refreshing instance network info cache due to event network-changed-80f19c68-2ef9-482b-b88e-c44912e8cfd2. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-624cb89d-e216-4afc-9d8e-ec267a9a91c0 req-8942c291-365a-406f-8dd8-b13e7f761dff service nova] Acquiring lock "refresh_cache-748f9ac3-6911-4de4-99cc-af5949dc08c8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.245s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.network.neutron [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Successfully created port: 31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Updating instance_info_cache with network_info: [{"id": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "address": "fa:16:3e:85:61:93", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f19c68-2e", "ovs_interfaceid": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Cannot resize image /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Ensure instance console log exists: /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Releasing lock "refresh_cache-748f9ac3-6911-4de4-99cc-af5949dc08c8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Instance network_info: |[{"id": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "address": "fa:16:3e:85:61:93", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f19c68-2e", "ovs_interfaceid": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-624cb89d-e216-4afc-9d8e-ec267a9a91c0 req-8942c291-365a-406f-8dd8-b13e7f761dff service nova] Acquired lock "refresh_cache-748f9ac3-6911-4de4-99cc-af5949dc08c8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.network.neutron [req-624cb89d-e216-4afc-9d8e-ec267a9a91c0 req-8942c291-365a-406f-8dd8-b13e7f761dff service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Refreshing network info cache for port 80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.network.neutron [req-624cb89d-e216-4afc-9d8e-ec267a9a91c0 req-8942c291-365a-406f-8dd8-b13e7f761dff service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Updated VIF entry in instance network info cache for port 80f19c68-2ef9-482b-b88e-c44912e8cfd2. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG nova.network.neutron [req-624cb89d-e216-4afc-9d8e-ec267a9a91c0 req-8942c291-365a-406f-8dd8-b13e7f761dff service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Updating instance_info_cache with network_info: [{"id": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "address": "fa:16:3e:85:61:93", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f19c68-2e", "ovs_interfaceid": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:38:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-624cb89d-e216-4afc-9d8e-ec267a9a91c0 req-8942c291-365a-406f-8dd8-b13e7f761dff service nova] Releasing lock "refresh_cache-748f9ac3-6911-4de4-99cc-af5949dc08c8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.network.neutron [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Successfully updated port: 31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-51c57a28-c7d4-4711-bfe8-b253d2942e4c req-47207027-ac44-4cbe-8090-d4f50f215e46 service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Received event network-changed-31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-51c57a28-c7d4-4711-bfe8-b253d2942e4c req-47207027-ac44-4cbe-8090-d4f50f215e46 service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Refreshing instance network info cache due to event network-changed-31d31b6a-108f-4dc6-b217-3d474fac787d. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-51c57a28-c7d4-4711-bfe8-b253d2942e4c req-47207027-ac44-4cbe-8090-d4f50f215e46 service nova] Acquiring lock "refresh_cache-44395e02-246c-4923-b163-51289db5d1a3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-51c57a28-c7d4-4711-bfe8-b253d2942e4c req-47207027-ac44-4cbe-8090-d4f50f215e46 service nova] Acquired lock "refresh_cache-44395e02-246c-4923-b163-51289db5d1a3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.network.neutron [req-51c57a28-c7d4-4711-bfe8-b253d2942e4c req-47207027-ac44-4cbe-8090-d4f50f215e46 service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Refreshing network info cache for port 31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:38:27 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:38:27 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=25.257701873779297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "refresh_cache-44395e02-246c-4923-b163-51289db5d1a3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.network.neutron [req-51c57a28-c7d4-4711-bfe8-b253d2942e4c req-47207027-ac44-4cbe-8090-d4f50f215e46 service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 8811e708-b8c0-4bad-9d97-2be84aef2cc6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 748f9ac3-6911-4de4-99cc-af5949dc08c8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 44395e02-246c-4923-b163-51289db5d1a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.network.neutron [req-51c57a28-c7d4-4711-bfe8-b253d2942e4c req-47207027-ac44-4cbe-8090-d4f50f215e46 service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-51c57a28-c7d4-4711-bfe8-b253d2942e4c req-47207027-ac44-4cbe-8090-d4f50f215e46 service nova] Releasing lock "refresh_cache-44395e02-246c-4923-b163-51289db5d1a3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquired lock "refresh_cache-44395e02-246c-4923-b163-51289db5d1a3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.network.neutron [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:38:27 user nova-compute[74311]: DEBUG nova.network.neutron [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.network.neutron [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Updating instance_info_cache with network_info: [{"id": "31d31b6a-108f-4dc6-b217-3d474fac787d", "address": "fa:16:3e:5d:c7:c3", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d31b6a-10", "ovs_interfaceid": "31d31b6a-108f-4dc6-b217-3d474fac787d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Releasing lock "refresh_cache-44395e02-246c-4923-b163-51289db5d1a3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.compute.manager [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Instance network_info: |[{"id": "31d31b6a-108f-4dc6-b217-3d474fac787d", "address": "fa:16:3e:5d:c7:c3", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d31b6a-10", "ovs_interfaceid": "31d31b6a-108f-4dc6-b217-3d474fac787d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Start _get_guest_xml network_info=[{"id": "31d31b6a-108f-4dc6-b217-3d474fac787d", "address": "fa:16:3e:5d:c7:c3", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d31b6a-10", "ovs_interfaceid": "31d31b6a-108f-4dc6-b217-3d474fac787d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:38:28 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:38:28 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-387053839',display_name='tempest-VolumesSnapshotTestJSON-instance-387053839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-387053839',id=44,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8YAGHWNpllpbs5qPgaQtUf4n3RBKpndoTQPk5d+Fg/Ur4Gv1JbFppnKjwiOamLDZJVc9DBT40jRCVO5vd+QBoEtquE1p0e5ZBe2A+D4T1QhlX5qDNUH9hbxZalBpKfsQ==',key_name='tempest-keypair-637392144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e14e8b4071d4f0591e65fededd0f2fd',ramdisk_id='',reservation_id='r-w1f1u0sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1070048329',owner_user_name='tempest-VolumesSnapshotTestJSON-1070048329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:38:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dda3552abdb4cee967ce9cac71580ba',uuid=44395e02-246c-4923-b163-51289db5d1a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31d31b6a-108f-4dc6-b217-3d474fac787d", "address": "fa:16:3e:5d:c7:c3", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d31b6a-10", "ovs_interfaceid": "31d31b6a-108f-4dc6-b217-3d474fac787d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Converting VIF {"id": "31d31b6a-108f-4dc6-b217-3d474fac787d", "address": "fa:16:3e:5d:c7:c3", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d31b6a-10", "ovs_interfaceid": "31d31b6a-108f-4dc6-b217-3d474fac787d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c7:c3,bridge_name='br-int',has_traffic_filtering=True,id=31d31b6a-108f-4dc6-b217-3d474fac787d,network=Network(3f659357-90d1-42cc-99de-5959812bf2fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d31b6a-10') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.objects.instance [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lazy-loading 'pci_devices' on Instance uuid 44395e02-246c-4923-b163-51289db5d1a3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:38:28 user nova-compute[74311]:   <uuid>44395e02-246c-4923-b163-51289db5d1a3</uuid>
Oct 20 10:38:28 user nova-compute[74311]:   <name>instance-0000002c</name>
Oct 20 10:38:28 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:38:28 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:38:28 user nova-compute[74311]:   <metadata>
Oct 20 10:38:28 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:38:28 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:38:28 user nova-compute[74311]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-387053839</nova:name>
Oct 20 10:38:28 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:38:28</nova:creationTime>
Oct 20 10:38:28 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:38:28 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:38:28 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:38:28 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:38:28 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:38:28 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:38:28 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:38:28 user nova-compute[74311]:       <nova:owner>
Oct 20 10:38:28 user nova-compute[74311]:         <nova:user uuid="4dda3552abdb4cee967ce9cac71580ba">tempest-VolumesSnapshotTestJSON-1070048329-project-member</nova:user>
Oct 20 10:38:28 user nova-compute[74311]:         <nova:project uuid="4e14e8b4071d4f0591e65fededd0f2fd">tempest-VolumesSnapshotTestJSON-1070048329</nova:project>
Oct 20 10:38:28 user nova-compute[74311]:       </nova:owner>
Oct 20 10:38:28 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:38:28 user nova-compute[74311]:       <nova:ports>
Oct 20 10:38:28 user nova-compute[74311]:         <nova:port uuid="31d31b6a-108f-4dc6-b217-3d474fac787d">
Oct 20 10:38:28 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 10:38:28 user nova-compute[74311]:         </nova:port>
Oct 20 10:38:28 user nova-compute[74311]:       </nova:ports>
Oct 20 10:38:28 user nova-compute[74311]:     </nova:instance>
Oct 20 10:38:28 user nova-compute[74311]:   </metadata>
Oct 20 10:38:28 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:38:28 user nova-compute[74311]:     <system>
Oct 20 10:38:28 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:38:28 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:38:28 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:38:28 user nova-compute[74311]:       <entry name="serial">44395e02-246c-4923-b163-51289db5d1a3</entry>
Oct 20 10:38:28 user nova-compute[74311]:       <entry name="uuid">44395e02-246c-4923-b163-51289db5d1a3</entry>
Oct 20 10:38:28 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:38:28 user nova-compute[74311]:     </system>
Oct 20 10:38:28 user nova-compute[74311]:   </sysinfo>
Oct 20 10:38:28 user nova-compute[74311]:   <os>
Oct 20 10:38:28 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:38:28 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:38:28 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:38:28 user nova-compute[74311]:   </os>
Oct 20 10:38:28 user nova-compute[74311]:   <features>
Oct 20 10:38:28 user nova-compute[74311]:     <acpi/>
Oct 20 10:38:28 user nova-compute[74311]:     <apic/>
Oct 20 10:38:28 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:38:28 user nova-compute[74311]:   </features>
Oct 20 10:38:28 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:38:28 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:38:28 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:38:28 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:38:28 user nova-compute[74311]:   </clock>
Oct 20 10:38:28 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:38:28 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:38:28 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:38:28 user nova-compute[74311]:   </cpu>
Oct 20 10:38:28 user nova-compute[74311]:   <devices>
Oct 20 10:38:28 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:38:28 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:38:28 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk"/>
Oct 20 10:38:28 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:38:28 user nova-compute[74311]:     </disk>
Oct 20 10:38:28 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:38:28 user nova-compute[74311]:       <mac address="fa:16:3e:5d:c7:c3"/>
Oct 20 10:38:28 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:38:28 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:38:28 user nova-compute[74311]:       <target dev="tap31d31b6a-10"/>
Oct 20 10:38:28 user nova-compute[74311]:     </interface>
Oct 20 10:38:28 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:38:28 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/console.log" append="off"/>
Oct 20 10:38:28 user nova-compute[74311]:     </serial>
Oct 20 10:38:28 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:38:28 user nova-compute[74311]:     <video>
Oct 20 10:38:28 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:38:28 user nova-compute[74311]:     </video>
Oct 20 10:38:28 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:38:28 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:38:28 user nova-compute[74311]:     </rng>
Oct 20 10:38:28 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:38:28 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:38:28 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:38:28 user nova-compute[74311]:     </memballoon>
Oct 20 10:38:28 user nova-compute[74311]:   </devices>
Oct 20 10:38:28 user nova-compute[74311]: </domain>
Oct 20 10:38:28 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-387053839',display_name='tempest-VolumesSnapshotTestJSON-instance-387053839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-387053839',id=44,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8YAGHWNpllpbs5qPgaQtUf4n3RBKpndoTQPk5d+Fg/Ur4Gv1JbFppnKjwiOamLDZJVc9DBT40jRCVO5vd+QBoEtquE1p0e5ZBe2A+D4T1QhlX5qDNUH9hbxZalBpKfsQ==',key_name='tempest-keypair-637392144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e14e8b4071d4f0591e65fededd0f2fd',ramdisk_id='',reservation_id='r-w1f1u0sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1070048329',owner_user_name='tempest-VolumesSnapshotTestJSON-1070048329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:38:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dda3552abdb4cee967ce9cac71580ba',uuid=44395e02-246c-4923-b163-51289db5d1a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31d31b6a-108f-4dc6-b217-3d474fac787d", "address": "fa:16:3e:5d:c7:c3", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d31b6a-10", "ovs_interfaceid": "31d31b6a-108f-4dc6-b217-3d474fac787d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Converting VIF {"id": "31d31b6a-108f-4dc6-b217-3d474fac787d", "address": "fa:16:3e:5d:c7:c3", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d31b6a-10", "ovs_interfaceid": "31d31b6a-108f-4dc6-b217-3d474fac787d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c7:c3,bridge_name='br-int',has_traffic_filtering=True,id=31d31b6a-108f-4dc6-b217-3d474fac787d,network=Network(3f659357-90d1-42cc-99de-5959812bf2fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d31b6a-10') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG os_vif [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c7:c3,bridge_name='br-int',has_traffic_filtering=True,id=31d31b6a-108f-4dc6-b217-3d474fac787d,network=Network(3f659357-90d1-42cc-99de-5959812bf2fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d31b6a-10') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21a55ed7-a013-55ae-94a6-e059ab9fa637', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31d31b6a-10, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap31d31b6a-10, col_values=(('qos', UUID('bfe97ec4-732b-49b4-b292-36163b1b8ca0')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap31d31b6a-10, col_values=(('external_ids', {'iface-id': '31d31b6a-108f-4dc6-b217-3d474fac787d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:c7:c3', 'vm-uuid': '44395e02-246c-4923-b163-51289db5d1a3'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:28 user nova-compute[74311]: INFO os_vif [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c7:c3,bridge_name='br-int',has_traffic_filtering=True,id=31d31b6a-108f-4dc6-b217-3d474fac787d,network=Network(3f659357-90d1-42cc-99de-5959812bf2fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d31b6a-10')
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] No VIF found with MAC fa:16:3e:5d:c7:c3, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:38:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-7b9aad47-ef65-43d5-94c7-e64111486aa5 req-33f2a88f-8621-466d-9984-7b056d17447e service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Received event network-vif-plugged-31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:38:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7b9aad47-ef65-43d5-94c7-e64111486aa5 req-33f2a88f-8621-466d-9984-7b056d17447e service nova] Acquiring lock "44395e02-246c-4923-b163-51289db5d1a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:38:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7b9aad47-ef65-43d5-94c7-e64111486aa5 req-33f2a88f-8621-466d-9984-7b056d17447e service nova] Lock "44395e02-246c-4923-b163-51289db5d1a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:38:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7b9aad47-ef65-43d5-94c7-e64111486aa5 req-33f2a88f-8621-466d-9984-7b056d17447e service nova] Lock "44395e02-246c-4923-b163-51289db5d1a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:38:29 user nova-compute[74311]: DEBUG nova.compute.manager [req-7b9aad47-ef65-43d5-94c7-e64111486aa5 req-33f2a88f-8621-466d-9984-7b056d17447e service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] No waiting events found dispatching network-vif-plugged-31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:38:29 user nova-compute[74311]: WARNING nova.compute.manager [req-7b9aad47-ef65-43d5-94c7-e64111486aa5 req-33f2a88f-8621-466d-9984-7b056d17447e service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Received unexpected event network-vif-plugged-31d31b6a-108f-4dc6-b217-3d474fac787d for instance with vm_state building and task_state spawning.
Oct 20 10:38:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG os_brick.utils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[576f7fb4-9cd7-4eb0-b50a-3b1b64d52dda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[10da7b62-fcef-48cc-b85d-06d4fc751fe2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[691812d1-a287-41ee-b682-5800b4570214]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ca301d-ad44-4e98-adcf-cfb8fa59b709]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:38:30 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:38:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[483e0b55-162c-44b2-bfe5-577ece4247f3]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG os_brick.utils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:38:30 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Updating existing volume attachment record: 0de1a672-a5a8-4a77-9a8b-a448a2ae5435 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:38:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:38:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:38:31 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Instance spawned successfully.
Oct 20 10:38:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:38:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:38:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:38:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:38:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:38:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:38:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:38:31 user nova-compute[74311]: DEBUG nova.compute.manager [req-62e5654f-1250-4bed-9484-18502b00b856 req-bdb40018-b5b0-4c07-a801-b646dcccf4be service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Received event network-vif-plugged-31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:38:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-62e5654f-1250-4bed-9484-18502b00b856 req-bdb40018-b5b0-4c07-a801-b646dcccf4be service nova] Acquiring lock "44395e02-246c-4923-b163-51289db5d1a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:38:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-62e5654f-1250-4bed-9484-18502b00b856 req-bdb40018-b5b0-4c07-a801-b646dcccf4be service nova] Lock "44395e02-246c-4923-b163-51289db5d1a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:38:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-62e5654f-1250-4bed-9484-18502b00b856 req-bdb40018-b5b0-4c07-a801-b646dcccf4be service nova] Lock "44395e02-246c-4923-b163-51289db5d1a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:38:31 user nova-compute[74311]: DEBUG nova.compute.manager [req-62e5654f-1250-4bed-9484-18502b00b856 req-bdb40018-b5b0-4c07-a801-b646dcccf4be service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] No waiting events found dispatching network-vif-plugged-31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:38:31 user nova-compute[74311]: WARNING nova.compute.manager [req-62e5654f-1250-4bed-9484-18502b00b856 req-bdb40018-b5b0-4c07-a801-b646dcccf4be service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Received unexpected event network-vif-plugged-31d31b6a-108f-4dc6-b217-3d474fac787d for instance with vm_state building and task_state spawning.
Oct 20 10:38:31 user nova-compute[74311]: INFO nova.compute.manager [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Took 6.46 seconds to spawn the instance on the hypervisor.
Oct 20 10:38:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:38:32 user nova-compute[74311]: INFO nova.compute.manager [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Took 7.06 seconds to build instance.
Oct 20 10:38:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-30d81855-9f6c-4282-9a0d-88303694b1db tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "44395e02-246c-4923-b163-51289db5d1a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.160s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:38:32 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:38:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:39 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:38:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 10:38:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] There are 0 instances to clean {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 10:38:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:38:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:38:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:38:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:38:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:38:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:45 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:38:45 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74311) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:38:48 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Creating image(s)
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Ensure instance console log exists: /opt/stack/data/nova/instances/748f9ac3-6911-4de4-99cc-af5949dc08c8/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Start _get_guest_xml network_info=[{"id": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "address": "fa:16:3e:85:61:93", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f19c68-2e", "ovs_interfaceid": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T10:38:11Z,direct_url=<?>,disk_format='qcow2',id=4252af43-4d9b-43a6-b6fa-710c396e7cad,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-267840016',owner='aa7a52d2fa8243fabc22baa8694e14d6',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T10:38:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '0de1a672-a5a8-4a77-9a8b-a448a2ae5435', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLpsGzVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '748f9ac3-6911-4de4-99cc-af5949dc08c8', 'attached_at': '', 'detached_at': '', 'volume_id': '7c9e143e-559e-4a91-b3ee-4a2ce2ad4999', 'serial': '7c9e143e-559e-4a91-b3ee-4a2ce2ad4999'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:38:48 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:38:48 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T10:38:11Z,direct_url=<?>,disk_format='qcow2',id=4252af43-4d9b-43a6-b6fa-710c396e7cad,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-267840016',owner='aa7a52d2fa8243fabc22baa8694e14d6',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T10:38:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLpsGzVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:38:48 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:38:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:38:48 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:38:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:38:48 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:38:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefc0520-f23c-4d9e-ac59-2dfcda83261d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:38:48 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e5113e-e924-4814-a0f7-40a31760f62e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999] added
Oct 20 10:38:48 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:38:48 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cd4b81-63c1-4306-aca1-f2477d7c8088]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0718dd-03ba-4232-9ee9-b73a03ee6f11]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLpsGzVU {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLpsGzVU" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7c2cfb-4d7c-4c84-b0a4-0d9a7e7a633b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nLpsGzVU'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1565322-9ae6-46cb-93b7-6ae4247c8d30]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6d179e-92f0-46b5-a0fb-b032b562dd91]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)
Oct 20 10:38:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)
Oct 20 10:38:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22fdf71-064f-4c53-b8c7-6aa7035bd9d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999, portal: 172.16.0.220,3260]
Oct 20 10:38:49 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999, portal: 172.16.0.220,3260] successful.
Oct 20 10:38:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89a211a-56e7-4a32-8d95-4eea93cec33c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[13451dd2-77e2-41d5-9d16-24d2c813ad28]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)
Oct 20 10:38:49 user nova-compute[74311]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 (non-flash)
Oct 20 10:38:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)
Oct 20 10:38:49 user nova-compute[74311]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 (non-flash)
Oct 20 10:38:49 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f235db-2bab-4eeb-a673-50ed7c76346f]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:38:49 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLpsGzVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23233396634353932', 'path': '/dev/sdc'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233396634353932', 'path': '/dev/sdc'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1677031009',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1677031009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1677031009',id=43,image_ref='4252af43-4d9b-43a6-b6fa-710c396e7cad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq4kPWjIY21awDmKEydKDrmXWDy5RCUGj0cbDzQIWWG8wiM9YSYvxIM+r1RhV08aHJemZTwhloLPfAogxbsKufVzR8szrrJdX9MgVgYD2AwGwy6/Lx93cqxWTP9p+7PoA==',key_name='tempest-keypair-2049096852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-raj1dvqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1419375529',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:38:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=748f9ac3-6911-4de4-99cc-af5949dc08c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "address": "fa:16:3e:85:61:93", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f19c68-2e", "ovs_interfaceid": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "address": "fa:16:3e:85:61:93", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f19c68-2e", "ovs_interfaceid": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:61:93,bridge_name='br-int',has_traffic_filtering=True,id=80f19c68-2ef9-482b-b88e-c44912e8cfd2,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f19c68-2e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG nova.objects.instance [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lazy-loading 'pci_devices' on Instance uuid 748f9ac3-6911-4de4-99cc-af5949dc08c8 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:38:50 user nova-compute[74311]:   <uuid>748f9ac3-6911-4de4-99cc-af5949dc08c8</uuid>
Oct 20 10:38:50 user nova-compute[74311]:   <name>instance-0000002b</name>
Oct 20 10:38:50 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:38:50 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:38:50 user nova-compute[74311]:   <metadata>
Oct 20 10:38:50 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:38:50 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:38:50 user nova-compute[74311]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1677031009</nova:name>
Oct 20 10:38:50 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:38:48</nova:creationTime>
Oct 20 10:38:50 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:38:50 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:38:50 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:38:50 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:38:50 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:38:50 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:38:50 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:38:50 user nova-compute[74311]:       <nova:owner>
Oct 20 10:38:50 user nova-compute[74311]:         <nova:user uuid="f9634a3daf064bf2aad6ea38454f7639">tempest-TestVolumeBootPattern-1419375529-project-member</nova:user>
Oct 20 10:38:50 user nova-compute[74311]:         <nova:project uuid="aa7a52d2fa8243fabc22baa8694e14d6">tempest-TestVolumeBootPattern-1419375529</nova:project>
Oct 20 10:38:50 user nova-compute[74311]:       </nova:owner>
Oct 20 10:38:50 user nova-compute[74311]:       <nova:root type="image" uuid="4252af43-4d9b-43a6-b6fa-710c396e7cad"/>
Oct 20 10:38:50 user nova-compute[74311]:       <nova:ports>
Oct 20 10:38:50 user nova-compute[74311]:         <nova:port uuid="80f19c68-2ef9-482b-b88e-c44912e8cfd2">
Oct 20 10:38:50 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 10:38:50 user nova-compute[74311]:         </nova:port>
Oct 20 10:38:50 user nova-compute[74311]:       </nova:ports>
Oct 20 10:38:50 user nova-compute[74311]:     </nova:instance>
Oct 20 10:38:50 user nova-compute[74311]:   </metadata>
Oct 20 10:38:50 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:38:50 user nova-compute[74311]:     <system>
Oct 20 10:38:50 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:38:50 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:38:50 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:38:50 user nova-compute[74311]:       <entry name="serial">748f9ac3-6911-4de4-99cc-af5949dc08c8</entry>
Oct 20 10:38:50 user nova-compute[74311]:       <entry name="uuid">748f9ac3-6911-4de4-99cc-af5949dc08c8</entry>
Oct 20 10:38:50 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:38:50 user nova-compute[74311]:     </system>
Oct 20 10:38:50 user nova-compute[74311]:   </sysinfo>
Oct 20 10:38:50 user nova-compute[74311]:   <os>
Oct 20 10:38:50 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:38:50 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:38:50 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:38:50 user nova-compute[74311]:   </os>
Oct 20 10:38:50 user nova-compute[74311]:   <features>
Oct 20 10:38:50 user nova-compute[74311]:     <acpi/>
Oct 20 10:38:50 user nova-compute[74311]:     <apic/>
Oct 20 10:38:50 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:38:50 user nova-compute[74311]:   </features>
Oct 20 10:38:50 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:38:50 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:38:50 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:38:50 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:38:50 user nova-compute[74311]:   </clock>
Oct 20 10:38:50 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:38:50 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:38:50 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:38:50 user nova-compute[74311]:   </cpu>
Oct 20 10:38:50 user nova-compute[74311]:   <devices>
Oct 20 10:38:50 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:38:50 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:38:50 user nova-compute[74311]:       <source dev="/dev/sdc"/>
Oct 20 10:38:50 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:38:50 user nova-compute[74311]:       <serial>7c9e143e-559e-4a91-b3ee-4a2ce2ad4999</serial>
Oct 20 10:38:50 user nova-compute[74311]:     </disk>
Oct 20 10:38:50 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:38:50 user nova-compute[74311]:       <mac address="fa:16:3e:85:61:93"/>
Oct 20 10:38:50 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:38:50 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:38:50 user nova-compute[74311]:       <target dev="tap80f19c68-2e"/>
Oct 20 10:38:50 user nova-compute[74311]:     </interface>
Oct 20 10:38:50 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:38:50 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/748f9ac3-6911-4de4-99cc-af5949dc08c8/console.log" append="off"/>
Oct 20 10:38:50 user nova-compute[74311]:     </serial>
Oct 20 10:38:50 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:38:50 user nova-compute[74311]:     <video>
Oct 20 10:38:50 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:38:50 user nova-compute[74311]:     </video>
Oct 20 10:38:50 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:38:50 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:38:50 user nova-compute[74311]:     </rng>
Oct 20 10:38:50 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:38:50 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:38:50 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:38:50 user nova-compute[74311]:     </memballoon>
Oct 20 10:38:50 user nova-compute[74311]:   </devices>
Oct 20 10:38:50 user nova-compute[74311]: </domain>
Oct 20 10:38:50 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1677031009',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1677031009',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1677031009',id=43,image_ref='4252af43-4d9b-43a6-b6fa-710c396e7cad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq4kPWjIY21awDmKEydKDrmXWDy5RCUGj0cbDzQIWWG8wiM9YSYvxIM+r1RhV08aHJemZTwhloLPfAogxbsKufVzR8szrrJdX9MgVgYD2AwGwy6/Lx93cqxWTP9p+7PoA==',key_name='tempest-keypair-2049096852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-raj1dvqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1419375529',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:38:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=748f9ac3-6911-4de4-99cc-af5949dc08c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "address": "fa:16:3e:85:61:93", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f19c68-2e", "ovs_interfaceid": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "address": "fa:16:3e:85:61:93", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f19c68-2e", "ovs_interfaceid": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:61:93,bridge_name='br-int',has_traffic_filtering=True,id=80f19c68-2ef9-482b-b88e-c44912e8cfd2,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f19c68-2e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG os_vif [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:61:93,bridge_name='br-int',has_traffic_filtering=True,id=80f19c68-2ef9-482b-b88e-c44912e8cfd2,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f19c68-2e') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9604ee6-1568-5228-b7e1-81c40aeea86a', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80f19c68-2e, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80f19c68-2e, col_values=(('qos', UUID('9c9fcc15-05ef-4999-95e9-5dfb710090ed')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80f19c68-2e, col_values=(('external_ids', {'iface-id': '80f19c68-2ef9-482b-b88e-c44912e8cfd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:61:93', 'vm-uuid': '748f9ac3-6911-4de4-99cc-af5949dc08c8'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:50 user nova-compute[74311]: INFO os_vif [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:61:93,bridge_name='br-int',has_traffic_filtering=True,id=80f19c68-2ef9-482b-b88e-c44912e8cfd2,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f19c68-2e')
Oct 20 10:38:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] No VIF found with MAC fa:16:3e:85:61:93, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:38:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-6f00a2c1-74b0-49b6-bc1c-c618409aab1c req-94a6e0d2-85b6-4381-8d4a-d6cf0d5c3edf service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Received event network-vif-plugged-80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:38:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6f00a2c1-74b0-49b6-bc1c-c618409aab1c req-94a6e0d2-85b6-4381-8d4a-d6cf0d5c3edf service nova] Acquiring lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:38:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6f00a2c1-74b0-49b6-bc1c-c618409aab1c req-94a6e0d2-85b6-4381-8d4a-d6cf0d5c3edf service nova] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:38:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6f00a2c1-74b0-49b6-bc1c-c618409aab1c req-94a6e0d2-85b6-4381-8d4a-d6cf0d5c3edf service nova] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:38:52 user nova-compute[74311]: DEBUG nova.compute.manager [req-6f00a2c1-74b0-49b6-bc1c-c618409aab1c req-94a6e0d2-85b6-4381-8d4a-d6cf0d5c3edf service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] No waiting events found dispatching network-vif-plugged-80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:38:52 user nova-compute[74311]: WARNING nova.compute.manager [req-6f00a2c1-74b0-49b6-bc1c-c618409aab1c req-94a6e0d2-85b6-4381-8d4a-d6cf0d5c3edf service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Received unexpected event network-vif-plugged-80f19c68-2ef9-482b-b88e-c44912e8cfd2 for instance with vm_state building and task_state spawning.
Oct 20 10:38:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:38:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:38:53 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Instance spawned successfully.
Oct 20 10:38:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:38:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:38:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:38:53 user nova-compute[74311]: INFO nova.compute.manager [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Took 5.06 seconds to spawn the instance on the hypervisor.
Oct 20 10:38:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:38:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:54 user nova-compute[74311]: INFO nova.compute.manager [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Took 30.21 seconds to build instance.
Oct 20 10:38:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5702b04-71eb-4e18-a56e-93bbedab4b34 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.325s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:38:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-afeba445-92ca-4021-b39e-53391e157cc0 req-d46f3095-b7a8-45b4-9eb4-90105c43f2d9 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Received event network-vif-plugged-80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:38:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-afeba445-92ca-4021-b39e-53391e157cc0 req-d46f3095-b7a8-45b4-9eb4-90105c43f2d9 service nova] Acquiring lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:38:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-afeba445-92ca-4021-b39e-53391e157cc0 req-d46f3095-b7a8-45b4-9eb4-90105c43f2d9 service nova] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:38:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-afeba445-92ca-4021-b39e-53391e157cc0 req-d46f3095-b7a8-45b4-9eb4-90105c43f2d9 service nova] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:38:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-afeba445-92ca-4021-b39e-53391e157cc0 req-d46f3095-b7a8-45b4-9eb4-90105c43f2d9 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] No waiting events found dispatching network-vif-plugged-80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:38:54 user nova-compute[74311]: WARNING nova.compute.manager [req-afeba445-92ca-4021-b39e-53391e157cc0 req-d46f3095-b7a8-45b4-9eb4-90105c43f2d9 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Received unexpected event network-vif-plugged-80f19c68-2ef9-482b-b88e-c44912e8cfd2 for instance with vm_state active and task_state None.
Oct 20 10:38:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:38:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:00 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:39:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 8811e708-b8c0-4bad-9d97-2be84aef2cc6 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:39:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 748f9ac3-6911-4de4-99cc-af5949dc08c8 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:39:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 44395e02-246c-4923-b163-51289db5d1a3 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:39:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:39:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:39:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "748f9ac3-6911-4de4-99cc-af5949dc08c8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:39:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:39:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "44395e02-246c-4923-b163-51289db5d1a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:39:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "44395e02-246c-4923-b163-51289db5d1a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:39:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:39:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:39:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "44395e02-246c-4923-b163-51289db5d1a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:39:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:11 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:39:11 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:39:11 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:39:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:39:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:39:11 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:39:11 user nova-compute[74311]: DEBUG nova.objects.instance [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lazy-loading 'info_cache' on Instance uuid 8811e708-b8c0-4bad-9d97-2be84aef2cc6 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:39:11 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Updating instance_info_cache with network_info: [{"id": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "address": "fa:16:3e:c0:ad:40", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e285374-bb", "ovs_interfaceid": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:39:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-8811e708-b8c0-4bad-9d97-2be84aef2cc6" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:39:11 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:39:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:15 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:39:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:18 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:39:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:20 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:39:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:22 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:39:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:25 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:39:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:39:28 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:39:28 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:39:28 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8514MB free_disk=25.215961456298828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 8811e708-b8c0-4bad-9d97-2be84aef2cc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 748f9ac3-6911-4de4-99cc-af5949dc08c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 44395e02-246c-4923-b163-51289db5d1a3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:39:28 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:39:29 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:39:29 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:39:29 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:39:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:39:30 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:39:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:39:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:39:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:39:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:39:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:39:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:39:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:39:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:39:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:40:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:40:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:40:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:40:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:40:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:12 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:40:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:40:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-748f9ac3-6911-4de4-99cc-af5949dc08c8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:40:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-748f9ac3-6911-4de4-99cc-af5949dc08c8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:40:12 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:40:12 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Updating instance_info_cache with network_info: [{"id": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "address": "fa:16:3e:85:61:93", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f19c68-2e", "ovs_interfaceid": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:40:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-748f9ac3-6911-4de4-99cc-af5949dc08c8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:40:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:40:14 user nova-compute[74311]: DEBUG nova.compute.manager [req-ce4430a4-2bd8-46f5-9e23-ddc8fdc8d19b req-56a6a371-7d9b-4a53-ac75-47df3440b517 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Received event network-changed-80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:40:14 user nova-compute[74311]: DEBUG nova.compute.manager [req-ce4430a4-2bd8-46f5-9e23-ddc8fdc8d19b req-56a6a371-7d9b-4a53-ac75-47df3440b517 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Refreshing instance network info cache due to event network-changed-80f19c68-2ef9-482b-b88e-c44912e8cfd2. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:40:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ce4430a4-2bd8-46f5-9e23-ddc8fdc8d19b req-56a6a371-7d9b-4a53-ac75-47df3440b517 service nova] Acquiring lock "refresh_cache-748f9ac3-6911-4de4-99cc-af5949dc08c8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:40:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ce4430a4-2bd8-46f5-9e23-ddc8fdc8d19b req-56a6a371-7d9b-4a53-ac75-47df3440b517 service nova] Acquired lock "refresh_cache-748f9ac3-6911-4de4-99cc-af5949dc08c8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:40:14 user nova-compute[74311]: DEBUG nova.network.neutron [req-ce4430a4-2bd8-46f5-9e23-ddc8fdc8d19b req-56a6a371-7d9b-4a53-ac75-47df3440b517 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Refreshing network info cache for port 80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG nova.network.neutron [req-ce4430a4-2bd8-46f5-9e23-ddc8fdc8d19b req-56a6a371-7d9b-4a53-ac75-47df3440b517 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Updated VIF entry in instance network info cache for port 80f19c68-2ef9-482b-b88e-c44912e8cfd2. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG nova.network.neutron [req-ce4430a4-2bd8-46f5-9e23-ddc8fdc8d19b req-56a6a371-7d9b-4a53-ac75-47df3440b517 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Updating instance_info_cache with network_info: [{"id": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "address": "fa:16:3e:85:61:93", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f19c68-2e", "ovs_interfaceid": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ce4430a4-2bd8-46f5-9e23-ddc8fdc8d19b req-56a6a371-7d9b-4a53-ac75-47df3440b517 service nova] Releasing lock "refresh_cache-748f9ac3-6911-4de4-99cc-af5949dc08c8" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "748f9ac3-6911-4de4-99cc-af5949dc08c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:40:15 user nova-compute[74311]: INFO nova.compute.manager [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Terminating instance
Oct 20 10:40:15 user nova-compute[74311]: DEBUG nova.compute.manager [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG nova.compute.manager [req-51607253-1950-47ec-875f-bb80b1a8eecd req-cfa87e5a-8d32-44df-a457-8ea5704b54b0 service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Received event network-changed-31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG nova.compute.manager [req-51607253-1950-47ec-875f-bb80b1a8eecd req-cfa87e5a-8d32-44df-a457-8ea5704b54b0 service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Refreshing instance network info cache due to event network-changed-31d31b6a-108f-4dc6-b217-3d474fac787d. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-51607253-1950-47ec-875f-bb80b1a8eecd req-cfa87e5a-8d32-44df-a457-8ea5704b54b0 service nova] Acquiring lock "refresh_cache-44395e02-246c-4923-b163-51289db5d1a3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-51607253-1950-47ec-875f-bb80b1a8eecd req-cfa87e5a-8d32-44df-a457-8ea5704b54b0 service nova] Acquired lock "refresh_cache-44395e02-246c-4923-b163-51289db5d1a3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG nova.network.neutron [req-51607253-1950-47ec-875f-bb80b1a8eecd req-cfa87e5a-8d32-44df-a457-8ea5704b54b0 service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Refreshing network info cache for port 31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:15 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Instance destroyed successfully.
Oct 20 10:40:15 user nova-compute[74311]: DEBUG nova.objects.instance [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lazy-loading 'resources' on Instance uuid 748f9ac3-6911-4de4-99cc-af5949dc08c8 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1677031009',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1677031009',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1677031009',id=43,image_ref='4252af43-4d9b-43a6-b6fa-710c396e7cad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq4kPWjIY21awDmKEydKDrmXWDy5RCUGj0cbDzQIWWG8wiM9YSYvxIM+r1RhV08aHJemZTwhloLPfAogxbsKufVzR8szrrJdX9MgVgYD2AwGwy6/Lx93cqxWTP9p+7PoA==',key_name='tempest-keypair-2049096852',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:38:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-raj1dvqj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1419375529',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=748f9ac3-6911-4de4-99cc-af5949dc08c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "address": "fa:16:3e:85:61:93", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f19c68-2e", "ovs_interfaceid": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "address": "fa:16:3e:85:61:93", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f19c68-2e", "ovs_interfaceid": "80f19c68-2ef9-482b-b88e-c44912e8cfd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:61:93,bridge_name='br-int',has_traffic_filtering=True,id=80f19c68-2ef9-482b-b88e-c44912e8cfd2,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f19c68-2e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG os_vif [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:61:93,bridge_name='br-int',has_traffic_filtering=True,id=80f19c68-2ef9-482b-b88e-c44912e8cfd2,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f19c68-2e') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80f19c68-2e, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c9fcc15-05ef-4999-95e9-5dfb710090ed) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:40:15 user nova-compute[74311]: INFO os_vif [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:61:93,bridge_name='br-int',has_traffic_filtering=True,id=80f19c68-2ef9-482b-b88e-c44912e8cfd2,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f19c68-2e')
Oct 20 10:40:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLpsGzVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:40:15 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:40:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4528da-b3e9-4884-82f3-2c9b01242dcd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:40:15 user nova-compute[74311]: No targets found.
Oct 20 10:40:15 user nova-compute[74311]: iSNS:
Oct 20 10:40:15 user nova-compute[74311]: No targets found.
Oct 20 10:40:15 user nova-compute[74311]: STATIC:
Oct 20 10:40:15 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e
Oct 20 10:40:15 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:40:15 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:40:15 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999
Oct 20 10:40:15 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:40:15 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:40:15 user nova-compute[74311]: FIRMWARE:
Oct 20 10:40:15 user nova-compute[74311]: No targets found.
Oct 20 10:40:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:40:15 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:40:15 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:40:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb12875a-52ad-415e-94e1-acbc18b83ab3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f1af70-580d-4134-a471-8af2a6270971]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)
Oct 20 10:40:16 user nova-compute[74311]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 (non-flash)
Oct 20 10:40:16 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)
Oct 20 10:40:16 user nova-compute[74311]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 (non-flash)
Oct 20 10:40:16 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164e411b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999'): ({'sdc'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Removing single pathed devices sdc {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "44395e02-246c-4923-b163-51289db5d1a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "44395e02-246c-4923-b163-51289db5d1a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG nova.objects.instance [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lazy-loading 'flavor' on Instance uuid 44395e02-246c-4923-b163-51289db5d1a3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2f15ba-d45b-4c32-8e14-95b6c44151a3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:16 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Ignoring supplied device name: /dev/vdb
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee83b74d-d3a8-4c80-9637-22df543d7dcf]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flushing IO for device /dev/sdc {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "44395e02-246c-4923-b163-51289db5d1a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00ff2f3-ab68-4756-84b4-4cf8ddc89e6e]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f1d5df-3f9e-43c4-baa3-1945706005cf]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23233396634353932', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b56d2981', '/dev/disk/by-id/scsi-1SCST_BIOb56d2981-239f4592016e87c8') {{(pid=85589) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c075b9-237d-47bc-befd-f78d69d1812a]: (4, None) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a71a1f8-5c71-43ae-a642-273cfb3a94f2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG nova.network.neutron [req-51607253-1950-47ec-875f-bb80b1a8eecd req-cfa87e5a-8d32-44df-a457-8ea5704b54b0 service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Updated VIF entry in instance network info cache for port 31d31b6a-108f-4dc6-b217-3d474fac787d. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG nova.network.neutron [req-51607253-1950-47ec-875f-bb80b1a8eecd req-cfa87e5a-8d32-44df-a457-8ea5704b54b0 service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Updating instance_info_cache with network_info: [{"id": "31d31b6a-108f-4dc6-b217-3d474fac787d", "address": "fa:16:3e:5d:c7:c3", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d31b6a-10", "ovs_interfaceid": "31d31b6a-108f-4dc6-b217-3d474fac787d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e520f28-4efd-4008-aba2-790714b77d1d]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999, portal: 172.16.0.220,3260]
Oct 20 10:40:16 user nova-compute[74311]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999, portal: 172.16.0.220,3260] successful.
Oct 20 10:40:16 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-51607253-1950-47ec-875f-bb80b1a8eecd req-cfa87e5a-8d32-44df-a457-8ea5704b54b0 service nova] Releasing lock "refresh_cache-44395e02-246c-4923-b163-51289db5d1a3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "44395e02-246c-4923-b163-51289db5d1a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "44395e02-246c-4923-b163-51289db5d1a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:40:16 user nova-compute[74311]: INFO nova.compute.manager [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Attaching volume 603b5e4f-99c0-407e-8d53-21d9cfee0825 to /dev/vdb
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[132523df-7a67-4a5e-bf26-668c86003fea]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== disconnect_volume: return (340ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:40:16 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Deleting instance files /opt/stack/data/nova/instances/748f9ac3-6911-4de4-99cc-af5949dc08c8_del
Oct 20 10:40:16 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Deletion of /opt/stack/data/nova/instances/748f9ac3-6911-4de4-99cc-af5949dc08c8_del complete
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.utils [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:16 user nova-compute[74311]: INFO nova.compute.manager [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa380f6-0b40-4e92-ab9a-3bf7ca9e810d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf8a859-34b2-45e9-926f-e39536a0153b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd78772-656c-4b39-8c16-856841e82c29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7d1de3-e9d4-46b5-bcb2-862dd814b74c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:40:16 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc51c8e6-4a5d-4647-b0a8-0c044f23cc1d]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG os_brick.utils [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Updating existing volume attachment record: 1b54b1a6-ebc3-4bb3-b551-2bc2d93224fc {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-3217e1e1-2cb1-4dc0-ac8d-064e237f30ee req-f9cb3f3b-0660-425e-b5b3-d32608940e75 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Received event network-vif-unplugged-80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3217e1e1-2cb1-4dc0-ac8d-064e237f30ee req-f9cb3f3b-0660-425e-b5b3-d32608940e75 service nova] Acquiring lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3217e1e1-2cb1-4dc0-ac8d-064e237f30ee req-f9cb3f3b-0660-425e-b5b3-d32608940e75 service nova] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3217e1e1-2cb1-4dc0-ac8d-064e237f30ee req-f9cb3f3b-0660-425e-b5b3-d32608940e75 service nova] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-3217e1e1-2cb1-4dc0-ac8d-064e237f30ee req-f9cb3f3b-0660-425e-b5b3-d32608940e75 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] No waiting events found dispatching network-vif-unplugged-80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-3217e1e1-2cb1-4dc0-ac8d-064e237f30ee req-f9cb3f3b-0660-425e-b5b3-d32608940e75 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Received event network-vif-unplugged-80f19c68-2ef9-482b-b88e-c44912e8cfd2 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-3217e1e1-2cb1-4dc0-ac8d-064e237f30ee req-f9cb3f3b-0660-425e-b5b3-d32608940e75 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Received event network-vif-plugged-80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3217e1e1-2cb1-4dc0-ac8d-064e237f30ee req-f9cb3f3b-0660-425e-b5b3-d32608940e75 service nova] Acquiring lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3217e1e1-2cb1-4dc0-ac8d-064e237f30ee req-f9cb3f3b-0660-425e-b5b3-d32608940e75 service nova] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3217e1e1-2cb1-4dc0-ac8d-064e237f30ee req-f9cb3f3b-0660-425e-b5b3-d32608940e75 service nova] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:40:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-3217e1e1-2cb1-4dc0-ac8d-064e237f30ee req-f9cb3f3b-0660-425e-b5b3-d32608940e75 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] No waiting events found dispatching network-vif-plugged-80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:40:16 user nova-compute[74311]: WARNING nova.compute.manager [req-3217e1e1-2cb1-4dc0-ac8d-064e237f30ee req-f9cb3f3b-0660-425e-b5b3-d32608940e75 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Received unexpected event network-vif-plugged-80f19c68-2ef9-482b-b88e-c44912e8cfd2 for instance with vm_state active and task_state deleting.
Oct 20 10:40:17 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:40:17 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Took 1.23 seconds to deallocate network for instance.
Oct 20 10:40:17 user nova-compute[74311]: DEBUG nova.compute.manager [req-15ac4a87-58e3-46e3-8fe6-664c3e5d94f8 req-d34a1267-e887-412c-9105-8442159e5503 service nova] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Received event network-vif-deleted-80f19c68-2ef9-482b-b88e-c44912e8cfd2 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:40:18 user nova-compute[74311]: INFO nova.compute.manager [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Took 0.81 seconds to detach 1 volumes for instance.
Oct 20 10:40:18 user nova-compute[74311]: DEBUG nova.compute.manager [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 748f9ac3-6911-4de4-99cc-af5949dc08c8] Deleting volume: 7c9e143e-559e-4a91-b3ee-4a2ce2ad4999 {{(pid=74311) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 10:40:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:40:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:40:18 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:40:18 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:40:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:40:18 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Deleted allocations for instance 748f9ac3-6911-4de4-99cc-af5949dc08c8
Oct 20 10:40:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-41b3917a-7882-47c9-af2c-b9db8fb6956f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "748f9ac3-6911-4de4-99cc-af5949dc08c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.811s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:40:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:20 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:40:20 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:40:20 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:24 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:40:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:26 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:40:29 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:40:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:40:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:40:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:40:29 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:40:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:40:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:29 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:40:29 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:40:29 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8652MB free_disk=25.21247100830078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:40:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:40:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:40:30 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 8811e708-b8c0-4bad-9d97-2be84aef2cc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:40:30 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 44395e02-246c-4923-b163-51289db5d1a3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:40:30 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:40:30 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:40:30 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:40:30 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:40:30 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:40:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:40:30 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:40:31 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:40:31 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:40:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:40:32 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJMnYOLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:40:34 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:40:34 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:40:34 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56d1fed-c301-4b40-8833-93d5625555e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:40:34 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8102b6d1-00a0-45e9-84a0-587214dd2343]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825] added
Oct 20 10:40:34 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e18da8-9fa3-4df9-83bf-91f4830c6106]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70d1de6-dfdb-4ff0-8282-746790d50d36]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJMnYOLD {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJMnYOLD" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a19822-0b58-432f-b819-88286d803089]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zJMnYOLD'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b05459-5a57-41af-b635-60bbac349397]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8401fb1c-8921-4f10-b68c-7fdfa9e06f7c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)
Oct 20 10:40:34 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)
Oct 20 10:40:34 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7f688c-b100-47b2-ab17-cc5b9b4acd08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825, portal: 172.16.0.220,3260]
Oct 20 10:40:34 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825, portal: 172.16.0.220,3260] successful.
Oct 20 10:40:34 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8759781-08ff-4020-b535-9af5867506c2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[895f290f-78e6-46e3-afb0-3bb8101f71b2]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)
Oct 20 10:40:34 user nova-compute[74311]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 (non-flash)
Oct 20 10:40:34 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)
Oct 20 10:40:34 user nova-compute[74311]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 (non-flash)
Oct 20 10:40:34 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1319653-08f6-484a-8f7c-17066268b875]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:40:34 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJMnYOLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:40:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:40:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23235643461643237', 'path': '/dev/sdc'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:40:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235643461643237', 'path': '/dev/sdc'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:40:35 user nova-compute[74311]: DEBUG nova.objects.instance [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lazy-loading 'flavor' on Instance uuid 44395e02-246c-4923-b163-51289db5d1a3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:40:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:40:35 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:40:35 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:40:35 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:40:35 user nova-compute[74311]:   <serial>603b5e4f-99c0-407e-8d53-21d9cfee0825</serial>
Oct 20 10:40:35 user nova-compute[74311]: </disk>
Oct 20 10:40:35 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:40:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:40:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:40:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] No VIF found with MAC fa:16:3e:5d:c7:c3, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:40:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-506ff610-af57-46de-baea-6d6a91983f8c tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "44395e02-246c-4923-b163-51289db5d1a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.678s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:40:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:40:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:40:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:40:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:40:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:40:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:40:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:41:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:41:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:12 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:41:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:41:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-44395e02-246c-4923-b163-51289db5d1a3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:41:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-44395e02-246c-4923-b163-51289db5d1a3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:41:12 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:41:12 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Updating instance_info_cache with network_info: [{"id": "31d31b6a-108f-4dc6-b217-3d474fac787d", "address": "fa:16:3e:5d:c7:c3", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d31b6a-10", "ovs_interfaceid": "31d31b6a-108f-4dc6-b217-3d474fac787d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:41:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-44395e02-246c-4923-b163-51289db5d1a3" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:41:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:41:15 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:41:15 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:41:16 user nova-compute[74311]: INFO nova.compute.manager [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Terminating instance
Oct 20 10:41:16 user nova-compute[74311]: DEBUG nova.compute.manager [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-d0283f82-f47f-4d06-a1c3-1e440b3f796e req-c4af32c8-2e32-4dc6-9386-2e5901970f3e service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Received event network-vif-unplugged-7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d0283f82-f47f-4d06-a1c3-1e440b3f796e req-c4af32c8-2e32-4dc6-9386-2e5901970f3e service nova] Acquiring lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d0283f82-f47f-4d06-a1c3-1e440b3f796e req-c4af32c8-2e32-4dc6-9386-2e5901970f3e service nova] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d0283f82-f47f-4d06-a1c3-1e440b3f796e req-c4af32c8-2e32-4dc6-9386-2e5901970f3e service nova] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-d0283f82-f47f-4d06-a1c3-1e440b3f796e req-c4af32c8-2e32-4dc6-9386-2e5901970f3e service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] No waiting events found dispatching network-vif-unplugged-7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-d0283f82-f47f-4d06-a1c3-1e440b3f796e req-c4af32c8-2e32-4dc6-9386-2e5901970f3e service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Received event network-vif-unplugged-7e285374-bb45-4df4-bdc1-c00d4f8a0cec for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:17 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Instance destroyed successfully.
Oct 20 10:41:17 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lazy-loading 'resources' on Instance uuid 8811e708-b8c0-4bad-9d97-2be84aef2cc6 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1631446642',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1631446642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1631446642',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1sJyBjXjXv0pRBMw6yc3o2S51p0QTt1TWngjomhI0WAcwDzE9Aw8ZRqJf6z5nLH/cM0U5XbjAij1G2xJj2toy2ud+vtHTA/xbUQQhkd5hALRtCc3RDxc24CHIlvaWVVw==',key_name='tempest-keypair-973036274',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:36:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-hkpalzej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:36:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=8811e708-b8c0-4bad-9d97-2be84aef2cc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "address": "fa:16:3e:c0:ad:40", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e285374-bb", "ovs_interfaceid": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "address": "fa:16:3e:c0:ad:40", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e285374-bb", "ovs_interfaceid": "7e285374-bb45-4df4-bdc1-c00d4f8a0cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:ad:40,bridge_name='br-int',has_traffic_filtering=True,id=7e285374-bb45-4df4-bdc1-c00d4f8a0cec,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e285374-bb') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_vif [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:ad:40,bridge_name='br-int',has_traffic_filtering=True,id=7e285374-bb45-4df4-bdc1-c00d4f8a0cec,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e285374-bb') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e285374-bb, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7e53cf5-5603-4f20-870e-702ded686bdd) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:41:17 user nova-compute[74311]: INFO os_vif [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:ad:40,bridge_name='br-int',has_traffic_filtering=True,id=7e285374-bb45-4df4-bdc1-c00d4f8a0cec,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e285374-bb')
Oct 20 10:41:17 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TiHFhopz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:41:17 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34b5be7-3877-4205-b964-d4c34c869fbe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:41:17 user nova-compute[74311]: No targets found.
Oct 20 10:41:17 user nova-compute[74311]: iSNS:
Oct 20 10:41:17 user nova-compute[74311]: No targets found.
Oct 20 10:41:17 user nova-compute[74311]: STATIC:
Oct 20 10:41:17 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e
Oct 20 10:41:17 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:41:17 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:41:17 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825
Oct 20 10:41:17 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:41:17 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:41:17 user nova-compute[74311]: FIRMWARE:
Oct 20 10:41:17 user nova-compute[74311]: No targets found.
Oct 20 10:41:17 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:41:17 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:41:17 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a54e90-bc57-434a-9570-d01bde3c638f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64634e2-346a-4ed1-85f7-7b5d94ab0333]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)
Oct 20 10:41:17 user nova-compute[74311]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 (non-flash)
Oct 20 10:41:17 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e (non-flash)
Oct 20 10:41:17 user nova-compute[74311]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 (non-flash)
Oct 20 10:41:17 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164c4d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e49e85-273c-430d-ad99-3c050a8a66b5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca80bf00-e748-499f-94bf-c297af0ee416]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5837f2ef-03ee-443b-b231-7157d846d79f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[081c908b-8856-4f73-88ea-48d2573cfaa0]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a776d671-c423-4e15-a5ba-aa01b660d149]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[782b10e5-dad9-4b9c-95bc-99237c19d5f2]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e, portal: 172.16.0.220,3260]
Oct 20 10:41:17 user nova-compute[74311]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e, portal: 172.16.0.220,3260] successful.
Oct 20 10:41:17 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868bce24-4a1a-4f1b-ab42-63ff5a41cf6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.065s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad7d7fa-b0bc-44f4-bd20-6161a643f94a]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== disconnect_volume: return (384ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:41:17 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Deleting instance files /opt/stack/data/nova/instances/8811e708-b8c0-4bad-9d97-2be84aef2cc6_del
Oct 20 10:41:17 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Deletion of /opt/stack/data/nova/instances/8811e708-b8c0-4bad-9d97-2be84aef2cc6_del complete
Oct 20 10:41:17 user nova-compute[74311]: INFO nova.compute.manager [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Took 1.32 seconds to destroy the instance on the hypervisor.
Oct 20 10:41:17 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:41:17 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:41:18 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:41:18 user nova-compute[74311]: DEBUG nova.compute.manager [req-0001aa93-9494-46d8-af1f-0aae14df8469 req-7a7e92eb-6f4e-4753-88a7-f5894216d582 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Received event network-vif-plugged-7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:41:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0001aa93-9494-46d8-af1f-0aae14df8469 req-7a7e92eb-6f4e-4753-88a7-f5894216d582 service nova] Acquiring lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:41:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0001aa93-9494-46d8-af1f-0aae14df8469 req-7a7e92eb-6f4e-4753-88a7-f5894216d582 service nova] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:41:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0001aa93-9494-46d8-af1f-0aae14df8469 req-7a7e92eb-6f4e-4753-88a7-f5894216d582 service nova] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:41:18 user nova-compute[74311]: DEBUG nova.compute.manager [req-0001aa93-9494-46d8-af1f-0aae14df8469 req-7a7e92eb-6f4e-4753-88a7-f5894216d582 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] No waiting events found dispatching network-vif-plugged-7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:41:18 user nova-compute[74311]: WARNING nova.compute.manager [req-0001aa93-9494-46d8-af1f-0aae14df8469 req-7a7e92eb-6f4e-4753-88a7-f5894216d582 service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Received unexpected event network-vif-plugged-7e285374-bb45-4df4-bdc1-c00d4f8a0cec for instance with vm_state active and task_state deleting.
Oct 20 10:41:18 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Took 1.07 seconds to deallocate network for instance.
Oct 20 10:41:18 user nova-compute[74311]: DEBUG nova.compute.manager [req-1bd495ab-23ef-414a-b8ab-214cb4459033 req-490e5401-970e-4e69-a764-ffe13cdad4fd service nova] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Received event network-vif-deleted-7e285374-bb45-4df4-bdc1-c00d4f8a0cec {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:41:21 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:41:22 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:41:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:23 user nova-compute[74311]: INFO nova.compute.manager [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Took 4.60 seconds to detach 1 volumes for instance.
Oct 20 10:41:23 user nova-compute[74311]: DEBUG nova.compute.manager [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8811e708-b8c0-4bad-9d97-2be84aef2cc6] Deleting volume: 868bce24-4a1a-4f1b-ab42-63ff5a41cf6e {{(pid=74311) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 10:41:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:41:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:41:23 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:41:23 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:41:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:41:23 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Deleted allocations for instance 8811e708-b8c0-4bad-9d97-2be84aef2cc6
Oct 20 10:41:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e6eb1105-27d2-4837-859d-63f47db8fb73 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "8811e708-b8c0-4bad-9d97-2be84aef2cc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.550s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:41:24 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:41:26 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:41:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:41:29 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:41:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:41:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:41:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:41:29 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:41:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:41:29 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:41:29 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:41:29 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=25.208824157714844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:41:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:41:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:41:30 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 44395e02-246c-4923-b163-51289db5d1a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:41:30 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:41:30 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:41:30 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:41:30 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:41:30 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:41:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:41:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:33 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:41:33 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:41:33 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:41:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "44395e02-246c-4923-b163-51289db5d1a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:41:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "44395e02-246c-4923-b163-51289db5d1a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:41:36 user nova-compute[74311]: INFO nova.compute.manager [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Detaching volume 603b5e4f-99c0-407e-8d53-21d9cfee0825
Oct 20 10:41:37 user nova-compute[74311]: INFO nova.virt.block_device [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Attempting to driver detach volume 603b5e4f-99c0-407e-8d53-21d9cfee0825 from mountpoint /dev/vdb
Oct 20 10:41:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Attempting to detach device vdb from instance 44395e02-246c-4923-b163-51289db5d1a3 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:41:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:41:37 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:41:37 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:41:37 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:41:37 user nova-compute[74311]:   <serial>603b5e4f-99c0-407e-8d53-21d9cfee0825</serial>
Oct 20 10:41:37 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:41:37 user nova-compute[74311]: </disk>
Oct 20 10:41:37 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:41:37 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Successfully detached device vdb from instance 44395e02-246c-4923-b163-51289db5d1a3 from the persistent domain config.
Oct 20 10:41:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44395e02-246c-4923-b163-51289db5d1a3 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:41:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:41:37 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:41:37 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:41:37 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:41:37 user nova-compute[74311]:   <serial>603b5e4f-99c0-407e-8d53-21d9cfee0825</serial>
Oct 20 10:41:37 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:41:37 user nova-compute[74311]: </disk>
Oct 20 10:41:37 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:41:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "44395e02-246c-4923-b163-51289db5d1a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:41:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44395e02-246c-4923-b163-51289db5d1a3 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:41:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:41:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:41:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:57 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 44395e02-246c-4923-b163-51289db5d1a3 is timed out.
Oct 20 10:41:57 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Successfully detached device vdb from instance 44395e02-246c-4923-b163-51289db5d1a3 from the live domain config.
Oct 20 10:41:57 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJMnYOLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:41:57 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f4ef66-ab45-4504-bcb1-df3fbd583763]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:41:57 user nova-compute[74311]: No targets found.
Oct 20 10:41:57 user nova-compute[74311]: iSNS:
Oct 20 10:41:57 user nova-compute[74311]: No targets found.
Oct 20 10:41:57 user nova-compute[74311]: STATIC:
Oct 20 10:41:57 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825
Oct 20 10:41:57 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:41:57 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:41:57 user nova-compute[74311]: FIRMWARE:
Oct 20 10:41:57 user nova-compute[74311]: No targets found.
Oct 20 10:41:57 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:41:57 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:41:57 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fd47d6-12ad-49fd-9f69-f501a244d6ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a0a28c-d283-4061-94cd-108cf50b42ac]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 (non-flash)
Oct 20 10:41:57 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 (non-flash)
Oct 20 10:41:57 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1887a1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825'): ({'sdc'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Removing single pathed devices sdc {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1acde36-f57b-4b62-bbee-2f090182865d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a37d1b5-afe4-4f0e-99c6-d9513566e60c]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Flushing IO for device /dev/sdc {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d409c4-2cfa-4694-9865-4318af44eb33]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[50045663-1941-4901-ac15-177af9a0db8b]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[79deb05b-ea32-4795-b0a0-d487415a57d2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e23d8c-f475-4974-b83c-13df7404257e]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825, portal: 172.16.0.220,3260]
Oct 20 10:41:57 user nova-compute[74311]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825, portal: 172.16.0.220,3260] successful.
Oct 20 10:41:57 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[363e9dfc-995f-49a4-a6b4-a5e387e8a359]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] <== disconnect_volume: return (299ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:41:57 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:41:58 user nova-compute[74311]: DEBUG nova.objects.instance [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lazy-loading 'flavor' on Instance uuid 44395e02-246c-4923-b163-51289db5d1a3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:41:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-bc5a8d6f-92e4-4a0c-8320-f41c76b61baa tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "44395e02-246c-4923-b163-51289db5d1a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.731s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:41:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "44395e02-246c-4923-b163-51289db5d1a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.610s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:41:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "44395e02-246c-4923-b163-51289db5d1a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:41:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "44395e02-246c-4923-b163-51289db5d1a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:41:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "44395e02-246c-4923-b163-51289db5d1a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:41:58 user nova-compute[74311]: INFO nova.compute.manager [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Terminating instance
Oct 20 10:41:58 user nova-compute[74311]: DEBUG nova.compute.manager [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:41:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-c82c9e2e-471e-4acb-b096-dba0d6acfb09 req-11785430-f11d-4e74-a30d-9e7765ae41a4 service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Received event network-vif-unplugged-31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c82c9e2e-471e-4acb-b096-dba0d6acfb09 req-11785430-f11d-4e74-a30d-9e7765ae41a4 service nova] Acquiring lock "44395e02-246c-4923-b163-51289db5d1a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c82c9e2e-471e-4acb-b096-dba0d6acfb09 req-11785430-f11d-4e74-a30d-9e7765ae41a4 service nova] Lock "44395e02-246c-4923-b163-51289db5d1a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-c82c9e2e-471e-4acb-b096-dba0d6acfb09 req-11785430-f11d-4e74-a30d-9e7765ae41a4 service nova] Lock "44395e02-246c-4923-b163-51289db5d1a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-c82c9e2e-471e-4acb-b096-dba0d6acfb09 req-11785430-f11d-4e74-a30d-9e7765ae41a4 service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] No waiting events found dispatching network-vif-unplugged-31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG nova.compute.manager [req-c82c9e2e-471e-4acb-b096-dba0d6acfb09 req-11785430-f11d-4e74-a30d-9e7765ae41a4 service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Received event network-vif-unplugged-31d31b6a-108f-4dc6-b217-3d474fac787d for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:59 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Instance destroyed successfully.
Oct 20 10:41:59 user nova-compute[74311]: DEBUG nova.objects.instance [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lazy-loading 'resources' on Instance uuid 44395e02-246c-4923-b163-51289db5d1a3 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:38:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-387053839',display_name='tempest-VolumesSnapshotTestJSON-instance-387053839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-387053839',id=44,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8YAGHWNpllpbs5qPgaQtUf4n3RBKpndoTQPk5d+Fg/Ur4Gv1JbFppnKjwiOamLDZJVc9DBT40jRCVO5vd+QBoEtquE1p0e5ZBe2A+D4T1QhlX5qDNUH9hbxZalBpKfsQ==',key_name='tempest-keypair-637392144',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:38:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e14e8b4071d4f0591e65fededd0f2fd',ramdisk_id='',reservation_id='r-w1f1u0sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1070048329',owner_user_name='tempest-VolumesSnapshotTestJSON-1070048329-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dda3552abdb4cee967ce9cac71580ba',uuid=44395e02-246c-4923-b163-51289db5d1a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31d31b6a-108f-4dc6-b217-3d474fac787d", "address": "fa:16:3e:5d:c7:c3", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d31b6a-10", "ovs_interfaceid": "31d31b6a-108f-4dc6-b217-3d474fac787d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Converting VIF {"id": "31d31b6a-108f-4dc6-b217-3d474fac787d", "address": "fa:16:3e:5d:c7:c3", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31d31b6a-10", "ovs_interfaceid": "31d31b6a-108f-4dc6-b217-3d474fac787d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:c7:c3,bridge_name='br-int',has_traffic_filtering=True,id=31d31b6a-108f-4dc6-b217-3d474fac787d,network=Network(3f659357-90d1-42cc-99de-5959812bf2fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d31b6a-10') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG os_vif [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:c7:c3,bridge_name='br-int',has_traffic_filtering=True,id=31d31b6a-108f-4dc6-b217-3d474fac787d,network=Network(3f659357-90d1-42cc-99de-5959812bf2fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d31b6a-10') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31d31b6a-10, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bfe97ec4-732b-49b4-b292-36163b1b8ca0) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:41:59 user nova-compute[74311]: INFO os_vif [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:c7:c3,bridge_name='br-int',has_traffic_filtering=True,id=31d31b6a-108f-4dc6-b217-3d474fac787d,network=Network(3f659357-90d1-42cc-99de-5959812bf2fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31d31b6a-10')
Oct 20 10:41:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:603b5e4f-99c0-407e-8d53-21d9cfee0825', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJMnYOLD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:41:59 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:41:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[2f28e16f-a36a-4b92-9305-ab778203b6be]: Unexpected error while running command.
Oct 20 10:41:59 user nova-compute[74311]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 10:41:59 user nova-compute[74311]: Exit code: 21
Oct 20 10:41:59 user nova-compute[74311]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 10:41:59 user nova-compute[74311]: Stderr: '' {{(pid=85589) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 20 10:41:59 user nova-compute[74311]: Traceback (most recent call last):
Oct 20 10:41:59 user nova-compute[74311]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 20 10:41:59 user nova-compute[74311]:     ret = func(*f_args, **f_kwargs)
Oct 20 10:41:59 user nova-compute[74311]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 20 10:41:59 user nova-compute[74311]:     return func(*args, **kwargs)
Oct 20 10:41:59 user nova-compute[74311]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 20 10:41:59 user nova-compute[74311]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 20 10:41:59 user nova-compute[74311]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 20 10:41:59 user nova-compute[74311]:     return putils.execute(on_execute=on_execute,
Oct 20 10:41:59 user nova-compute[74311]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 20 10:41:59 user nova-compute[74311]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 20 10:41:59 user nova-compute[74311]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 10:41:59 user nova-compute[74311]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 10:41:59 user nova-compute[74311]: Exit code: 21
Oct 20 10:41:59 user nova-compute[74311]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 10:41:59 user nova-compute[74311]: Stderr: ''
Oct 20 10:41:59 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f28e16f-a36a-4b92-9305-ab778203b6be]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 10:41:59 user nova-compute[74311]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 10:41:59 user nova-compute[74311]: Exit code: 21
Oct 20 10:41:59 user nova-compute[74311]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 10:41:59 user nova-compute[74311]: Stderr: ''
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 20 10:41:59 user nova-compute[74311]: ERROR os_brick.initiator.connectors.iscsi 
Oct 20 10:41:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74311) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] <== disconnect_volume: return (64ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:41:59 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Deleting instance files /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3_del
Oct 20 10:41:59 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Deletion of /opt/stack/data/nova/instances/44395e02-246c-4923-b163-51289db5d1a3_del complete
Oct 20 10:41:59 user nova-compute[74311]: INFO nova.compute.manager [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 20 10:41:59 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:41:59 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 44395e02-246c-4923-b163-51289db5d1a3] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:42:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:00 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:42:00 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Took 1.31 seconds to deallocate network for instance.
Oct 20 10:42:01 user nova-compute[74311]: WARNING nova.volume.cinder [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Attachment 1b54b1a6-ebc3-4bb3-b551-2bc2d93224fc does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1b54b1a6-ebc3-4bb3-b551-2bc2d93224fc. (HTTP 404) (Request-ID: req-2b21928b-84f9-49d8-8c75-95204d3d3c14)
Oct 20 10:42:01 user nova-compute[74311]: INFO nova.compute.manager [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Took 0.03 seconds to detach 1 volumes for instance.
Oct 20 10:42:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-f505065b-bd85-44b4-b244-b6c6b5a92793 req-c4a5bc82-b9fa-44c7-b641-f3c0431baa6b service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Received event network-vif-deleted-31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:42:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-7ec1205c-5e72-4225-9de8-c140ee910b1f req-9f70bf8c-cc8b-4851-a45c-abe6af11768e service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Received event network-vif-plugged-31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:42:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7ec1205c-5e72-4225-9de8-c140ee910b1f req-9f70bf8c-cc8b-4851-a45c-abe6af11768e service nova] Acquiring lock "44395e02-246c-4923-b163-51289db5d1a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7ec1205c-5e72-4225-9de8-c140ee910b1f req-9f70bf8c-cc8b-4851-a45c-abe6af11768e service nova] Lock "44395e02-246c-4923-b163-51289db5d1a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7ec1205c-5e72-4225-9de8-c140ee910b1f req-9f70bf8c-cc8b-4851-a45c-abe6af11768e service nova] Lock "44395e02-246c-4923-b163-51289db5d1a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-7ec1205c-5e72-4225-9de8-c140ee910b1f req-9f70bf8c-cc8b-4851-a45c-abe6af11768e service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] No waiting events found dispatching network-vif-plugged-31d31b6a-108f-4dc6-b217-3d474fac787d {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:42:01 user nova-compute[74311]: WARNING nova.compute.manager [req-7ec1205c-5e72-4225-9de8-c140ee910b1f req-9f70bf8c-cc8b-4851-a45c-abe6af11768e service nova] [instance: 44395e02-246c-4923-b163-51289db5d1a3] Received unexpected event network-vif-plugged-31d31b6a-108f-4dc6-b217-3d474fac787d for instance with vm_state deleted and task_state None.
Oct 20 10:42:01 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:42:01 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:42:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:01 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Deleted allocations for instance 44395e02-246c-4923-b163-51289db5d1a3
Oct 20 10:42:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-94d5938b-a10d-40da-96c4-4f0fb3f3eaca tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "44395e02-246c-4923-b163-51289db5d1a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.668s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "785fdcb1-5995-485c-a931-3a2537700785" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:05 user nova-compute[74311]: DEBUG nova.compute.manager [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:42:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:05 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:05 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:42:05 user nova-compute[74311]: INFO nova.compute.claims [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Claim successful on node user
Oct 20 10:42:06 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:42:06 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:42:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.181s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:42:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:42:06 user nova-compute[74311]: DEBUG nova.network.neutron [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:42:06 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:42:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:42:06 user nova-compute[74311]: DEBUG nova.policy [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24c8f83400ef489e88a4f719e301b284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bfc1cd59d4be3b98ddad43a8d3002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:42:06 user nova-compute[74311]: DEBUG nova.compute.manager [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:42:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:42:06 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Creating image(s)
Oct 20 10:42:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "/opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "/opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "/opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "06848d39871d8b1145d2899fba6f32185867605a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "06848d39871d8b1145d2899fba6f32185867605a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a.part --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Successfully created port: 7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a.part --force-share --output=json" returned: 0 in 0.194s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG nova.virt.images [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] 706b4482-9d7a-46aa-99c8-d2406826b5cd was qcow2, converting to raw {{(pid=74311) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a.part /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a.converted {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a.part /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a.converted" returned: 0 in 0.343s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a.converted --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Successfully updated port: 7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquired lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "06848d39871d8b1145d2899fba6f32185867605a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.389s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG nova.compute.manager [req-19327c7e-aeec-4581-a9d2-0e360070cf7c req-02020c2d-a77c-4753-aacc-6babeb34cec3 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-changed-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG nova.compute.manager [req-19327c7e-aeec-4581-a9d2-0e360070cf7c req-02020c2d-a77c-4753-aacc-6babeb34cec3 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Refreshing instance network info cache due to event network-changed-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-19327c7e-aeec-4581-a9d2-0e360070cf7c req-02020c2d-a77c-4753-aacc-6babeb34cec3 service nova] Acquiring lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG nova.network.neutron [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "06848d39871d8b1145d2899fba6f32185867605a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "06848d39871d8b1145d2899fba6f32185867605a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.network.neutron [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updating instance_info_cache with network_info: [{"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Releasing lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Instance network_info: |[{"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-19327c7e-aeec-4581-a9d2-0e360070cf7c req-02020c2d-a77c-4753-aacc-6babeb34cec3 service nova] Acquired lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.network.neutron [req-19327c7e-aeec-4581-a9d2-0e360070cf7c req-02020c2d-a77c-4753-aacc-6babeb34cec3 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Refreshing network info cache for port 7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a --force-share --output=json" returned: 0 in 0.199s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a,backing_fmt=raw /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a,backing_fmt=raw /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk 1073741824" returned: 0 in 0.057s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "06848d39871d8b1145d2899fba6f32185867605a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a --force-share --output=json" returned: 0 in 0.170s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Cannot resize image /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Ensure instance console log exists: /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Start _get_guest_xml network_info=[{"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:42:03Z,direct_url=<?>,disk_format='qcow2',id=706b4482-9d7a-46aa-99c8-d2406826b5cd,min_disk=0,min_ram=0,name='tempest-scenario-img--124033119',owner='b78bfc1cd59d4be3b98ddad43a8d3002',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:42:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '706b4482-9d7a-46aa-99c8-d2406826b5cd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.network.neutron [req-19327c7e-aeec-4581-a9d2-0e360070cf7c req-02020c2d-a77c-4753-aacc-6babeb34cec3 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updated VIF entry in instance network info cache for port 7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.network.neutron [req-19327c7e-aeec-4581-a9d2-0e360070cf7c req-02020c2d-a77c-4753-aacc-6babeb34cec3 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updating instance_info_cache with network_info: [{"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:42:08 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:42:08 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:42:03Z,direct_url=<?>,disk_format='qcow2',id=706b4482-9d7a-46aa-99c8-d2406826b5cd,min_disk=0,min_ram=0,name='tempest-scenario-img--124033119',owner='b78bfc1cd59d4be3b98ddad43a8d3002',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:42:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1156781070',display_name='tempest-TestMinimumBasicScenario-server-1156781070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1156781070',id=45,image_ref='706b4482-9d7a-46aa-99c8-d2406826b5cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj/D+1WyPOap3Jo+vC1Q5hCcw2yS28HXSOkgxqKTeUc8i0RUKyxTssv6yVsUkIvEWvb+Zgt5GLVTyuUKFt32znAPpJwn0pqltkVaRupLZFTExIPcZcBWT14VOcMt4epMQ==',key_name='tempest-TestMinimumBasicScenario-43511418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b78bfc1cd59d4be3b98ddad43a8d3002',ramdisk_id='',reservation_id='r-uwxccota',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='706b4482-9d7a-46aa-99c8-d2406826b5cd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1072164048',owner_user_name='tempest-TestMinimumBasicScenario-1072164048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:42:06Z,user_data=None,user_id='24c8f83400ef489e88a4f719e301b284',uuid=785fdcb1-5995-485c-a931-3a2537700785,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converting VIF {"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:32:c1,bridge_name='br-int',has_traffic_filtering=True,id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dadfb0d-8e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.objects.instance [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'pci_devices' on Instance uuid 785fdcb1-5995-485c-a931-3a2537700785 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-19327c7e-aeec-4581-a9d2-0e360070cf7c req-02020c2d-a77c-4753-aacc-6babeb34cec3 service nova] Releasing lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:42:08 user nova-compute[74311]:   <uuid>785fdcb1-5995-485c-a931-3a2537700785</uuid>
Oct 20 10:42:08 user nova-compute[74311]:   <name>instance-0000002d</name>
Oct 20 10:42:08 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:42:08 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:42:08 user nova-compute[74311]:   <metadata>
Oct 20 10:42:08 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:42:08 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:42:08 user nova-compute[74311]:       <nova:name>tempest-TestMinimumBasicScenario-server-1156781070</nova:name>
Oct 20 10:42:08 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:42:08</nova:creationTime>
Oct 20 10:42:08 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:42:08 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:42:08 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:42:08 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:42:08 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:42:08 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:42:08 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:42:08 user nova-compute[74311]:       <nova:owner>
Oct 20 10:42:08 user nova-compute[74311]:         <nova:user uuid="24c8f83400ef489e88a4f719e301b284">tempest-TestMinimumBasicScenario-1072164048-project-member</nova:user>
Oct 20 10:42:08 user nova-compute[74311]:         <nova:project uuid="b78bfc1cd59d4be3b98ddad43a8d3002">tempest-TestMinimumBasicScenario-1072164048</nova:project>
Oct 20 10:42:08 user nova-compute[74311]:       </nova:owner>
Oct 20 10:42:08 user nova-compute[74311]:       <nova:root type="image" uuid="706b4482-9d7a-46aa-99c8-d2406826b5cd"/>
Oct 20 10:42:08 user nova-compute[74311]:       <nova:ports>
Oct 20 10:42:08 user nova-compute[74311]:         <nova:port uuid="7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9">
Oct 20 10:42:08 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 10:42:08 user nova-compute[74311]:         </nova:port>
Oct 20 10:42:08 user nova-compute[74311]:       </nova:ports>
Oct 20 10:42:08 user nova-compute[74311]:     </nova:instance>
Oct 20 10:42:08 user nova-compute[74311]:   </metadata>
Oct 20 10:42:08 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:42:08 user nova-compute[74311]:     <system>
Oct 20 10:42:08 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:42:08 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:42:08 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:42:08 user nova-compute[74311]:       <entry name="serial">785fdcb1-5995-485c-a931-3a2537700785</entry>
Oct 20 10:42:08 user nova-compute[74311]:       <entry name="uuid">785fdcb1-5995-485c-a931-3a2537700785</entry>
Oct 20 10:42:08 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:42:08 user nova-compute[74311]:     </system>
Oct 20 10:42:08 user nova-compute[74311]:   </sysinfo>
Oct 20 10:42:08 user nova-compute[74311]:   <os>
Oct 20 10:42:08 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:42:08 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:42:08 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:42:08 user nova-compute[74311]:   </os>
Oct 20 10:42:08 user nova-compute[74311]:   <features>
Oct 20 10:42:08 user nova-compute[74311]:     <acpi/>
Oct 20 10:42:08 user nova-compute[74311]:     <apic/>
Oct 20 10:42:08 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:42:08 user nova-compute[74311]:   </features>
Oct 20 10:42:08 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:42:08 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:42:08 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:42:08 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:42:08 user nova-compute[74311]:   </clock>
Oct 20 10:42:08 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:42:08 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:42:08 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:42:08 user nova-compute[74311]:   </cpu>
Oct 20 10:42:08 user nova-compute[74311]:   <devices>
Oct 20 10:42:08 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:42:08 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:42:08 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk"/>
Oct 20 10:42:08 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:42:08 user nova-compute[74311]:     </disk>
Oct 20 10:42:08 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:42:08 user nova-compute[74311]:       <mac address="fa:16:3e:d2:32:c1"/>
Oct 20 10:42:08 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:42:08 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:42:08 user nova-compute[74311]:       <target dev="tap7dadfb0d-8e"/>
Oct 20 10:42:08 user nova-compute[74311]:     </interface>
Oct 20 10:42:08 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:42:08 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/console.log" append="off"/>
Oct 20 10:42:08 user nova-compute[74311]:     </serial>
Oct 20 10:42:08 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:42:08 user nova-compute[74311]:     <video>
Oct 20 10:42:08 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:42:08 user nova-compute[74311]:     </video>
Oct 20 10:42:08 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:42:08 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:42:08 user nova-compute[74311]:     </rng>
Oct 20 10:42:08 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:42:08 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:42:08 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:42:08 user nova-compute[74311]:     </memballoon>
Oct 20 10:42:08 user nova-compute[74311]:   </devices>
Oct 20 10:42:08 user nova-compute[74311]: </domain>
Oct 20 10:42:08 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1156781070',display_name='tempest-TestMinimumBasicScenario-server-1156781070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1156781070',id=45,image_ref='706b4482-9d7a-46aa-99c8-d2406826b5cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj/D+1WyPOap3Jo+vC1Q5hCcw2yS28HXSOkgxqKTeUc8i0RUKyxTssv6yVsUkIvEWvb+Zgt5GLVTyuUKFt32znAPpJwn0pqltkVaRupLZFTExIPcZcBWT14VOcMt4epMQ==',key_name='tempest-TestMinimumBasicScenario-43511418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b78bfc1cd59d4be3b98ddad43a8d3002',ramdisk_id='',reservation_id='r-uwxccota',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='706b4482-9d7a-46aa-99c8-d2406826b5cd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1072164048',owner_user_name='tempest-TestMinimumBasicScenario-1072164048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:42:06Z,user_data=None,user_id='24c8f83400ef489e88a4f719e301b284',uuid=785fdcb1-5995-485c-a931-3a2537700785,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converting VIF {"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:32:c1,bridge_name='br-int',has_traffic_filtering=True,id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dadfb0d-8e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG os_vif [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:32:c1,bridge_name='br-int',has_traffic_filtering=True,id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dadfb0d-8e') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfda2a8b-7e44-5dba-ae21-2dcc144c421b', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7dadfb0d-8e, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7dadfb0d-8e, col_values=(('qos', UUID('d8fdc4ae-538a-4822-bd97-c46db944d7d3')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7dadfb0d-8e, col_values=(('external_ids', {'iface-id': '7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:32:c1', 'vm-uuid': '785fdcb1-5995-485c-a931-3a2537700785'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:08 user nova-compute[74311]: INFO os_vif [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:32:c1,bridge_name='br-int',has_traffic_filtering=True,id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dadfb0d-8e')
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:42:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] No VIF found with MAC fa:16:3e:d2:32:c1, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:42:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-4ffc6f0d-dc61-4c81-8151-5c77a4d6bfd5 req-c5674ec6-0af9-4225-be0d-b3bbaab1ce38 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:42:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ffc6f0d-dc61-4c81-8151-5c77a4d6bfd5 req-c5674ec6-0af9-4225-be0d-b3bbaab1ce38 service nova] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ffc6f0d-dc61-4c81-8151-5c77a4d6bfd5 req-c5674ec6-0af9-4225-be0d-b3bbaab1ce38 service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4ffc6f0d-dc61-4c81-8151-5c77a4d6bfd5 req-c5674ec6-0af9-4225-be0d-b3bbaab1ce38 service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:10 user nova-compute[74311]: DEBUG nova.compute.manager [req-4ffc6f0d-dc61-4c81-8151-5c77a4d6bfd5 req-c5674ec6-0af9-4225-be0d-b3bbaab1ce38 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] No waiting events found dispatching network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:42:10 user nova-compute[74311]: WARNING nova.compute.manager [req-4ffc6f0d-dc61-4c81-8151-5c77a4d6bfd5 req-c5674ec6-0af9-4225-be0d-b3bbaab1ce38 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received unexpected event network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 for instance with vm_state building and task_state spawning.
Oct 20 10:42:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:42:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:42:12 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Instance spawned successfully.
Oct 20 10:42:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:42:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:12 user nova-compute[74311]: INFO nova.compute.manager [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Took 6.32 seconds to spawn the instance on the hypervisor.
Oct 20 10:42:12 user nova-compute[74311]: DEBUG nova.compute.manager [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:42:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-2ba1165a-a86f-4962-a85b-ac23bb7cd304 req-e63219b7-32e7-4c80-9498-f9729170992e service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:42:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2ba1165a-a86f-4962-a85b-ac23bb7cd304 req-e63219b7-32e7-4c80-9498-f9729170992e service nova] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2ba1165a-a86f-4962-a85b-ac23bb7cd304 req-e63219b7-32e7-4c80-9498-f9729170992e service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2ba1165a-a86f-4962-a85b-ac23bb7cd304 req-e63219b7-32e7-4c80-9498-f9729170992e service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:12 user nova-compute[74311]: DEBUG nova.compute.manager [req-2ba1165a-a86f-4962-a85b-ac23bb7cd304 req-e63219b7-32e7-4c80-9498-f9729170992e service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] No waiting events found dispatching network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:42:12 user nova-compute[74311]: WARNING nova.compute.manager [req-2ba1165a-a86f-4962-a85b-ac23bb7cd304 req-e63219b7-32e7-4c80-9498-f9729170992e service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received unexpected event network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 for instance with vm_state building and task_state spawning.
Oct 20 10:42:12 user nova-compute[74311]: INFO nova.compute.manager [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Took 6.82 seconds to build instance.
Oct 20 10:42:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-12c3c4af-6bb2-4226-81db-eb2266373b4f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "785fdcb1-5995-485c-a931-3a2537700785" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.917s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:14 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:42:14 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:42:14 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:42:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:42:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:42:14 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:42:14 user nova-compute[74311]: DEBUG nova.objects.instance [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lazy-loading 'info_cache' on Instance uuid 785fdcb1-5995-485c-a931-3a2537700785 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:42:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:14 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updating instance_info_cache with network_info: [{"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:42:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:42:14 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:42:16 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:42:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:22 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:42:23 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:42:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:25 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:42:26 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:42:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:42:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:26 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:42:26 user nova-compute[74311]: INFO nova.compute.claims [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Claim successful on node user
Oct 20 10:42:26 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:42:26 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:42:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG nova.compute.manager [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG nova.network.neutron [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:42:27 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:42:27 user nova-compute[74311]: DEBUG nova.policy [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9634a3daf064bf2aad6ea38454f7639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7a52d2fa8243fabc22baa8694e14d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG nova.compute.manager [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:42:27 user nova-compute[74311]: INFO nova.virt.block_device [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Booting with volume e4b55e17-9b40-477a-8918-536f0e39236b at /dev/vda
Oct 20 10:42:27 user nova-compute[74311]: DEBUG os_brick.utils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bd24d6-2db3-45cb-a411-a21cfd6ee983]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[64579de4-e345-4dba-92be-cd0a229e9f29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07c5af2-3d1c-4dc2-8607-8811f589ca3e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e50f06-ea18-4d90-9a9a-42f38b802372]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:42:27 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:42:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bca9a19-f246-4164-bf22-dd928762ef0b]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG os_brick.utils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:42:27 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Updating existing volume attachment record: 9c4e630c-f21a-4397-a595-3ef09496c707 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:42:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:28 user nova-compute[74311]: DEBUG nova.network.neutron [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Successfully created port: e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:42:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:28 user nova-compute[74311]: DEBUG nova.network.neutron [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Successfully updated port: e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:42:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "refresh_cache-a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:42:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquired lock "refresh_cache-a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:42:28 user nova-compute[74311]: DEBUG nova.network.neutron [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:42:28 user nova-compute[74311]: DEBUG nova.compute.manager [req-a88a2113-89d4-4a65-8c8b-52b1c3a5ae7f req-08cfb655-896f-4677-ac70-f581239633ac service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Received event network-changed-e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:42:28 user nova-compute[74311]: DEBUG nova.compute.manager [req-a88a2113-89d4-4a65-8c8b-52b1c3a5ae7f req-08cfb655-896f-4677-ac70-f581239633ac service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Refreshing instance network info cache due to event network-changed-e1d343aa-4e85-480e-9f73-f422ed0bbf8c. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:42:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a88a2113-89d4-4a65-8c8b-52b1c3a5ae7f req-08cfb655-896f-4677-ac70-f581239633ac service nova] Acquiring lock "refresh_cache-a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:42:28 user nova-compute[74311]: DEBUG nova.network.neutron [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG nova.network.neutron [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Updating instance_info_cache with network_info: [{"id": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "address": "fa:16:3e:4e:8f:7c", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d343aa-4e", "ovs_interfaceid": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Releasing lock "refresh_cache-a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG nova.compute.manager [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Instance network_info: |[{"id": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "address": "fa:16:3e:4e:8f:7c", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d343aa-4e", "ovs_interfaceid": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a88a2113-89d4-4a65-8c8b-52b1c3a5ae7f req-08cfb655-896f-4677-ac70-f581239633ac service nova] Acquired lock "refresh_cache-a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG nova.network.neutron [req-a88a2113-89d4-4a65-8c8b-52b1c3a5ae7f req-08cfb655-896f-4677-ac70-f581239633ac service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Refreshing network info cache for port e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG nova.network.neutron [req-a88a2113-89d4-4a65-8c8b-52b1c3a5ae7f req-08cfb655-896f-4677-ac70-f581239633ac service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Updated VIF entry in instance network info cache for port e1d343aa-4e85-480e-9f73-f422ed0bbf8c. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG nova.network.neutron [req-a88a2113-89d4-4a65-8c8b-52b1c3a5ae7f req-08cfb655-896f-4677-ac70-f581239633ac service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Updating instance_info_cache with network_info: [{"id": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "address": "fa:16:3e:4e:8f:7c", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d343aa-4e", "ovs_interfaceid": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:42:29 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:42:29 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:42:29 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8722MB free_disk=25.137466430664062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a88a2113-89d4-4a65-8c8b-52b1c3a5ae7f req-08cfb655-896f-4677-ac70-f581239633ac service nova] Releasing lock "refresh_cache-a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 785fdcb1-5995-485c-a931-3a2537700785 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance a7f5f818-c2a3-4543-a6c2-80d7fc46dd64 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:42:29 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:42:30 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:42:30 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:42:30 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:42:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:33 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:42:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:33 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:42:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:35 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:42:35 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:42:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:40 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.compute.manager [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:42:44 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Creating image(s)
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Ensure instance console log exists: /opt/stack/data/nova/instances/a7f5f818-c2a3-4543-a6c2-80d7fc46dd64/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Start _get_guest_xml network_info=[{"id": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "address": "fa:16:3e:4e:8f:7c", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d343aa-4e", "ovs_interfaceid": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '9c4e630c-f21a-4397-a595-3ef09496c707', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TojvNfEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a7f5f818-c2a3-4543-a6c2-80d7fc46dd64', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4b55e17-9b40-477a-8918-536f0e39236b', 'serial': 'e4b55e17-9b40-477a-8918-536f0e39236b'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:42:44 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:42:44 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:42:44 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TojvNfEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:42:45 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:42:45 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:42:45 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a689b474-5751-4998-9b4d-2b506202e1c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:42:45 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c695cf9-1c65-413e-918f-3b49d6a4bed4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b] added
Oct 20 10:42:45 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8031dcfb-57c3-4e88-aa2b-2758282e2f60]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a354cf-606d-4631-80d5-d3bfbf7abb7a]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TojvNfEc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TojvNfEc" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a436b1-fc01-4e5e-b5a7-2ffcc1b8504b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TojvNfEc'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[386d4b91-fd43-4b58-bec1-b987c6d3f2d7]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d7bf5b-2296-48de-b75a-2108dff6d7a6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:42:45 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:42:45 user nova-compute[74311]:  {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:42:45 user nova-compute[74311]: WARNING os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 10:42:45 user nova-compute[74311]: 
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b78685-59d6-47e5-a1ba-d81c91ba4edd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260]
Oct 20 10:42:45 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260] successful.
Oct 20 10:42:45 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea05187-68ed-4453-b36a-a983ec6025fe]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82b9ee5-6438-4026-abb7-52bfcebbab9a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:42:45 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:42:45 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[09370dc8-8892-428a-acf8-f49dae4e2a78]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:42:45 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TojvNfEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26265376338346539', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265376338346539', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-200079669',display_name='tempest-TestVolumeBootPattern-server-200079669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-200079669',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3a39KFZ17bE3ncvzIcH4Vxw/Y2gdrgDREcztfOEHBNO1uipHHk2Y+XPwHgE3eoiT29JTcO8Ys40E+uqpMDlmjQ529gbmWean5D7IYFP305bqhP5ciafYVbX9wu+N+nLQ==',key_name='tempest-TestVolumeBootPattern-1713092442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-2l9mjj76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:42:27Z,user_data=None,user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=a7f5f818-c2a3-4543-a6c2-80d7fc46dd64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "address": "fa:16:3e:4e:8f:7c", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d343aa-4e", "ovs_interfaceid": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "address": "fa:16:3e:4e:8f:7c", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d343aa-4e", "ovs_interfaceid": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:8f:7c,bridge_name='br-int',has_traffic_filtering=True,id=e1d343aa-4e85-480e-9f73-f422ed0bbf8c,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d343aa-4e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG nova.objects.instance [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lazy-loading 'pci_devices' on Instance uuid a7f5f818-c2a3-4543-a6c2-80d7fc46dd64 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:42:46 user nova-compute[74311]:   <uuid>a7f5f818-c2a3-4543-a6c2-80d7fc46dd64</uuid>
Oct 20 10:42:46 user nova-compute[74311]:   <name>instance-0000002e</name>
Oct 20 10:42:46 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:42:46 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:42:46 user nova-compute[74311]:   <metadata>
Oct 20 10:42:46 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:42:46 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:42:46 user nova-compute[74311]:       <nova:name>tempest-TestVolumeBootPattern-server-200079669</nova:name>
Oct 20 10:42:46 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:42:44</nova:creationTime>
Oct 20 10:42:46 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:42:46 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:42:46 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:42:46 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:42:46 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:42:46 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:42:46 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:42:46 user nova-compute[74311]:       <nova:owner>
Oct 20 10:42:46 user nova-compute[74311]:         <nova:user uuid="f9634a3daf064bf2aad6ea38454f7639">tempest-TestVolumeBootPattern-1419375529-project-member</nova:user>
Oct 20 10:42:46 user nova-compute[74311]:         <nova:project uuid="aa7a52d2fa8243fabc22baa8694e14d6">tempest-TestVolumeBootPattern-1419375529</nova:project>
Oct 20 10:42:46 user nova-compute[74311]:       </nova:owner>
Oct 20 10:42:46 user nova-compute[74311]:       <nova:ports>
Oct 20 10:42:46 user nova-compute[74311]:         <nova:port uuid="e1d343aa-4e85-480e-9f73-f422ed0bbf8c">
Oct 20 10:42:46 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 10:42:46 user nova-compute[74311]:         </nova:port>
Oct 20 10:42:46 user nova-compute[74311]:       </nova:ports>
Oct 20 10:42:46 user nova-compute[74311]:     </nova:instance>
Oct 20 10:42:46 user nova-compute[74311]:   </metadata>
Oct 20 10:42:46 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:42:46 user nova-compute[74311]:     <system>
Oct 20 10:42:46 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:42:46 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:42:46 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:42:46 user nova-compute[74311]:       <entry name="serial">a7f5f818-c2a3-4543-a6c2-80d7fc46dd64</entry>
Oct 20 10:42:46 user nova-compute[74311]:       <entry name="uuid">a7f5f818-c2a3-4543-a6c2-80d7fc46dd64</entry>
Oct 20 10:42:46 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:42:46 user nova-compute[74311]:     </system>
Oct 20 10:42:46 user nova-compute[74311]:   </sysinfo>
Oct 20 10:42:46 user nova-compute[74311]:   <os>
Oct 20 10:42:46 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:42:46 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:42:46 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:42:46 user nova-compute[74311]:   </os>
Oct 20 10:42:46 user nova-compute[74311]:   <features>
Oct 20 10:42:46 user nova-compute[74311]:     <acpi/>
Oct 20 10:42:46 user nova-compute[74311]:     <apic/>
Oct 20 10:42:46 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:42:46 user nova-compute[74311]:   </features>
Oct 20 10:42:46 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:42:46 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:42:46 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:42:46 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:42:46 user nova-compute[74311]:   </clock>
Oct 20 10:42:46 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:42:46 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:42:46 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:42:46 user nova-compute[74311]:   </cpu>
Oct 20 10:42:46 user nova-compute[74311]:   <devices>
Oct 20 10:42:46 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:42:46 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:42:46 user nova-compute[74311]:       <source dev="/dev/sdb"/>
Oct 20 10:42:46 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:42:46 user nova-compute[74311]:       <serial>e4b55e17-9b40-477a-8918-536f0e39236b</serial>
Oct 20 10:42:46 user nova-compute[74311]:     </disk>
Oct 20 10:42:46 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:42:46 user nova-compute[74311]:       <mac address="fa:16:3e:4e:8f:7c"/>
Oct 20 10:42:46 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:42:46 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:42:46 user nova-compute[74311]:       <target dev="tape1d343aa-4e"/>
Oct 20 10:42:46 user nova-compute[74311]:     </interface>
Oct 20 10:42:46 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:42:46 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/a7f5f818-c2a3-4543-a6c2-80d7fc46dd64/console.log" append="off"/>
Oct 20 10:42:46 user nova-compute[74311]:     </serial>
Oct 20 10:42:46 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:42:46 user nova-compute[74311]:     <video>
Oct 20 10:42:46 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:42:46 user nova-compute[74311]:     </video>
Oct 20 10:42:46 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:42:46 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:42:46 user nova-compute[74311]:     </rng>
Oct 20 10:42:46 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:42:46 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:42:46 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:42:46 user nova-compute[74311]:     </memballoon>
Oct 20 10:42:46 user nova-compute[74311]:   </devices>
Oct 20 10:42:46 user nova-compute[74311]: </domain>
Oct 20 10:42:46 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-200079669',display_name='tempest-TestVolumeBootPattern-server-200079669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-200079669',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3a39KFZ17bE3ncvzIcH4Vxw/Y2gdrgDREcztfOEHBNO1uipHHk2Y+XPwHgE3eoiT29JTcO8Ys40E+uqpMDlmjQ529gbmWean5D7IYFP305bqhP5ciafYVbX9wu+N+nLQ==',key_name='tempest-TestVolumeBootPattern-1713092442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-2l9mjj76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:42:27Z,user_data=None,user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=a7f5f818-c2a3-4543-a6c2-80d7fc46dd64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "address": "fa:16:3e:4e:8f:7c", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d343aa-4e", "ovs_interfaceid": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "address": "fa:16:3e:4e:8f:7c", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d343aa-4e", "ovs_interfaceid": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:8f:7c,bridge_name='br-int',has_traffic_filtering=True,id=e1d343aa-4e85-480e-9f73-f422ed0bbf8c,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d343aa-4e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG os_vif [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:8f:7c,bridge_name='br-int',has_traffic_filtering=True,id=e1d343aa-4e85-480e-9f73-f422ed0bbf8c,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d343aa-4e') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c28bb4b-fcab-584c-9326-adcbe9391b95', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1d343aa-4e, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1d343aa-4e, col_values=(('qos', UUID('025e6a42-256d-4520-bf1b-9555fa319a66')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1d343aa-4e, col_values=(('external_ids', {'iface-id': 'e1d343aa-4e85-480e-9f73-f422ed0bbf8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:8f:7c', 'vm-uuid': 'a7f5f818-c2a3-4543-a6c2-80d7fc46dd64'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:46 user nova-compute[74311]: INFO os_vif [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:8f:7c,bridge_name='br-int',has_traffic_filtering=True,id=e1d343aa-4e85-480e-9f73-f422ed0bbf8c,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d343aa-4e')
Oct 20 10:42:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] No VIF found with MAC fa:16:3e:4e:8f:7c, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:42:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:48 user nova-compute[74311]: DEBUG nova.compute.manager [req-e1bb582f-334d-43bc-b9bd-8b4000fa155c req-9d83f6e3-b270-415e-90b5-e8bd2f0cc5d5 service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Received event network-vif-plugged-e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:42:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e1bb582f-334d-43bc-b9bd-8b4000fa155c req-9d83f6e3-b270-415e-90b5-e8bd2f0cc5d5 service nova] Acquiring lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e1bb582f-334d-43bc-b9bd-8b4000fa155c req-9d83f6e3-b270-415e-90b5-e8bd2f0cc5d5 service nova] Lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e1bb582f-334d-43bc-b9bd-8b4000fa155c req-9d83f6e3-b270-415e-90b5-e8bd2f0cc5d5 service nova] Lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:48 user nova-compute[74311]: DEBUG nova.compute.manager [req-e1bb582f-334d-43bc-b9bd-8b4000fa155c req-9d83f6e3-b270-415e-90b5-e8bd2f0cc5d5 service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] No waiting events found dispatching network-vif-plugged-e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:42:48 user nova-compute[74311]: WARNING nova.compute.manager [req-e1bb582f-334d-43bc-b9bd-8b4000fa155c req-9d83f6e3-b270-415e-90b5-e8bd2f0cc5d5 service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Received unexpected event network-vif-plugged-e1d343aa-4e85-480e-9f73-f422ed0bbf8c for instance with vm_state building and task_state spawning.
Oct 20 10:42:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:50 user nova-compute[74311]: DEBUG nova.compute.manager [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:42:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:42:50 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Instance spawned successfully.
Oct 20 10:42:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:42:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:50 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:50 user nova-compute[74311]: DEBUG nova.compute.manager [req-8e3c7742-26bc-4974-b910-00cdbc80441d req-185962b7-d519-445e-8d7c-b67bd8f75f3c service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Received event network-vif-plugged-e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:42:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8e3c7742-26bc-4974-b910-00cdbc80441d req-185962b7-d519-445e-8d7c-b67bd8f75f3c service nova] Acquiring lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8e3c7742-26bc-4974-b910-00cdbc80441d req-185962b7-d519-445e-8d7c-b67bd8f75f3c service nova] Lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8e3c7742-26bc-4974-b910-00cdbc80441d req-185962b7-d519-445e-8d7c-b67bd8f75f3c service nova] Lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:50 user nova-compute[74311]: DEBUG nova.compute.manager [req-8e3c7742-26bc-4974-b910-00cdbc80441d req-185962b7-d519-445e-8d7c-b67bd8f75f3c service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] No waiting events found dispatching network-vif-plugged-e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:42:50 user nova-compute[74311]: WARNING nova.compute.manager [req-8e3c7742-26bc-4974-b910-00cdbc80441d req-185962b7-d519-445e-8d7c-b67bd8f75f3c service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Received unexpected event network-vif-plugged-e1d343aa-4e85-480e-9f73-f422ed0bbf8c for instance with vm_state building and task_state spawning.
Oct 20 10:42:50 user nova-compute[74311]: INFO nova.compute.manager [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Took 5.30 seconds to spawn the instance on the hypervisor.
Oct 20 10:42:50 user nova-compute[74311]: DEBUG nova.compute.manager [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:42:50 user nova-compute[74311]: INFO nova.compute.manager [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Took 23.66 seconds to build instance.
Oct 20 10:42:50 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-575f735c-2f37-4ea2-a19b-684cf2266521 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.749s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:51 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:42:52 user nova-compute[74311]: INFO nova.compute.claims [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Claim successful on node user
Oct 20 10:42:52 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:42:52 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:42:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:42:52 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Creating image(s)
Oct 20 10:42:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "/opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "/opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG nova.policy [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a420244b8ea475f91a9a5f27d652b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a090a44405c45ee9bcdd6a34c0173a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.191s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk 1073741824" returned: 0 in 0.222s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.406s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.220s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.382s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Cannot resize image /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Ensure instance console log exists: /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:53 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Successfully created port: af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:42:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Successfully updated port: af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:42:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:42:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquired lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:42:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:42:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-4bd38f84-463a-4cbe-b5b9-91432d3c3b06 req-19224535-64b3-4fd7-a207-701ce42a0e63 service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Received event network-changed-af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:42:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-4bd38f84-463a-4cbe-b5b9-91432d3c3b06 req-19224535-64b3-4fd7-a207-701ce42a0e63 service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Refreshing instance network info cache due to event network-changed-af3cce47-5348-449e-b5ca-c006515a379e. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:42:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4bd38f84-463a-4cbe-b5b9-91432d3c3b06 req-19224535-64b3-4fd7-a207-701ce42a0e63 service nova] Acquiring lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:42:54 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updating instance_info_cache with network_info: [{"id": "af3cce47-5348-449e-b5ca-c006515a379e", "address": "fa:16:3e:56:4a:4d", "network": {"id": "fa57bf52-f1a0-4605-878e-a936f3c7e717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1036604684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a090a44405c45ee9bcdd6a34c0173a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cce47-53", "ovs_interfaceid": "af3cce47-5348-449e-b5ca-c006515a379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Releasing lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Instance network_info: |[{"id": "af3cce47-5348-449e-b5ca-c006515a379e", "address": "fa:16:3e:56:4a:4d", "network": {"id": "fa57bf52-f1a0-4605-878e-a936f3c7e717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1036604684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a090a44405c45ee9bcdd6a34c0173a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cce47-53", "ovs_interfaceid": "af3cce47-5348-449e-b5ca-c006515a379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4bd38f84-463a-4cbe-b5b9-91432d3c3b06 req-19224535-64b3-4fd7-a207-701ce42a0e63 service nova] Acquired lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.network.neutron [req-4bd38f84-463a-4cbe-b5b9-91432d3c3b06 req-19224535-64b3-4fd7-a207-701ce42a0e63 service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Refreshing network info cache for port af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Start _get_guest_xml network_info=[{"id": "af3cce47-5348-449e-b5ca-c006515a379e", "address": "fa:16:3e:56:4a:4d", "network": {"id": "fa57bf52-f1a0-4605-878e-a936f3c7e717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1036604684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a090a44405c45ee9bcdd6a34c0173a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cce47-53", "ovs_interfaceid": "af3cce47-5348-449e-b5ca-c006515a379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:42:55 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:42:55 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1120232970',display_name='tempest-SnapshotDataIntegrityTests-server-1120232970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1120232970',id=47,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyzyHHG3N91FPN/pPYmouKQIMsBSdpw3RGR1W0TeYMksWvtAnnsRpFGrXuUpVLgXLSxrELIEvj5gx+/+igVfFNtZKFp5vGiJ73qXjd+fBt9vbZ2FgrTPFwzo6Hpa4ZuJA==',key_name='tempest-keypair-1907055845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a090a44405c45ee9bcdd6a34c0173a9',ramdisk_id='',reservation_id='r-pwh0dttx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1924202967',owner_user_name='tempest-SnapshotDataIntegrityTests-1924202967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:42:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a420244b8ea475f91a9a5f27d652b5c',uuid=bb318c53-c058-439c-86f5-35847ac9c90e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af3cce47-5348-449e-b5ca-c006515a379e", "address": "fa:16:3e:56:4a:4d", "network": {"id": "fa57bf52-f1a0-4605-878e-a936f3c7e717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1036604684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a090a44405c45ee9bcdd6a34c0173a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cce47-53", "ovs_interfaceid": "af3cce47-5348-449e-b5ca-c006515a379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Converting VIF {"id": "af3cce47-5348-449e-b5ca-c006515a379e", "address": "fa:16:3e:56:4a:4d", "network": {"id": "fa57bf52-f1a0-4605-878e-a936f3c7e717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1036604684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a090a44405c45ee9bcdd6a34c0173a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cce47-53", "ovs_interfaceid": "af3cce47-5348-449e-b5ca-c006515a379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:4a:4d,bridge_name='br-int',has_traffic_filtering=True,id=af3cce47-5348-449e-b5ca-c006515a379e,network=Network(fa57bf52-f1a0-4605-878e-a936f3c7e717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3cce47-53') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.objects.instance [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lazy-loading 'pci_devices' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:42:55 user nova-compute[74311]:   <uuid>bb318c53-c058-439c-86f5-35847ac9c90e</uuid>
Oct 20 10:42:55 user nova-compute[74311]:   <name>instance-0000002f</name>
Oct 20 10:42:55 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:42:55 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:42:55 user nova-compute[74311]:   <metadata>
Oct 20 10:42:55 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:42:55 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:42:55 user nova-compute[74311]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1120232970</nova:name>
Oct 20 10:42:55 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:42:55</nova:creationTime>
Oct 20 10:42:55 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:42:55 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:42:55 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:42:55 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:42:55 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:42:55 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:42:55 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:42:55 user nova-compute[74311]:       <nova:owner>
Oct 20 10:42:55 user nova-compute[74311]:         <nova:user uuid="5a420244b8ea475f91a9a5f27d652b5c">tempest-SnapshotDataIntegrityTests-1924202967-project-member</nova:user>
Oct 20 10:42:55 user nova-compute[74311]:         <nova:project uuid="4a090a44405c45ee9bcdd6a34c0173a9">tempest-SnapshotDataIntegrityTests-1924202967</nova:project>
Oct 20 10:42:55 user nova-compute[74311]:       </nova:owner>
Oct 20 10:42:55 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:42:55 user nova-compute[74311]:       <nova:ports>
Oct 20 10:42:55 user nova-compute[74311]:         <nova:port uuid="af3cce47-5348-449e-b5ca-c006515a379e">
Oct 20 10:42:55 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 10:42:55 user nova-compute[74311]:         </nova:port>
Oct 20 10:42:55 user nova-compute[74311]:       </nova:ports>
Oct 20 10:42:55 user nova-compute[74311]:     </nova:instance>
Oct 20 10:42:55 user nova-compute[74311]:   </metadata>
Oct 20 10:42:55 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:42:55 user nova-compute[74311]:     <system>
Oct 20 10:42:55 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:42:55 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:42:55 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:42:55 user nova-compute[74311]:       <entry name="serial">bb318c53-c058-439c-86f5-35847ac9c90e</entry>
Oct 20 10:42:55 user nova-compute[74311]:       <entry name="uuid">bb318c53-c058-439c-86f5-35847ac9c90e</entry>
Oct 20 10:42:55 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:42:55 user nova-compute[74311]:     </system>
Oct 20 10:42:55 user nova-compute[74311]:   </sysinfo>
Oct 20 10:42:55 user nova-compute[74311]:   <os>
Oct 20 10:42:55 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:42:55 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:42:55 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:42:55 user nova-compute[74311]:   </os>
Oct 20 10:42:55 user nova-compute[74311]:   <features>
Oct 20 10:42:55 user nova-compute[74311]:     <acpi/>
Oct 20 10:42:55 user nova-compute[74311]:     <apic/>
Oct 20 10:42:55 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:42:55 user nova-compute[74311]:   </features>
Oct 20 10:42:55 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:42:55 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:42:55 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:42:55 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:42:55 user nova-compute[74311]:   </clock>
Oct 20 10:42:55 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:42:55 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:42:55 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:42:55 user nova-compute[74311]:   </cpu>
Oct 20 10:42:55 user nova-compute[74311]:   <devices>
Oct 20 10:42:55 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:42:55 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:42:55 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk"/>
Oct 20 10:42:55 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:42:55 user nova-compute[74311]:     </disk>
Oct 20 10:42:55 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:42:55 user nova-compute[74311]:       <mac address="fa:16:3e:56:4a:4d"/>
Oct 20 10:42:55 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:42:55 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:42:55 user nova-compute[74311]:       <target dev="tapaf3cce47-53"/>
Oct 20 10:42:55 user nova-compute[74311]:     </interface>
Oct 20 10:42:55 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:42:55 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/console.log" append="off"/>
Oct 20 10:42:55 user nova-compute[74311]:     </serial>
Oct 20 10:42:55 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:42:55 user nova-compute[74311]:     <video>
Oct 20 10:42:55 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:42:55 user nova-compute[74311]:     </video>
Oct 20 10:42:55 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:42:55 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:42:55 user nova-compute[74311]:     </rng>
Oct 20 10:42:55 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:42:55 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:42:55 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:42:55 user nova-compute[74311]:     </memballoon>
Oct 20 10:42:55 user nova-compute[74311]:   </devices>
Oct 20 10:42:55 user nova-compute[74311]: </domain>
Oct 20 10:42:55 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1120232970',display_name='tempest-SnapshotDataIntegrityTests-server-1120232970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1120232970',id=47,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyzyHHG3N91FPN/pPYmouKQIMsBSdpw3RGR1W0TeYMksWvtAnnsRpFGrXuUpVLgXLSxrELIEvj5gx+/+igVfFNtZKFp5vGiJ73qXjd+fBt9vbZ2FgrTPFwzo6Hpa4ZuJA==',key_name='tempest-keypair-1907055845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a090a44405c45ee9bcdd6a34c0173a9',ramdisk_id='',reservation_id='r-pwh0dttx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1924202967',owner_user_name='tempest-SnapshotDataIntegrityTests-1924202967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:42:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a420244b8ea475f91a9a5f27d652b5c',uuid=bb318c53-c058-439c-86f5-35847ac9c90e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af3cce47-5348-449e-b5ca-c006515a379e", "address": "fa:16:3e:56:4a:4d", "network": {"id": "fa57bf52-f1a0-4605-878e-a936f3c7e717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1036604684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a090a44405c45ee9bcdd6a34c0173a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cce47-53", "ovs_interfaceid": "af3cce47-5348-449e-b5ca-c006515a379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Converting VIF {"id": "af3cce47-5348-449e-b5ca-c006515a379e", "address": "fa:16:3e:56:4a:4d", "network": {"id": "fa57bf52-f1a0-4605-878e-a936f3c7e717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1036604684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a090a44405c45ee9bcdd6a34c0173a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cce47-53", "ovs_interfaceid": "af3cce47-5348-449e-b5ca-c006515a379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:4a:4d,bridge_name='br-int',has_traffic_filtering=True,id=af3cce47-5348-449e-b5ca-c006515a379e,network=Network(fa57bf52-f1a0-4605-878e-a936f3c7e717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3cce47-53') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG os_vif [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:4a:4d,bridge_name='br-int',has_traffic_filtering=True,id=af3cce47-5348-449e-b5ca-c006515a379e,network=Network(fa57bf52-f1a0-4605-878e-a936f3c7e717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3cce47-53') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc77225d-aaa1-57ab-b355-990069d4f80c', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf3cce47-53, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf3cce47-53, col_values=(('qos', UUID('5ea12c16-36d8-437d-b6fb-50e8fe060a77')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf3cce47-53, col_values=(('external_ids', {'iface-id': 'af3cce47-5348-449e-b5ca-c006515a379e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:4a:4d', 'vm-uuid': 'bb318c53-c058-439c-86f5-35847ac9c90e'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:55 user nova-compute[74311]: INFO os_vif [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:4a:4d,bridge_name='br-int',has_traffic_filtering=True,id=af3cce47-5348-449e-b5ca-c006515a379e,network=Network(fa57bf52-f1a0-4605-878e-a936f3c7e717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3cce47-53')
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] No VIF found with MAC fa:16:3e:56:4a:4d, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.network.neutron [req-4bd38f84-463a-4cbe-b5b9-91432d3c3b06 req-19224535-64b3-4fd7-a207-701ce42a0e63 service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updated VIF entry in instance network info cache for port af3cce47-5348-449e-b5ca-c006515a379e. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG nova.network.neutron [req-4bd38f84-463a-4cbe-b5b9-91432d3c3b06 req-19224535-64b3-4fd7-a207-701ce42a0e63 service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updating instance_info_cache with network_info: [{"id": "af3cce47-5348-449e-b5ca-c006515a379e", "address": "fa:16:3e:56:4a:4d", "network": {"id": "fa57bf52-f1a0-4605-878e-a936f3c7e717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1036604684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a090a44405c45ee9bcdd6a34c0173a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cce47-53", "ovs_interfaceid": "af3cce47-5348-449e-b5ca-c006515a379e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:42:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4bd38f84-463a-4cbe-b5b9-91432d3c3b06 req-19224535-64b3-4fd7-a207-701ce42a0e63 service nova] Releasing lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:42:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-305b95c4-15dc-491b-b52f-a7e2f6a3eb76 req-5ec1d6f5-00ab-4bd3-ac84-1717b7c7ad8f service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Received event network-vif-plugged-af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:42:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-305b95c4-15dc-491b-b52f-a7e2f6a3eb76 req-5ec1d6f5-00ab-4bd3-ac84-1717b7c7ad8f service nova] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-305b95c4-15dc-491b-b52f-a7e2f6a3eb76 req-5ec1d6f5-00ab-4bd3-ac84-1717b7c7ad8f service nova] Lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-305b95c4-15dc-491b-b52f-a7e2f6a3eb76 req-5ec1d6f5-00ab-4bd3-ac84-1717b7c7ad8f service nova] Lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-305b95c4-15dc-491b-b52f-a7e2f6a3eb76 req-5ec1d6f5-00ab-4bd3-ac84-1717b7c7ad8f service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] No waiting events found dispatching network-vif-plugged-af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:42:56 user nova-compute[74311]: WARNING nova.compute.manager [req-305b95c4-15dc-491b-b52f-a7e2f6a3eb76 req-5ec1d6f5-00ab-4bd3-ac84-1717b7c7ad8f service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Received unexpected event network-vif-plugged-af3cce47-5348-449e-b5ca-c006515a379e for instance with vm_state building and task_state spawning.
Oct 20 10:42:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:42:58 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:42:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:42:58 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Instance spawned successfully.
Oct 20 10:42:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:42:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:42:58 user nova-compute[74311]: INFO nova.compute.manager [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Took 6.27 seconds to spawn the instance on the hypervisor.
Oct 20 10:42:58 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:42:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-bb989f6e-a45d-4ea8-8290-85bff4c428fa req-f44cd79f-785c-4513-b79f-ec6fa228250d service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Received event network-vif-plugged-af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:42:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bb989f6e-a45d-4ea8-8290-85bff4c428fa req-f44cd79f-785c-4513-b79f-ec6fa228250d service nova] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:42:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bb989f6e-a45d-4ea8-8290-85bff4c428fa req-f44cd79f-785c-4513-b79f-ec6fa228250d service nova] Lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:42:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-bb989f6e-a45d-4ea8-8290-85bff4c428fa req-f44cd79f-785c-4513-b79f-ec6fa228250d service nova] Lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-bb989f6e-a45d-4ea8-8290-85bff4c428fa req-f44cd79f-785c-4513-b79f-ec6fa228250d service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] No waiting events found dispatching network-vif-plugged-af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:42:58 user nova-compute[74311]: WARNING nova.compute.manager [req-bb989f6e-a45d-4ea8-8290-85bff4c428fa req-f44cd79f-785c-4513-b79f-ec6fa228250d service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Received unexpected event network-vif-plugged-af3cce47-5348-449e-b5ca-c006515a379e for instance with vm_state building and task_state spawning.
Oct 20 10:42:58 user nova-compute[74311]: INFO nova.compute.manager [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Took 6.91 seconds to build instance.
Oct 20 10:42:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ecd721b5-b841-4434-9fda-7df231cc0e0d tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.098s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:42:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:05 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:43:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:43:09 user nova-compute[74311]: DEBUG nova.compute.manager [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:43:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:43:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:43:09 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:43:09 user nova-compute[74311]: INFO nova.compute.claims [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Claim successful on node user
Oct 20 10:43:09 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:43:09 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:43:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:43:09 user nova-compute[74311]: DEBUG nova.compute.manager [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:43:09 user nova-compute[74311]: DEBUG nova.compute.manager [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:43:09 user nova-compute[74311]: DEBUG nova.network.neutron [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:43:09 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:43:09 user nova-compute[74311]: DEBUG nova.compute.manager [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG nova.policy [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4dda3552abdb4cee967ce9cac71580ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e14e8b4071d4f0591e65fededd0f2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG nova.compute.manager [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:43:10 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Creating image(s)
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "/opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "/opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "/opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk 1073741824" returned: 0 in 0.047s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG nova.network.neutron [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Successfully created port: aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.195s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Cannot resize image /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Ensure instance console log exists: /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:43:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.network.neutron [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Successfully updated port: aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "refresh_cache-da32cd92-f1d7-4f26-9f74-6a1a23a02e60" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquired lock "refresh_cache-da32cd92-f1d7-4f26-9f74-6a1a23a02e60" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.network.neutron [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.compute.manager [req-b2b8a886-7293-442d-8413-44f147506a25 req-21c17ccf-ea32-4ad8-81ae-76b3265f64e2 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received event network-changed-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.compute.manager [req-b2b8a886-7293-442d-8413-44f147506a25 req-21c17ccf-ea32-4ad8-81ae-76b3265f64e2 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Refreshing instance network info cache due to event network-changed-aa5241d8-bb82-4c93-9bfd-116406ee4dd9. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b2b8a886-7293-442d-8413-44f147506a25 req-21c17ccf-ea32-4ad8-81ae-76b3265f64e2 service nova] Acquiring lock "refresh_cache-da32cd92-f1d7-4f26-9f74-6a1a23a02e60" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.network.neutron [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.network.neutron [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Updating instance_info_cache with network_info: [{"id": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "address": "fa:16:3e:8d:1d:e4", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5241d8-bb", "ovs_interfaceid": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Releasing lock "refresh_cache-da32cd92-f1d7-4f26-9f74-6a1a23a02e60" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.compute.manager [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Instance network_info: |[{"id": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "address": "fa:16:3e:8d:1d:e4", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5241d8-bb", "ovs_interfaceid": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b2b8a886-7293-442d-8413-44f147506a25 req-21c17ccf-ea32-4ad8-81ae-76b3265f64e2 service nova] Acquired lock "refresh_cache-da32cd92-f1d7-4f26-9f74-6a1a23a02e60" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.network.neutron [req-b2b8a886-7293-442d-8413-44f147506a25 req-21c17ccf-ea32-4ad8-81ae-76b3265f64e2 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Refreshing network info cache for port aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Start _get_guest_xml network_info=[{"id": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "address": "fa:16:3e:8d:1d:e4", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5241d8-bb", "ovs_interfaceid": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:43:11 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:43:11 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1250216490',display_name='tempest-VolumesSnapshotTestJSON-instance-1250216490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1250216490',id=48,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzrUmkZaOCJjaKRXYAcv/mcb33i1uoqeC0gduWvYLm1YCng761yJgPlVHvU+QtCWsCD6XGkX3bP3hSXpbo9IpJxqLr9iLZebzOAooql/sGTrxSbGSGvirKKrtH45e/sQw==',key_name='tempest-keypair-1532010150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e14e8b4071d4f0591e65fededd0f2fd',ramdisk_id='',reservation_id='r-r8ugzbay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1070048329',owner_user_name='tempest-VolumesSnapshotTestJSON-1070048329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:43:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dda3552abdb4cee967ce9cac71580ba',uuid=da32cd92-f1d7-4f26-9f74-6a1a23a02e60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "address": "fa:16:3e:8d:1d:e4", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5241d8-bb", "ovs_interfaceid": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Converting VIF {"id": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "address": "fa:16:3e:8d:1d:e4", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5241d8-bb", "ovs_interfaceid": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1d:e4,bridge_name='br-int',has_traffic_filtering=True,id=aa5241d8-bb82-4c93-9bfd-116406ee4dd9,network=Network(3f659357-90d1-42cc-99de-5959812bf2fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5241d8-bb') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.objects.instance [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lazy-loading 'pci_devices' on Instance uuid da32cd92-f1d7-4f26-9f74-6a1a23a02e60 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:43:11 user nova-compute[74311]:   <uuid>da32cd92-f1d7-4f26-9f74-6a1a23a02e60</uuid>
Oct 20 10:43:11 user nova-compute[74311]:   <name>instance-00000030</name>
Oct 20 10:43:11 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:43:11 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:43:11 user nova-compute[74311]:   <metadata>
Oct 20 10:43:11 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:43:11 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:43:11 user nova-compute[74311]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1250216490</nova:name>
Oct 20 10:43:11 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:43:11</nova:creationTime>
Oct 20 10:43:11 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:43:11 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:43:11 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:43:11 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:43:11 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:43:11 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:43:11 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:43:11 user nova-compute[74311]:       <nova:owner>
Oct 20 10:43:11 user nova-compute[74311]:         <nova:user uuid="4dda3552abdb4cee967ce9cac71580ba">tempest-VolumesSnapshotTestJSON-1070048329-project-member</nova:user>
Oct 20 10:43:11 user nova-compute[74311]:         <nova:project uuid="4e14e8b4071d4f0591e65fededd0f2fd">tempest-VolumesSnapshotTestJSON-1070048329</nova:project>
Oct 20 10:43:11 user nova-compute[74311]:       </nova:owner>
Oct 20 10:43:11 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:43:11 user nova-compute[74311]:       <nova:ports>
Oct 20 10:43:11 user nova-compute[74311]:         <nova:port uuid="aa5241d8-bb82-4c93-9bfd-116406ee4dd9">
Oct 20 10:43:11 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 10:43:11 user nova-compute[74311]:         </nova:port>
Oct 20 10:43:11 user nova-compute[74311]:       </nova:ports>
Oct 20 10:43:11 user nova-compute[74311]:     </nova:instance>
Oct 20 10:43:11 user nova-compute[74311]:   </metadata>
Oct 20 10:43:11 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:43:11 user nova-compute[74311]:     <system>
Oct 20 10:43:11 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:43:11 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:43:11 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:43:11 user nova-compute[74311]:       <entry name="serial">da32cd92-f1d7-4f26-9f74-6a1a23a02e60</entry>
Oct 20 10:43:11 user nova-compute[74311]:       <entry name="uuid">da32cd92-f1d7-4f26-9f74-6a1a23a02e60</entry>
Oct 20 10:43:11 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:43:11 user nova-compute[74311]:     </system>
Oct 20 10:43:11 user nova-compute[74311]:   </sysinfo>
Oct 20 10:43:11 user nova-compute[74311]:   <os>
Oct 20 10:43:11 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:43:11 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:43:11 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:43:11 user nova-compute[74311]:   </os>
Oct 20 10:43:11 user nova-compute[74311]:   <features>
Oct 20 10:43:11 user nova-compute[74311]:     <acpi/>
Oct 20 10:43:11 user nova-compute[74311]:     <apic/>
Oct 20 10:43:11 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:43:11 user nova-compute[74311]:   </features>
Oct 20 10:43:11 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:43:11 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:43:11 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:43:11 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:43:11 user nova-compute[74311]:   </clock>
Oct 20 10:43:11 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:43:11 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:43:11 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:43:11 user nova-compute[74311]:   </cpu>
Oct 20 10:43:11 user nova-compute[74311]:   <devices>
Oct 20 10:43:11 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:43:11 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:43:11 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk"/>
Oct 20 10:43:11 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:43:11 user nova-compute[74311]:     </disk>
Oct 20 10:43:11 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:43:11 user nova-compute[74311]:       <mac address="fa:16:3e:8d:1d:e4"/>
Oct 20 10:43:11 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:43:11 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:43:11 user nova-compute[74311]:       <target dev="tapaa5241d8-bb"/>
Oct 20 10:43:11 user nova-compute[74311]:     </interface>
Oct 20 10:43:11 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:43:11 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/console.log" append="off"/>
Oct 20 10:43:11 user nova-compute[74311]:     </serial>
Oct 20 10:43:11 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:43:11 user nova-compute[74311]:     <video>
Oct 20 10:43:11 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:43:11 user nova-compute[74311]:     </video>
Oct 20 10:43:11 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:43:11 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:43:11 user nova-compute[74311]:     </rng>
Oct 20 10:43:11 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:43:11 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:43:11 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:43:11 user nova-compute[74311]:     </memballoon>
Oct 20 10:43:11 user nova-compute[74311]:   </devices>
Oct 20 10:43:11 user nova-compute[74311]: </domain>
Oct 20 10:43:11 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1250216490',display_name='tempest-VolumesSnapshotTestJSON-instance-1250216490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1250216490',id=48,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzrUmkZaOCJjaKRXYAcv/mcb33i1uoqeC0gduWvYLm1YCng761yJgPlVHvU+QtCWsCD6XGkX3bP3hSXpbo9IpJxqLr9iLZebzOAooql/sGTrxSbGSGvirKKrtH45e/sQw==',key_name='tempest-keypair-1532010150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e14e8b4071d4f0591e65fededd0f2fd',ramdisk_id='',reservation_id='r-r8ugzbay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1070048329',owner_user_name='tempest-VolumesSnapshotTestJSON-1070048329-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:43:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dda3552abdb4cee967ce9cac71580ba',uuid=da32cd92-f1d7-4f26-9f74-6a1a23a02e60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "address": "fa:16:3e:8d:1d:e4", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5241d8-bb", "ovs_interfaceid": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Converting VIF {"id": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "address": "fa:16:3e:8d:1d:e4", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5241d8-bb", "ovs_interfaceid": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1d:e4,bridge_name='br-int',has_traffic_filtering=True,id=aa5241d8-bb82-4c93-9bfd-116406ee4dd9,network=Network(3f659357-90d1-42cc-99de-5959812bf2fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5241d8-bb') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG os_vif [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1d:e4,bridge_name='br-int',has_traffic_filtering=True,id=aa5241d8-bb82-4c93-9bfd-116406ee4dd9,network=Network(3f659357-90d1-42cc-99de-5959812bf2fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5241d8-bb') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '048df2f4-8f28-50de-a567-207f9e656d43', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa5241d8-bb, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa5241d8-bb, col_values=(('qos', UUID('c928d79b-f24a-4349-9a5f-76539d5c4ae6')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa5241d8-bb, col_values=(('external_ids', {'iface-id': 'aa5241d8-bb82-4c93-9bfd-116406ee4dd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:1d:e4', 'vm-uuid': 'da32cd92-f1d7-4f26-9f74-6a1a23a02e60'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:43:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:11 user nova-compute[74311]: INFO os_vif [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1d:e4,bridge_name='br-int',has_traffic_filtering=True,id=aa5241d8-bb82-4c93-9bfd-116406ee4dd9,network=Network(3f659357-90d1-42cc-99de-5959812bf2fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5241d8-bb')
Oct 20 10:43:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:43:12 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] No VIF found with MAC fa:16:3e:8d:1d:e4, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:43:12 user nova-compute[74311]: DEBUG nova.network.neutron [req-b2b8a886-7293-442d-8413-44f147506a25 req-21c17ccf-ea32-4ad8-81ae-76b3265f64e2 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Updated VIF entry in instance network info cache for port aa5241d8-bb82-4c93-9bfd-116406ee4dd9. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:43:12 user nova-compute[74311]: DEBUG nova.network.neutron [req-b2b8a886-7293-442d-8413-44f147506a25 req-21c17ccf-ea32-4ad8-81ae-76b3265f64e2 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Updating instance_info_cache with network_info: [{"id": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "address": "fa:16:3e:8d:1d:e4", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5241d8-bb", "ovs_interfaceid": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:43:12 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b2b8a886-7293-442d-8413-44f147506a25 req-21c17ccf-ea32-4ad8-81ae-76b3265f64e2 service nova] Releasing lock "refresh_cache-da32cd92-f1d7-4f26-9f74-6a1a23a02e60" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:43:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:13 user nova-compute[74311]: DEBUG nova.compute.manager [req-596332be-054a-4d0f-aa4d-85ec6442cdae req-02d81630-25b5-448e-924a-a9bad0050436 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received event network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:43:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-596332be-054a-4d0f-aa4d-85ec6442cdae req-02d81630-25b5-448e-924a-a9bad0050436 service nova] Acquiring lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:43:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-596332be-054a-4d0f-aa4d-85ec6442cdae req-02d81630-25b5-448e-924a-a9bad0050436 service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:43:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-596332be-054a-4d0f-aa4d-85ec6442cdae req-02d81630-25b5-448e-924a-a9bad0050436 service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:43:13 user nova-compute[74311]: DEBUG nova.compute.manager [req-596332be-054a-4d0f-aa4d-85ec6442cdae req-02d81630-25b5-448e-924a-a9bad0050436 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] No waiting events found dispatching network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:43:13 user nova-compute[74311]: WARNING nova.compute.manager [req-596332be-054a-4d0f-aa4d-85ec6442cdae req-02d81630-25b5-448e-924a-a9bad0050436 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received unexpected event network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 for instance with vm_state building and task_state spawning.
Oct 20 10:43:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:15 user nova-compute[74311]: DEBUG nova.compute.manager [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:43:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:43:15 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Instance spawned successfully.
Oct 20 10:43:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:43:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:43:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:43:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:43:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:43:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:43:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:43:15 user nova-compute[74311]: INFO nova.compute.manager [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Took 5.47 seconds to spawn the instance on the hypervisor.
Oct 20 10:43:15 user nova-compute[74311]: DEBUG nova.compute.manager [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:43:15 user nova-compute[74311]: DEBUG nova.compute.manager [req-53254115-31d3-49de-8b41-954f23ec86da req-5b7aa29e-c8cb-4848-a40f-fdb6d6759aed service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received event network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:43:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-53254115-31d3-49de-8b41-954f23ec86da req-5b7aa29e-c8cb-4848-a40f-fdb6d6759aed service nova] Acquiring lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:43:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-53254115-31d3-49de-8b41-954f23ec86da req-5b7aa29e-c8cb-4848-a40f-fdb6d6759aed service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:43:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-53254115-31d3-49de-8b41-954f23ec86da req-5b7aa29e-c8cb-4848-a40f-fdb6d6759aed service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:43:15 user nova-compute[74311]: DEBUG nova.compute.manager [req-53254115-31d3-49de-8b41-954f23ec86da req-5b7aa29e-c8cb-4848-a40f-fdb6d6759aed service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] No waiting events found dispatching network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:43:15 user nova-compute[74311]: WARNING nova.compute.manager [req-53254115-31d3-49de-8b41-954f23ec86da req-5b7aa29e-c8cb-4848-a40f-fdb6d6759aed service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received unexpected event network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 for instance with vm_state building and task_state spawning.
Oct 20 10:43:15 user nova-compute[74311]: INFO nova.compute.manager [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Took 6.15 seconds to build instance.
Oct 20 10:43:15 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-480938ad-4e06-47c6-ae82-8dbcda4e7e9b tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.249s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:43:16 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:43:16 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:43:16 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:43:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:43:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:43:16 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:43:16 user nova-compute[74311]: DEBUG nova.objects.instance [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lazy-loading 'info_cache' on Instance uuid 785fdcb1-5995-485c-a931-3a2537700785 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:43:16 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updating instance_info_cache with network_info: [{"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:43:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:43:16 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:43:16 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:43:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:22 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:43:23 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:43:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:27 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:43:27 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:43:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:43:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:43:32 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:43:32 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:43:32 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8235MB free_disk=25.068572998046875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 785fdcb1-5995-485c-a931-3a2537700785 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance a7f5f818-c2a3-4543-a6c2-80d7fc46dd64 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance bb318c53-c058-439c-86f5-35847ac9c90e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance da32cd92-f1d7-4f26-9f74-6a1a23a02e60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing inventories for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Updating ProviderTree inventory for provider 77cac819-3c22-4fec-a59d-0525ac40a90b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Updating inventory in ProviderTree for provider 77cac819-3c22-4fec-a59d-0525ac40a90b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing aggregate associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, aggregates: None {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 10:43:32 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing trait associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3 {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 10:43:33 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:43:33 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:43:33 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:43:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:43:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:35 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:43:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:37 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:43:37 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:43:37 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:43:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:43 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:43:43 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 10:43:43 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] There are 0 instances to clean {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 10:43:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:43:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:43:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:43:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:43:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:43:55 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:43:55 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74311) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 10:43:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "785fdcb1-5995-485c-a931-3a2537700785" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:01 user nova-compute[74311]: DEBUG nova.objects.instance [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'flavor' on Instance uuid 785fdcb1-5995-485c-a931-3a2537700785 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:44:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "785fdcb1-5995-485c-a931-3a2537700785" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "785fdcb1-5995-485c-a931-3a2537700785" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:02 user nova-compute[74311]: INFO nova.compute.manager [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Attaching volume 4db5caad-99d2-4f77-960a-3d318c290748 to /dev/vdb
Oct 20 10:44:02 user nova-compute[74311]: DEBUG os_brick.utils [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f366f84b-9eba-46d6-be38-3321c05f043e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d496e9-6284-4e85-871d-1a28c4a13131]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b890655-a5dc-4627-89f3-22447512ecc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ed632c-78ab-4bf1-abac-412d9d64ad05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:44:02 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:44:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c1d90d-f076-4ba3-9a44-2a9b3d7bb506]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG os_brick.utils [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:44:02 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updating existing volume attachment record: 24bd85d6-60d1-4db2-af88-5bccfc1fa104 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:44:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:44:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:44:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:44:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:44:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:16 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:44:16 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:44:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:44:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:44:16 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:44:16 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Updating instance_info_cache with network_info: [{"id": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "address": "fa:16:3e:4e:8f:7c", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d343aa-4e", "ovs_interfaceid": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:44:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:44:16 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:44:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:18 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:44:18 user nova-compute[74311]: DEBUG nova.compute.manager [req-b141ec80-fc27-45a5-9104-fec125a0708e req-b4726f62-bd61-47c2-92c9-a9d6662d6b60 service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Received event network-changed-e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:44:18 user nova-compute[74311]: DEBUG nova.compute.manager [req-b141ec80-fc27-45a5-9104-fec125a0708e req-b4726f62-bd61-47c2-92c9-a9d6662d6b60 service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Refreshing instance network info cache due to event network-changed-e1d343aa-4e85-480e-9f73-f422ed0bbf8c. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:44:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b141ec80-fc27-45a5-9104-fec125a0708e req-b4726f62-bd61-47c2-92c9-a9d6662d6b60 service nova] Acquiring lock "refresh_cache-a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:44:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b141ec80-fc27-45a5-9104-fec125a0708e req-b4726f62-bd61-47c2-92c9-a9d6662d6b60 service nova] Acquired lock "refresh_cache-a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:44:18 user nova-compute[74311]: DEBUG nova.network.neutron [req-b141ec80-fc27-45a5-9104-fec125a0708e req-b4726f62-bd61-47c2-92c9-a9d6662d6b60 service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Refreshing network info cache for port e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:44:18 user nova-compute[74311]: DEBUG nova.network.neutron [req-b141ec80-fc27-45a5-9104-fec125a0708e req-b4726f62-bd61-47c2-92c9-a9d6662d6b60 service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Updated VIF entry in instance network info cache for port e1d343aa-4e85-480e-9f73-f422ed0bbf8c. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:44:18 user nova-compute[74311]: DEBUG nova.network.neutron [req-b141ec80-fc27-45a5-9104-fec125a0708e req-b4726f62-bd61-47c2-92c9-a9d6662d6b60 service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Updating instance_info_cache with network_info: [{"id": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "address": "fa:16:3e:4e:8f:7c", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d343aa-4e", "ovs_interfaceid": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:44:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b141ec80-fc27-45a5-9104-fec125a0708e req-b4726f62-bd61-47c2-92c9-a9d6662d6b60 service nova] Releasing lock "refresh_cache-a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:44:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:44:19 user nova-compute[74311]: INFO nova.compute.manager [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Terminating instance
Oct 20 10:44:19 user nova-compute[74311]: DEBUG nova.compute.manager [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG nova.compute.manager [req-e8abfe60-90b0-42d5-8893-5c70dff94c63 req-b98627c5-6bf2-4260-ba88-419ee23d3e0d service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Received event network-vif-unplugged-e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e8abfe60-90b0-42d5-8893-5c70dff94c63 req-b98627c5-6bf2-4260-ba88-419ee23d3e0d service nova] Acquiring lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e8abfe60-90b0-42d5-8893-5c70dff94c63 req-b98627c5-6bf2-4260-ba88-419ee23d3e0d service nova] Lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e8abfe60-90b0-42d5-8893-5c70dff94c63 req-b98627c5-6bf2-4260-ba88-419ee23d3e0d service nova] Lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG nova.compute.manager [req-e8abfe60-90b0-42d5-8893-5c70dff94c63 req-b98627c5-6bf2-4260-ba88-419ee23d3e0d service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] No waiting events found dispatching network-vif-unplugged-e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG nova.compute.manager [req-e8abfe60-90b0-42d5-8893-5c70dff94c63 req-b98627c5-6bf2-4260-ba88-419ee23d3e0d service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Received event network-vif-unplugged-e1d343aa-4e85-480e-9f73-f422ed0bbf8c for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:44:19 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Instance destroyed successfully.
Oct 20 10:44:19 user nova-compute[74311]: DEBUG nova.objects.instance [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lazy-loading 'resources' on Instance uuid a7f5f818-c2a3-4543-a6c2-80d7fc46dd64 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-200079669',display_name='tempest-TestVolumeBootPattern-server-200079669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-200079669',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3a39KFZ17bE3ncvzIcH4Vxw/Y2gdrgDREcztfOEHBNO1uipHHk2Y+XPwHgE3eoiT29JTcO8Ys40E+uqpMDlmjQ529gbmWean5D7IYFP305bqhP5ciafYVbX9wu+N+nLQ==',key_name='tempest-TestVolumeBootPattern-1713092442',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:42:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-2l9mjj76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:42:50Z,user_data=None,user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=a7f5f818-c2a3-4543-a6c2-80d7fc46dd64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "address": "fa:16:3e:4e:8f:7c", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d343aa-4e", "ovs_interfaceid": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "address": "fa:16:3e:4e:8f:7c", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d343aa-4e", "ovs_interfaceid": "e1d343aa-4e85-480e-9f73-f422ed0bbf8c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:8f:7c,bridge_name='br-int',has_traffic_filtering=True,id=e1d343aa-4e85-480e-9f73-f422ed0bbf8c,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d343aa-4e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_vif [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:8f:7c,bridge_name='br-int',has_traffic_filtering=True,id=e1d343aa-4e85-480e-9f73-f422ed0bbf8c,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d343aa-4e') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1d343aa-4e, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=025e6a42-256d-4520-bf1b-9555fa319a66) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:44:19 user nova-compute[74311]: INFO os_vif [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:8f:7c,bridge_name='br-int',has_traffic_filtering=True,id=e1d343aa-4e85-480e-9f73-f422ed0bbf8c,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d343aa-4e')
Oct 20 10:44:19 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TojvNfEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:44:19 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4e8447-45cd-484d-b14a-ee81c7e94433]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:44:19 user nova-compute[74311]: No targets found.
Oct 20 10:44:19 user nova-compute[74311]: iSNS:
Oct 20 10:44:19 user nova-compute[74311]: No targets found.
Oct 20 10:44:19 user nova-compute[74311]: STATIC:
Oct 20 10:44:19 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b
Oct 20 10:44:19 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:44:19 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:44:19 user nova-compute[74311]: FIRMWARE:
Oct 20 10:44:19 user nova-compute[74311]: No targets found.
Oct 20 10:44:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:44:19 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:44:19 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bc92e9-0bcd-4823-bc80-929a562e5415]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c426835f-6cc7-48a0-82f5-0d2a1a9f06a6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:44:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:44:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1a831e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ff41c1-a447-48c4-ae8a-99eeb4e93ed8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca0b987-5bed-4585-94ca-ddfc60f9530e]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80da79f-5219-4ba7-bcdc-9ef8856a39ea]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d00179e-d474-4344-b883-9453534aa828]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f89eaf4d',) {{(pid=85589) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1412dc0-ddf8-451c-b10b-340cb267b4af]: (4, None) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:44:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[762cf8be-19d1-429a-9c94-f45860addb71]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[34475e11-64e1-4a92-a343-8f1cb32fd8ad]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260]
Oct 20 10:44:20 user nova-compute[74311]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260] successful.
Oct 20 10:44:20 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe78a69f-8dd0-49cb-9e16-9393b22fb9b0]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== disconnect_volume: return (298ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:44:20 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Deleting instance files /opt/stack/data/nova/instances/a7f5f818-c2a3-4543-a6c2-80d7fc46dd64_del
Oct 20 10:44:20 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Deletion of /opt/stack/data/nova/instances/a7f5f818-c2a3-4543-a6c2-80d7fc46dd64_del complete
Oct 20 10:44:20 user nova-compute[74311]: INFO nova.compute.manager [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 20 10:44:20 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:44:20 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:44:20 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Took 0.78 seconds to deallocate network for instance.
Oct 20 10:44:21 user nova-compute[74311]: DEBUG nova.compute.manager [req-7de63af8-82f7-4a38-9383-df6d2e8d592a req-c7515757-121a-4fc6-8e0c-c0c28c32ed3d service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Received event network-vif-deleted-e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:44:21 user nova-compute[74311]: DEBUG nova.compute.manager [req-d2f8f2c2-165e-4157-93fb-9726c55b364e req-f1ceda84-84c2-4490-99d8-d4469f237570 service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Received event network-vif-plugged-e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:44:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d2f8f2c2-165e-4157-93fb-9726c55b364e req-f1ceda84-84c2-4490-99d8-d4469f237570 service nova] Acquiring lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d2f8f2c2-165e-4157-93fb-9726c55b364e req-f1ceda84-84c2-4490-99d8-d4469f237570 service nova] Lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d2f8f2c2-165e-4157-93fb-9726c55b364e req-f1ceda84-84c2-4490-99d8-d4469f237570 service nova] Lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:44:21 user nova-compute[74311]: DEBUG nova.compute.manager [req-d2f8f2c2-165e-4157-93fb-9726c55b364e req-f1ceda84-84c2-4490-99d8-d4469f237570 service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] No waiting events found dispatching network-vif-plugged-e1d343aa-4e85-480e-9f73-f422ed0bbf8c {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:44:21 user nova-compute[74311]: WARNING nova.compute.manager [req-d2f8f2c2-165e-4157-93fb-9726c55b364e req-f1ceda84-84c2-4490-99d8-d4469f237570 service nova] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Received unexpected event network-vif-plugged-e1d343aa-4e85-480e-9f73-f422ed0bbf8c for instance with vm_state active and task_state deleting.
Oct 20 10:44:24 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:44:24 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:44:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:27 user nova-compute[74311]: INFO nova.compute.manager [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: a7f5f818-c2a3-4543-a6c2-80d7fc46dd64] Took 6.89 seconds to detach 1 volumes for instance.
Oct 20 10:44:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:27 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:44:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mcRblCMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:44:27 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:44:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:44:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:44:27 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:44:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:44:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:44:27 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:44:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:27 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc30e494-fbe4-4556-99ff-fdab61c755a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:27 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:44:27 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:27 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:27 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[238e6759-9f59-4a0b-a8d7-567ca8c5b9d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748] added
Oct 20 10:44:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14a8faf-c984-44a0-9a8b-a5ff95ab26e5]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2772936-0f6d-45de-982d-3c813b4a4584]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mcRblCMG {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mcRblCMG" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2a13db-746e-4ca9-8c96-10c97c9a0fa2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mcRblCMG'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.239s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff56003-7111-41cc-8c62-e75c9a498e3b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb83b31-b850-400f-98da-16d0c44c1bd5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:44:28 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:44:28 user nova-compute[74311]:  {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:44:28 user nova-compute[74311]: WARNING os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 10:44:28 user nova-compute[74311]: 
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:28 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Deleted allocations for instance a7f5f818-c2a3-4543-a6c2-80d7fc46dd64
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[df04b3ac-c099-4382-b857-e75c0cb2c381]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260]
Oct 20 10:44:28 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260] successful.
Oct 20 10:44:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed09d5d9-9da1-4fa5-b238-1ca195a959e8]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b96bf60-e0a0-45db-a692-c19034e7d0a1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:44:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:44:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.477s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cc6f61f2-ad55-48fa-80db-bb89105ecd8d tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "a7f5f818-c2a3-4543-a6c2-80d7fc46dd64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.452s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbc50e2-6c9b-40b0-bb34-65da1eca84bb]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:28 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:44:29 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:44:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mcRblCMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:44:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.504s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:44:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] <== connect_volume: return (1505ms) {'type': 'block', 'scsi_wwn': '23234396565313932', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:44:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234396565313932', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:44:29 user nova-compute[74311]: DEBUG nova.objects.instance [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'flavor' on Instance uuid 785fdcb1-5995-485c-a931-3a2537700785 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:44:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:44:29 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:44:29 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:44:29 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:44:29 user nova-compute[74311]:   <serial>4db5caad-99d2-4f77-960a-3d318c290748</serial>
Oct 20 10:44:29 user nova-compute[74311]: </disk>
Oct 20 10:44:29 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:44:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:44:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:44:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:44:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] No VIF found with MAC fa:16:3e:d2:32:c1, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:44:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-cffea56b-b8bc-405c-980b-ae3322ee77b0 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "785fdcb1-5995-485c-a931-3a2537700785" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.129s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:44:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:33 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:44:33 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:44:33 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8583MB free_disk=25.06542205810547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:44:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:33 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 785fdcb1-5995-485c-a931-3a2537700785 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:44:33 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance bb318c53-c058-439c-86f5-35847ac9c90e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:44:33 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance da32cd92-f1d7-4f26-9f74-6a1a23a02e60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:44:33 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:44:33 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:44:33 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:44:33 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:44:33 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:44:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:44:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:36 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:44:37 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:44:37 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:44:37 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:44:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:44:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-b8766167-d275-46c5-84a8-c68c410e6f11 req-04cb13b7-2007-4670-9f28-521ba3bcbfd3 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-changed-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:44:41 user nova-compute[74311]: DEBUG nova.compute.manager [req-b8766167-d275-46c5-84a8-c68c410e6f11 req-04cb13b7-2007-4670-9f28-521ba3bcbfd3 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Refreshing instance network info cache due to event network-changed-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:44:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b8766167-d275-46c5-84a8-c68c410e6f11 req-04cb13b7-2007-4670-9f28-521ba3bcbfd3 service nova] Acquiring lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:44:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b8766167-d275-46c5-84a8-c68c410e6f11 req-04cb13b7-2007-4670-9f28-521ba3bcbfd3 service nova] Acquired lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:44:41 user nova-compute[74311]: DEBUG nova.network.neutron [req-b8766167-d275-46c5-84a8-c68c410e6f11 req-04cb13b7-2007-4670-9f28-521ba3bcbfd3 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Refreshing network info cache for port 7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:44:41 user nova-compute[74311]: DEBUG nova.network.neutron [req-b8766167-d275-46c5-84a8-c68c410e6f11 req-04cb13b7-2007-4670-9f28-521ba3bcbfd3 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updated VIF entry in instance network info cache for port 7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:44:41 user nova-compute[74311]: DEBUG nova.network.neutron [req-b8766167-d275-46c5-84a8-c68c410e6f11 req-04cb13b7-2007-4670-9f28-521ba3bcbfd3 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updating instance_info_cache with network_info: [{"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:44:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b8766167-d275-46c5-84a8-c68c410e6f11 req-04cb13b7-2007-4670-9f28-521ba3bcbfd3 service nova] Releasing lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:44:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-3423a422-068e-494d-990a-326d54b8f95d req-3eeda1e9-a5e1-400c-9308-4e51c04b79f2 service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Received event network-changed-af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:44:43 user nova-compute[74311]: DEBUG nova.compute.manager [req-3423a422-068e-494d-990a-326d54b8f95d req-3eeda1e9-a5e1-400c-9308-4e51c04b79f2 service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Refreshing instance network info cache due to event network-changed-af3cce47-5348-449e-b5ca-c006515a379e. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:44:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3423a422-068e-494d-990a-326d54b8f95d req-3eeda1e9-a5e1-400c-9308-4e51c04b79f2 service nova] Acquiring lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:44:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3423a422-068e-494d-990a-326d54b8f95d req-3eeda1e9-a5e1-400c-9308-4e51c04b79f2 service nova] Acquired lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:44:43 user nova-compute[74311]: DEBUG nova.network.neutron [req-3423a422-068e-494d-990a-326d54b8f95d req-3eeda1e9-a5e1-400c-9308-4e51c04b79f2 service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Refreshing network info cache for port af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:44:43 user nova-compute[74311]: DEBUG nova.network.neutron [req-3423a422-068e-494d-990a-326d54b8f95d req-3eeda1e9-a5e1-400c-9308-4e51c04b79f2 service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updated VIF entry in instance network info cache for port af3cce47-5348-449e-b5ca-c006515a379e. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:44:43 user nova-compute[74311]: DEBUG nova.network.neutron [req-3423a422-068e-494d-990a-326d54b8f95d req-3eeda1e9-a5e1-400c-9308-4e51c04b79f2 service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updating instance_info_cache with network_info: [{"id": "af3cce47-5348-449e-b5ca-c006515a379e", "address": "fa:16:3e:56:4a:4d", "network": {"id": "fa57bf52-f1a0-4605-878e-a936f3c7e717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1036604684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a090a44405c45ee9bcdd6a34c0173a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cce47-53", "ovs_interfaceid": "af3cce47-5348-449e-b5ca-c006515a379e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:44:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3423a422-068e-494d-990a-326d54b8f95d req-3eeda1e9-a5e1-400c-9308-4e51c04b79f2 service nova] Releasing lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:44:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-e4017aea-8fed-48d3-82a3-8e9b245d888e req-9c25632d-3671-42ba-8305-4c574eca10b4 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-changed-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:44:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-e4017aea-8fed-48d3-82a3-8e9b245d888e req-9c25632d-3671-42ba-8305-4c574eca10b4 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Refreshing instance network info cache due to event network-changed-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:44:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e4017aea-8fed-48d3-82a3-8e9b245d888e req-9c25632d-3671-42ba-8305-4c574eca10b4 service nova] Acquiring lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:44:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e4017aea-8fed-48d3-82a3-8e9b245d888e req-9c25632d-3671-42ba-8305-4c574eca10b4 service nova] Acquired lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:44:45 user nova-compute[74311]: DEBUG nova.network.neutron [req-e4017aea-8fed-48d3-82a3-8e9b245d888e req-9c25632d-3671-42ba-8305-4c574eca10b4 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Refreshing network info cache for port 7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:44:45 user nova-compute[74311]: DEBUG nova.network.neutron [req-e4017aea-8fed-48d3-82a3-8e9b245d888e req-9c25632d-3671-42ba-8305-4c574eca10b4 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updated VIF entry in instance network info cache for port 7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:44:45 user nova-compute[74311]: DEBUG nova.network.neutron [req-e4017aea-8fed-48d3-82a3-8e9b245d888e req-9c25632d-3671-42ba-8305-4c574eca10b4 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updating instance_info_cache with network_info: [{"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:44:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e4017aea-8fed-48d3-82a3-8e9b245d888e req-9c25632d-3671-42ba-8305-4c574eca10b4 service nova] Releasing lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG nova.objects.instance [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lazy-loading 'flavor' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:49 user nova-compute[74311]: INFO nova.compute.manager [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Attaching volume 69823483-dd50-43df-a345-b117eb9786e5 to /dev/vdb
Oct 20 10:44:49 user nova-compute[74311]: DEBUG os_brick.utils [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5278de55-3742-417e-abc3-9dc76ee3dcb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa04af8-97a5-4b5f-b5f2-80aa506dc28e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:49 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6c5dfa-d27f-4a23-83d2-24c560e4dd38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2072e657-4de0-4cd8-9f7c-0e260fea8cac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:44:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:44:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:50 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:44:50 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:44:50 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f40e745-6679-4a1a-9164-8586181e7b0e]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:44:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:44:50 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:44:50 user nova-compute[74311]: DEBUG os_brick.utils [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:44:50 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updating existing volume attachment record: e92a4b32-1776-4038-819d-1dd5b4989508 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:44:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "785fdcb1-5995-485c-a931-3a2537700785" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:53 user nova-compute[74311]: INFO nova.compute.manager [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Rebooting instance
Oct 20 10:44:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:44:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquired lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:44:53 user nova-compute[74311]: DEBUG nova.network.neutron [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:44:53 user nova-compute[74311]: DEBUG nova.network.neutron [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updating instance_info_cache with network_info: [{"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:44:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Releasing lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:44:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:44:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-0fecd9a4-945f-4958-9052-381d2d76133c req-af93bab2-a6ea-4b6c-85f7-d96f2777574e service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-vif-unplugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0fecd9a4-945f-4958-9052-381d2d76133c req-af93bab2-a6ea-4b6c-85f7-d96f2777574e service nova] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0fecd9a4-945f-4958-9052-381d2d76133c req-af93bab2-a6ea-4b6c-85f7-d96f2777574e service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0fecd9a4-945f-4958-9052-381d2d76133c req-af93bab2-a6ea-4b6c-85f7-d96f2777574e service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-0fecd9a4-945f-4958-9052-381d2d76133c req-af93bab2-a6ea-4b6c-85f7-d96f2777574e service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] No waiting events found dispatching network-vif-unplugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:44:54 user nova-compute[74311]: WARNING nova.compute.manager [req-0fecd9a4-945f-4958-9052-381d2d76133c req-af93bab2-a6ea-4b6c-85f7-d96f2777574e service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received unexpected event network-vif-unplugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 10:44:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:54 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Instance destroyed successfully.
Oct 20 10:44:54 user nova-compute[74311]: DEBUG nova.objects.instance [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'resources' on Instance uuid 785fdcb1-5995-485c-a931-3a2537700785 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1156781070',display_name='tempest-TestMinimumBasicScenario-server-1156781070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1156781070',id=45,image_ref='706b4482-9d7a-46aa-99c8-d2406826b5cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj/D+1WyPOap3Jo+vC1Q5hCcw2yS28HXSOkgxqKTeUc8i0RUKyxTssv6yVsUkIvEWvb+Zgt5GLVTyuUKFt32znAPpJwn0pqltkVaRupLZFTExIPcZcBWT14VOcMt4epMQ==',key_name='tempest-TestMinimumBasicScenario-43511418',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:42:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b78bfc1cd59d4be3b98ddad43a8d3002',ramdisk_id='',reservation_id='r-uwxccota',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='706b4482-9d7a-46aa-99c8-d2406826b5cd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1072164048',owner_user_name='tempest-TestMinimumBasicScenario-1072164048-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:44:54Z,user_data=None,user_id='24c8f83400ef489e88a4f719e301b284',uuid=785fdcb1-5995-485c-a931-3a2537700785,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converting VIF {"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:32:c1,bridge_name='br-int',has_traffic_filtering=True,id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dadfb0d-8e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_vif [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:32:c1,bridge_name='br-int',has_traffic_filtering=True,id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dadfb0d-8e') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7dadfb0d-8e, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8fdc4ae-538a-4822-bd97-c46db944d7d3) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:44:54 user nova-compute[74311]: INFO os_vif [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:32:c1,bridge_name='br-int',has_traffic_filtering=True,id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dadfb0d-8e')
Oct 20 10:44:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mcRblCMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:44:54 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5930cced-5b72-44b9-9177-7f941a5eb83f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:44:54 user nova-compute[74311]: No targets found.
Oct 20 10:44:54 user nova-compute[74311]: iSNS:
Oct 20 10:44:54 user nova-compute[74311]: No targets found.
Oct 20 10:44:54 user nova-compute[74311]: STATIC:
Oct 20 10:44:54 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748
Oct 20 10:44:54 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:44:54 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:44:54 user nova-compute[74311]: FIRMWARE:
Oct 20 10:44:54 user nova-compute[74311]: No targets found.
Oct 20 10:44:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:44:54 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:44:54 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ed1991-acd8-44fc-bcd4-a58d3f8abbe5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[526e95bf-bb66-43f9-b494-739a43a207cc]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:44:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:44:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164e43250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b15a34-ed7a-4f1b-9242-e30b2fff8c13]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf3329e-1760-4c1d-825e-f48194aca8f5]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0301ab-9313-48ac-a416-c5aa5583ce5b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e672097-694d-4508-8672-20f56f20e6a6]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aed76b0-481e-47fc-a86f-736dec4a5bdb]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a95cb9a-694d-4574-a78c-61aa2f35a7f9]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260]
Oct 20 10:44:54 user nova-compute[74311]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260] successful.
Oct 20 10:44:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[547d5233-ae4b-41d2-aaa2-abb3a9c3fa38]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] <== disconnect_volume: return (277ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:44:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Start _get_guest_xml network_info=[{"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=706b4482-9d7a-46aa-99c8-d2406826b5cd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '706b4482-9d7a-46aa-99c8-d2406826b5cd'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '24bd85d6-60d1-4db2-af88-5bccfc1fa104', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mcRblCMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '785fdcb1-5995-485c-a931-3a2537700785', 'attached_at': '', 'detached_at': '', 'volume_id': '4db5caad-99d2-4f77-960a-3d318c290748', 'serial': '4db5caad-99d2-4f77-960a-3d318c290748'}, 'boot_index': None, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:44:54 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:44:54 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=706b4482-9d7a-46aa-99c8-d2406826b5cd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.objects.instance [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'vcpu_model' on Instance uuid 785fdcb1-5995-485c-a931-3a2537700785 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.objects.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Object Instance<785fdcb1-5995-485c-a931-3a2537700785> lazy-loaded attributes: resources,vcpu_model {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mcRblCMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:44:55 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:44:55 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:44:55 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8faffc-3b3b-45b9-a74b-c1be099d94ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:44:55 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bec7f7d-ccaa-4c3d-a287-89af2482a410]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748] added
Oct 20 10:44:55 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb741f3-9149-4465-b416-d3ccab513193]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef7c8a2-e242-493b-a24f-63e3b9c40f4e]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mcRblCMG {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mcRblCMG" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4bfe41-4304-489b-aa38-55880451ce12]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mcRblCMG'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[86251e89-219e-407c-9bbd-37ddea1ddcfd]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[73504704-602a-4cf1-96d0-c83187dd21f7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:44:55 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:44:55 user nova-compute[74311]:  {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:44:55 user nova-compute[74311]: WARNING os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 10:44:55 user nova-compute[74311]: 
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[445afc4c-05bd-4f94-ab61-3338cbac5414]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260]
Oct 20 10:44:55 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260] successful.
Oct 20 10:44:55 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ef48d8-bf38-4e72-87cc-c9d244d9c70c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b3a003-e30b-4372-94d2-27073d5360f2]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:44:55 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:44:55 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8605c053-2a65-452c-b044-41d889872b14]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:44:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mcRblCMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23234396565313932', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234396565313932', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-d414c0dc-d657-4072-b5a2-9e26a3dd1a2d req-733b03ab-f810-4a78-8e3e-a9618e9db8e4 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d414c0dc-d657-4072-b5a2-9e26a3dd1a2d req-733b03ab-f810-4a78-8e3e-a9618e9db8e4 service nova] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d414c0dc-d657-4072-b5a2-9e26a3dd1a2d req-733b03ab-f810-4a78-8e3e-a9618e9db8e4 service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d414c0dc-d657-4072-b5a2-9e26a3dd1a2d req-733b03ab-f810-4a78-8e3e-a9618e9db8e4 service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-d414c0dc-d657-4072-b5a2-9e26a3dd1a2d req-733b03ab-f810-4a78-8e3e-a9618e9db8e4 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] No waiting events found dispatching network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:44:56 user nova-compute[74311]: WARNING nova.compute.manager [req-d414c0dc-d657-4072-b5a2-9e26a3dd1a2d req-733b03ab-f810-4a78-8e3e-a9618e9db8e4 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received unexpected event network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 10:44:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1156781070',display_name='tempest-TestMinimumBasicScenario-server-1156781070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1156781070',id=45,image_ref='706b4482-9d7a-46aa-99c8-d2406826b5cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj/D+1WyPOap3Jo+vC1Q5hCcw2yS28HXSOkgxqKTeUc8i0RUKyxTssv6yVsUkIvEWvb+Zgt5GLVTyuUKFt32znAPpJwn0pqltkVaRupLZFTExIPcZcBWT14VOcMt4epMQ==',key_name='tempest-TestMinimumBasicScenario-43511418',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:42:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b78bfc1cd59d4be3b98ddad43a8d3002',ramdisk_id='',reservation_id='r-uwxccota',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='706b4482-9d7a-46aa-99c8-d2406826b5cd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1072164048',owner_user_name='tempest-TestMinimumBasicScenario-1072164048-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:44:54Z,user_data=None,user_id='24c8f83400ef489e88a4f719e301b284',uuid=785fdcb1-5995-485c-a931-3a2537700785,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converting VIF {"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:32:c1,bridge_name='br-int',has_traffic_filtering=True,id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dadfb0d-8e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG nova.objects.instance [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'pci_devices' on Instance uuid 785fdcb1-5995-485c-a931-3a2537700785 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG nova.objects.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Object Instance<785fdcb1-5995-485c-a931-3a2537700785> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:44:56 user nova-compute[74311]:   <uuid>785fdcb1-5995-485c-a931-3a2537700785</uuid>
Oct 20 10:44:56 user nova-compute[74311]:   <name>instance-0000002d</name>
Oct 20 10:44:56 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:44:56 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:44:56 user nova-compute[74311]:   <metadata>
Oct 20 10:44:56 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:44:56 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:44:56 user nova-compute[74311]:       <nova:name>tempest-TestMinimumBasicScenario-server-1156781070</nova:name>
Oct 20 10:44:56 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:44:54</nova:creationTime>
Oct 20 10:44:56 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:44:56 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:44:56 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:44:56 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:44:56 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:44:56 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:44:56 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:44:56 user nova-compute[74311]:       <nova:owner>
Oct 20 10:44:56 user nova-compute[74311]:         <nova:user uuid="24c8f83400ef489e88a4f719e301b284">tempest-TestMinimumBasicScenario-1072164048-project-member</nova:user>
Oct 20 10:44:56 user nova-compute[74311]:         <nova:project uuid="b78bfc1cd59d4be3b98ddad43a8d3002">tempest-TestMinimumBasicScenario-1072164048</nova:project>
Oct 20 10:44:56 user nova-compute[74311]:       </nova:owner>
Oct 20 10:44:56 user nova-compute[74311]:       <nova:root type="image" uuid="706b4482-9d7a-46aa-99c8-d2406826b5cd"/>
Oct 20 10:44:56 user nova-compute[74311]:       <nova:ports>
Oct 20 10:44:56 user nova-compute[74311]:         <nova:port uuid="7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9">
Oct 20 10:44:56 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 10:44:56 user nova-compute[74311]:         </nova:port>
Oct 20 10:44:56 user nova-compute[74311]:       </nova:ports>
Oct 20 10:44:56 user nova-compute[74311]:     </nova:instance>
Oct 20 10:44:56 user nova-compute[74311]:   </metadata>
Oct 20 10:44:56 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:44:56 user nova-compute[74311]:     <system>
Oct 20 10:44:56 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:44:56 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:44:56 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:44:56 user nova-compute[74311]:       <entry name="serial">785fdcb1-5995-485c-a931-3a2537700785</entry>
Oct 20 10:44:56 user nova-compute[74311]:       <entry name="uuid">785fdcb1-5995-485c-a931-3a2537700785</entry>
Oct 20 10:44:56 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:44:56 user nova-compute[74311]:     </system>
Oct 20 10:44:56 user nova-compute[74311]:   </sysinfo>
Oct 20 10:44:56 user nova-compute[74311]:   <os>
Oct 20 10:44:56 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:44:56 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:44:56 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:44:56 user nova-compute[74311]:   </os>
Oct 20 10:44:56 user nova-compute[74311]:   <features>
Oct 20 10:44:56 user nova-compute[74311]:     <acpi/>
Oct 20 10:44:56 user nova-compute[74311]:     <apic/>
Oct 20 10:44:56 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:44:56 user nova-compute[74311]:   </features>
Oct 20 10:44:56 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:44:56 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:44:56 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:44:56 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:44:56 user nova-compute[74311]:   </clock>
Oct 20 10:44:56 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:44:56 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:44:56 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:44:56 user nova-compute[74311]:   </cpu>
Oct 20 10:44:56 user nova-compute[74311]:   <devices>
Oct 20 10:44:56 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:44:56 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:44:56 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk"/>
Oct 20 10:44:56 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:44:56 user nova-compute[74311]:     </disk>
Oct 20 10:44:56 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:44:56 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:44:56 user nova-compute[74311]:       <source dev="/dev/sdb"/>
Oct 20 10:44:56 user nova-compute[74311]:       <target dev="vdb" bus="virtio"/>
Oct 20 10:44:56 user nova-compute[74311]:       <serial>4db5caad-99d2-4f77-960a-3d318c290748</serial>
Oct 20 10:44:56 user nova-compute[74311]:     </disk>
Oct 20 10:44:56 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:44:56 user nova-compute[74311]:       <mac address="fa:16:3e:d2:32:c1"/>
Oct 20 10:44:56 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:44:56 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:44:56 user nova-compute[74311]:       <target dev="tap7dadfb0d-8e"/>
Oct 20 10:44:56 user nova-compute[74311]:     </interface>
Oct 20 10:44:56 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:44:56 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/console.log" append="off"/>
Oct 20 10:44:56 user nova-compute[74311]:     </serial>
Oct 20 10:44:56 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:44:56 user nova-compute[74311]:     <video>
Oct 20 10:44:56 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:44:56 user nova-compute[74311]:     </video>
Oct 20 10:44:56 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:44:56 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:44:56 user nova-compute[74311]:     </rng>
Oct 20 10:44:56 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:44:56 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:44:56 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:44:56 user nova-compute[74311]:     </memballoon>
Oct 20 10:44:56 user nova-compute[74311]:   </devices>
Oct 20 10:44:56 user nova-compute[74311]: </domain>
Oct 20 10:44:56 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG nova.objects.instance [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'trusted_certs' on Instance uuid 785fdcb1-5995-485c-a931-3a2537700785 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG nova.objects.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Object Instance<785fdcb1-5995-485c-a931-3a2537700785> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:44:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Cannot resize image /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG nova.objects.instance [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'migration_context' on Instance uuid 785fdcb1-5995-485c-a931-3a2537700785 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG nova.objects.base [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Object Instance<785fdcb1-5995-485c-a931-3a2537700785> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74311) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1156781070',display_name='tempest-TestMinimumBasicScenario-server-1156781070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1156781070',id=45,image_ref='706b4482-9d7a-46aa-99c8-d2406826b5cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj/D+1WyPOap3Jo+vC1Q5hCcw2yS28HXSOkgxqKTeUc8i0RUKyxTssv6yVsUkIvEWvb+Zgt5GLVTyuUKFt32znAPpJwn0pqltkVaRupLZFTExIPcZcBWT14VOcMt4epMQ==',key_name='tempest-TestMinimumBasicScenario-43511418',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:42:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='b78bfc1cd59d4be3b98ddad43a8d3002',ramdisk_id='',reservation_id='r-uwxccota',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='706b4482-9d7a-46aa-99c8-d2406826b5cd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1072164048',owner_user_name='tempest-TestMinimumBasicScenario-1072164048-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:44:54Z,user_data=None,user_id='24c8f83400ef489e88a4f719e301b284',uuid=785fdcb1-5995-485c-a931-3a2537700785,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converting VIF {"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:32:c1,bridge_name='br-int',has_traffic_filtering=True,id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dadfb0d-8e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG os_vif [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:32:c1,bridge_name='br-int',has_traffic_filtering=True,id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dadfb0d-8e') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfda2a8b-7e44-5dba-ae21-2dcc144c421b', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7dadfb0d-8e, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7dadfb0d-8e, col_values=(('qos', UUID('3838d48b-aa39-4ad5-8139-69bf41c9b08b')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7dadfb0d-8e, col_values=(('external_ids', {'iface-id': '7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:32:c1', 'vm-uuid': '785fdcb1-5995-485c-a931-3a2537700785'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:44:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:57 user nova-compute[74311]: INFO os_vif [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:32:c1,bridge_name='br-int',has_traffic_filtering=True,id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dadfb0d-8e')
Oct 20 10:44:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-d6f003f5-396a-4004-81f0-7bea58312e41 req-6bf4e229-c124-48d8-ab25-298f62966828 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:44:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d6f003f5-396a-4004-81f0-7bea58312e41 req-6bf4e229-c124-48d8-ab25-298f62966828 service nova] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:44:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d6f003f5-396a-4004-81f0-7bea58312e41 req-6bf4e229-c124-48d8-ab25-298f62966828 service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:44:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-d6f003f5-396a-4004-81f0-7bea58312e41 req-6bf4e229-c124-48d8-ab25-298f62966828 service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:44:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-d6f003f5-396a-4004-81f0-7bea58312e41 req-6bf4e229-c124-48d8-ab25-298f62966828 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] No waiting events found dispatching network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:44:58 user nova-compute[74311]: WARNING nova.compute.manager [req-d6f003f5-396a-4004-81f0-7bea58312e41 req-6bf4e229-c124-48d8-ab25-298f62966828 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received unexpected event network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 10:44:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:44:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:45:00 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Instance rebooted successfully.
Oct 20 10:45:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:45:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-4d80678d-bfcc-4e35-94ff-acdd0276a03e req-e6d29ee5-824c-47fd-a623-dbb6f8346288 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received event network-changed-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:45:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-4d80678d-bfcc-4e35-94ff-acdd0276a03e req-e6d29ee5-824c-47fd-a623-dbb6f8346288 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Refreshing instance network info cache due to event network-changed-aa5241d8-bb82-4c93-9bfd-116406ee4dd9. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:45:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4d80678d-bfcc-4e35-94ff-acdd0276a03e req-e6d29ee5-824c-47fd-a623-dbb6f8346288 service nova] Acquiring lock "refresh_cache-da32cd92-f1d7-4f26-9f74-6a1a23a02e60" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:45:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4d80678d-bfcc-4e35-94ff-acdd0276a03e req-e6d29ee5-824c-47fd-a623-dbb6f8346288 service nova] Acquired lock "refresh_cache-da32cd92-f1d7-4f26-9f74-6a1a23a02e60" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:45:00 user nova-compute[74311]: DEBUG nova.network.neutron [req-4d80678d-bfcc-4e35-94ff-acdd0276a03e req-e6d29ee5-824c-47fd-a623-dbb6f8346288 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Refreshing network info cache for port aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:45:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-c90743bb-4722-4507-95b2-6700a31c4186 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "785fdcb1-5995-485c-a931-3a2537700785" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.605s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:45:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-ba0aa335-382e-4d88-959e-90f37f1f204f req-4df5d340-8621-4d1e-bac1-b5ef79a06faa service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:45:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ba0aa335-382e-4d88-959e-90f37f1f204f req-4df5d340-8621-4d1e-bac1-b5ef79a06faa service nova] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:45:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ba0aa335-382e-4d88-959e-90f37f1f204f req-4df5d340-8621-4d1e-bac1-b5ef79a06faa service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:45:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ba0aa335-382e-4d88-959e-90f37f1f204f req-4df5d340-8621-4d1e-bac1-b5ef79a06faa service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:45:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-ba0aa335-382e-4d88-959e-90f37f1f204f req-4df5d340-8621-4d1e-bac1-b5ef79a06faa service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] No waiting events found dispatching network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:45:00 user nova-compute[74311]: WARNING nova.compute.manager [req-ba0aa335-382e-4d88-959e-90f37f1f204f req-4df5d340-8621-4d1e-bac1-b5ef79a06faa service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received unexpected event network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 for instance with vm_state active and task_state None.
Oct 20 10:45:01 user nova-compute[74311]: DEBUG nova.network.neutron [req-4d80678d-bfcc-4e35-94ff-acdd0276a03e req-e6d29ee5-824c-47fd-a623-dbb6f8346288 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Updated VIF entry in instance network info cache for port aa5241d8-bb82-4c93-9bfd-116406ee4dd9. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:45:01 user nova-compute[74311]: DEBUG nova.network.neutron [req-4d80678d-bfcc-4e35-94ff-acdd0276a03e req-e6d29ee5-824c-47fd-a623-dbb6f8346288 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Updating instance_info_cache with network_info: [{"id": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "address": "fa:16:3e:8d:1d:e4", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5241d8-bb", "ovs_interfaceid": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:45:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4d80678d-bfcc-4e35-94ff-acdd0276a03e req-e6d29ee5-824c-47fd-a623-dbb6f8346288 service nova] Releasing lock "refresh_cache-da32cd92-f1d7-4f26-9f74-6a1a23a02e60" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:45:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:45:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:45:01 user nova-compute[74311]: DEBUG nova.objects.instance [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lazy-loading 'flavor' on Instance uuid da32cd92-f1d7-4f26-9f74-6a1a23a02e60 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:45:01 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Ignoring supplied device name: /dev/vdb
Oct 20 10:45:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:45:02 user nova-compute[74311]: INFO nova.compute.manager [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Attaching volume ccba51a7-18ca-4489-b4bb-39b60f0d4acd to /dev/vdb
Oct 20 10:45:02 user nova-compute[74311]: DEBUG os_brick.utils [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b7be90-34a7-495f-9f3e-a3f6b9c0e495]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e2bec5-50be-40a0-9c9d-4c129e5e8504]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[768cc298-935f-44cc-a54b-168a3fabe772]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4327d204-0113-40ac-9f43-91fe07c4f4a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:45:02 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:45:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f535c44-1a7e-42e5-ad19-9528706e0f7a]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG os_brick.utils [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:45:02 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Updating existing volume attachment record: bad0642b-6058-457d-b0d8-c0a191407492 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:45:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YtogCxym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:45:06 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:45:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:45:06 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:45:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:45:06 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[424c4e77-4b1c-4e12-88cd-c51bbdc1da15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:45:06 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf6b2c0-59ef-4ab1-9a5e-1d8a3a4cdd20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5] added
Oct 20 10:45:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[946d41cf-7538-453f-aa02-f36879cc5af3]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e90847-6973-42ef-9b59-cd78c16511fa]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YtogCxym {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YtogCxym" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cbc18e-ef2f-471f-a1a8-b507ad85401d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YtogCxym'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea6b82b-87d0-4035-bc9d-b7e763fa9d4b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf3d95d-862c-414e-a91b-b6b5a2e474c7]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:45:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:45:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe94689e-f76a-4e88-a073-1c805ee41419]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5, portal: 172.16.0.220,3260]
Oct 20 10:45:07 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5, portal: 172.16.0.220,3260] successful.
Oct 20 10:45:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3f089f-5791-4ace-850b-b52f7c8b7d98]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0a9c2e-86c2-416e-8ccd-5ba8ff19b9d8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:45:07 user nova-compute[74311]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)
Oct 20 10:45:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:45:07 user nova-compute[74311]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)
Oct 20 10:45:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4ef0fa-855f-4cf6-8c39-27c7d12d1bef]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YtogCxym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:45:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:45:08 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26562633333633434', 'path': '/dev/sdc'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:45:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562633333633434', 'path': '/dev/sdc'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:45:08 user nova-compute[74311]: DEBUG nova.objects.instance [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lazy-loading 'flavor' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:45:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:45:08 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:45:08 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:45:08 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:45:08 user nova-compute[74311]:   <serial>69823483-dd50-43df-a345-b117eb9786e5</serial>
Oct 20 10:45:08 user nova-compute[74311]: </disk>
Oct 20 10:45:08 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:45:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:45:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:45:08 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] No VIF found with MAC fa:16:3e:56:4a:4d, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:45:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-81103b9b-267b-4645-a3ce-e3ddd9cfeb83 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.841s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:45:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:45:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:45:11 user nova-compute[74311]: DEBUG nova.compute.manager [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:45:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:45:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:45:11 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:45:11 user nova-compute[74311]: INFO nova.compute.claims [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Claim successful on node user
Oct 20 10:45:11 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:45:11 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:45:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:45:11 user nova-compute[74311]: DEBUG nova.compute.manager [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:45:11 user nova-compute[74311]: DEBUG nova.compute.manager [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:45:11 user nova-compute[74311]: DEBUG nova.network.neutron [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:45:11 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:45:11 user nova-compute[74311]: DEBUG nova.compute.manager [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:45:11 user nova-compute[74311]: INFO nova.virt.block_device [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Booting with volume e4b55e17-9b40-477a-8918-536f0e39236b at /dev/vda
Oct 20 10:45:12 user nova-compute[74311]: DEBUG nova.policy [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9634a3daf064bf2aad6ea38454f7639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7a52d2fa8243fabc22baa8694e14d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG os_brick.utils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff03fe0-51e6-4a91-85a2-79f5dd1d56d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb997d3-479a-414f-b7d8-6f423c6d6b20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[535f3f3e-3f92-4ab2-b752-c955fcb597dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[436ccc13-c0c6-42e8-86ad-cc4b67bbbdb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:45:12 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:45:12 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7074176-a7c5-47d7-b320-6ebe7eb43143]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG os_brick.utils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Updating existing volume attachment record: 2c88871c-c921-4556-811c-5b6f591e4323 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:45:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:13 user nova-compute[74311]: DEBUG nova.network.neutron [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Successfully created port: f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:45:13 user nova-compute[74311]: DEBUG nova.network.neutron [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Successfully updated port: f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:45:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:45:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquired lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:45:13 user nova-compute[74311]: DEBUG nova.network.neutron [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:45:13 user nova-compute[74311]: DEBUG nova.compute.manager [req-4b2a2042-bb17-460c-aca1-014f6f872fef req-e8cc6a01-0347-4688-8077-4a4112e09b45 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Received event network-changed-f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:45:13 user nova-compute[74311]: DEBUG nova.compute.manager [req-4b2a2042-bb17-460c-aca1-014f6f872fef req-e8cc6a01-0347-4688-8077-4a4112e09b45 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Refreshing instance network info cache due to event network-changed-f04b4733-87a4-4ecf-961f-0d5232d7c480. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:45:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4b2a2042-bb17-460c-aca1-014f6f872fef req-e8cc6a01-0347-4688-8077-4a4112e09b45 service nova] Acquiring lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:45:13 user nova-compute[74311]: DEBUG nova.network.neutron [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:45:14 user nova-compute[74311]: DEBUG nova.network.neutron [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Updating instance_info_cache with network_info: [{"id": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "address": "fa:16:3e:0e:34:85", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04b4733-87", "ovs_interfaceid": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:45:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Releasing lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:45:14 user nova-compute[74311]: DEBUG nova.compute.manager [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Instance network_info: |[{"id": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "address": "fa:16:3e:0e:34:85", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04b4733-87", "ovs_interfaceid": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:45:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4b2a2042-bb17-460c-aca1-014f6f872fef req-e8cc6a01-0347-4688-8077-4a4112e09b45 service nova] Acquired lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:45:14 user nova-compute[74311]: DEBUG nova.network.neutron [req-4b2a2042-bb17-460c-aca1-014f6f872fef req-e8cc6a01-0347-4688-8077-4a4112e09b45 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Refreshing network info cache for port f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:45:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:14 user nova-compute[74311]: DEBUG nova.network.neutron [req-4b2a2042-bb17-460c-aca1-014f6f872fef req-e8cc6a01-0347-4688-8077-4a4112e09b45 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Updated VIF entry in instance network info cache for port f04b4733-87a4-4ecf-961f-0d5232d7c480. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:45:14 user nova-compute[74311]: DEBUG nova.network.neutron [req-4b2a2042-bb17-460c-aca1-014f6f872fef req-e8cc6a01-0347-4688-8077-4a4112e09b45 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Updating instance_info_cache with network_info: [{"id": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "address": "fa:16:3e:0e:34:85", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04b4733-87", "ovs_interfaceid": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:45:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4b2a2042-bb17-460c-aca1-014f6f872fef req-e8cc6a01-0347-4688-8077-4a4112e09b45 service nova] Releasing lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:45:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:18 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:45:18 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:45:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:45:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:45:18 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:45:18 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updating instance_info_cache with network_info: [{"id": "af3cce47-5348-449e-b5ca-c006515a379e", "address": "fa:16:3e:56:4a:4d", "network": {"id": "fa57bf52-f1a0-4605-878e-a936f3c7e717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1036604684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a090a44405c45ee9bcdd6a34c0173a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cce47-53", "ovs_interfaceid": "af3cce47-5348-449e-b5ca-c006515a379e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:45:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:45:18 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vawiejon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:45:19 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:45:19 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:45:19 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b737df72-38ac-4aef-a857-43afd0fba14e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:45:19 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7743809-1e36-4680-9ec4-646ba52b7581]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd] added
Oct 20 10:45:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e35c9e2-d54d-4c40-ba0b-fe4c896a5f5c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd78143c-6c6e-43a4-9905-3538a0b0393a]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vawiejon {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vawiejon" returned: 0 in 0.033s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[85758df7-05bb-4d59-918e-061f2d754144]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vawiejon'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f8a66c-04f7-4e00-b808-ef1e83321075]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee8aa76-5643-4e85-b559-9c40301985dc]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:45:19 user nova-compute[74311]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)
Oct 20 10:45:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:45:19 user nova-compute[74311]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)
Oct 20 10:45:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad6a27d-e044-4d65-aa02-581b857620a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd, portal: 172.16.0.220,3260]
Oct 20 10:45:19 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd, portal: 172.16.0.220,3260] successful.
Oct 20 10:45:19 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2678a327-ae2f-4ff4-a433-efad96e8fcf0]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:19 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[438bf956-1303-4523-abf8-72ae10d505e6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:45:20 user nova-compute[74311]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)
Oct 20 10:45:20 user nova-compute[74311]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)
Oct 20 10:45:20 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:45:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:45:20 user nova-compute[74311]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)
Oct 20 10:45:20 user nova-compute[74311]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)
Oct 20 10:45:20 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:45:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:45:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:45:20 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:45:20 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:45:20 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:45:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6774fb5-1509-4621-b95a-44cc1e8f0dcb]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:20 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:45:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vawiejon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:45:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:45:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23262333064613866', 'path': '/dev/sdd'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:45:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262333064613866', 'path': '/dev/sdd'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:45:21 user nova-compute[74311]: DEBUG nova.objects.instance [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lazy-loading 'flavor' on Instance uuid da32cd92-f1d7-4f26-9f74-6a1a23a02e60 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:45:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:45:21 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:45:21 user nova-compute[74311]:   <source dev="/dev/sdd"/>
Oct 20 10:45:21 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:45:21 user nova-compute[74311]:   <serial>ccba51a7-18ca-4489-b4bb-39b60f0d4acd</serial>
Oct 20 10:45:21 user nova-compute[74311]: </disk>
Oct 20 10:45:21 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:45:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:45:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:45:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] No VIF found with MAC fa:16:3e:8d:1d:e4, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:45:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3bebe92b-f81e-4ecc-b22b-e8ee5c3b0314 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.846s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:45:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:25 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:45:26 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:45:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:27 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:45:29 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:45:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.compute.manager [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:45:30 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Creating image(s)
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Ensure instance console log exists: /opt/stack/data/nova/instances/bd1f0ae9-d07b-45db-94f2-81baf48010bf/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Start _get_guest_xml network_info=[{"id": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "address": "fa:16:3e:0e:34:85", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04b4733-87", "ovs_interfaceid": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '2c88871c-c921-4556-811c-5b6f591e4323', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TojvNfEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bd1f0ae9-d07b-45db-94f2-81baf48010bf', 'attached_at': '', 'detached_at': '', 'volume_id': 'e4b55e17-9b40-477a-8918-536f0e39236b', 'serial': 'e4b55e17-9b40-477a-8918-536f0e39236b'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:45:30 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:45:30 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TojvNfEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:45:30 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:45:30 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:45:30 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9238785e-b692-4b59-9fe9-6fc1b2045949]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:45:30 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[30435c5b-7740-42e3-82ac-016a82f84ba4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b] added
Oct 20 10:45:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d50e2f-7ba4-4f94-9463-942635987561]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a11c5f-2bf5-492b-8d2c-960b31864fd4]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TojvNfEc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TojvNfEc" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ee8420-99bd-478a-af1e-ba9c97a8d0b5]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TojvNfEc'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5a1063-245c-43af-aa98-ec6f0f8556f6]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[004ced31-6b0b-44cc-a0f1-6efec36cd654]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:45:30 user nova-compute[74311]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)
Oct 20 10:45:30 user nova-compute[74311]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)
Oct 20 10:45:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:45:30 user nova-compute[74311]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)
Oct 20 10:45:30 user nova-compute[74311]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)
Oct 20 10:45:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --login" returned: 0 in 0.192s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20e7ff1-f130-402d-b762-a912150f6500]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260]
Oct 20 10:45:30 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260] successful.
Oct 20 10:45:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43733d4-1ae5-4092-864f-a2e2371f89fd]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d6482c-b40d-402d-99a2-2433e0febe91]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:45:30 user nova-compute[74311]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)
Oct 20 10:45:30 user nova-compute[74311]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)
Oct 20 10:45:30 user nova-compute[74311]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:45:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:45:30 user nova-compute[74311]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)
Oct 20 10:45:30 user nova-compute[74311]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)
Oct 20 10:45:30 user nova-compute[74311]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:45:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2b34d3-3979-438c-bd72-127e8d4f6aed]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:45:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TojvNfEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== connect_volume: return (1460ms) {'type': 'block', 'scsi_wwn': '26265376338346539', 'path': '/dev/sde'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265376338346539', 'path': '/dev/sde'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1238377505',display_name='tempest-TestVolumeBootPattern-server-1238377505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1238377505',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3a39KFZ17bE3ncvzIcH4Vxw/Y2gdrgDREcztfOEHBNO1uipHHk2Y+XPwHgE3eoiT29JTcO8Ys40E+uqpMDlmjQ529gbmWean5D7IYFP305bqhP5ciafYVbX9wu+N+nLQ==',key_name='tempest-TestVolumeBootPattern-1713092442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-qb074cae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:45:12Z,user_data=None,user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=bd1f0ae9-d07b-45db-94f2-81baf48010bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "address": "fa:16:3e:0e:34:85", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04b4733-87", "ovs_interfaceid": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "address": "fa:16:3e:0e:34:85", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04b4733-87", "ovs_interfaceid": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:34:85,bridge_name='br-int',has_traffic_filtering=True,id=f04b4733-87a4-4ecf-961f-0d5232d7c480,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04b4733-87') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG nova.objects.instance [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lazy-loading 'pci_devices' on Instance uuid bd1f0ae9-d07b-45db-94f2-81baf48010bf {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:45:31 user nova-compute[74311]:   <uuid>bd1f0ae9-d07b-45db-94f2-81baf48010bf</uuid>
Oct 20 10:45:31 user nova-compute[74311]:   <name>instance-00000031</name>
Oct 20 10:45:31 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:45:31 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:45:31 user nova-compute[74311]:   <metadata>
Oct 20 10:45:31 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:45:31 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:45:31 user nova-compute[74311]:       <nova:name>tempest-TestVolumeBootPattern-server-1238377505</nova:name>
Oct 20 10:45:31 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:45:30</nova:creationTime>
Oct 20 10:45:31 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:45:31 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:45:31 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:45:31 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:45:31 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:45:31 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:45:31 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:45:31 user nova-compute[74311]:       <nova:owner>
Oct 20 10:45:31 user nova-compute[74311]:         <nova:user uuid="f9634a3daf064bf2aad6ea38454f7639">tempest-TestVolumeBootPattern-1419375529-project-member</nova:user>
Oct 20 10:45:31 user nova-compute[74311]:         <nova:project uuid="aa7a52d2fa8243fabc22baa8694e14d6">tempest-TestVolumeBootPattern-1419375529</nova:project>
Oct 20 10:45:31 user nova-compute[74311]:       </nova:owner>
Oct 20 10:45:31 user nova-compute[74311]:       <nova:ports>
Oct 20 10:45:31 user nova-compute[74311]:         <nova:port uuid="f04b4733-87a4-4ecf-961f-0d5232d7c480">
Oct 20 10:45:31 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 10:45:31 user nova-compute[74311]:         </nova:port>
Oct 20 10:45:31 user nova-compute[74311]:       </nova:ports>
Oct 20 10:45:31 user nova-compute[74311]:     </nova:instance>
Oct 20 10:45:31 user nova-compute[74311]:   </metadata>
Oct 20 10:45:31 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:45:31 user nova-compute[74311]:     <system>
Oct 20 10:45:31 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:45:31 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:45:31 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:45:31 user nova-compute[74311]:       <entry name="serial">bd1f0ae9-d07b-45db-94f2-81baf48010bf</entry>
Oct 20 10:45:31 user nova-compute[74311]:       <entry name="uuid">bd1f0ae9-d07b-45db-94f2-81baf48010bf</entry>
Oct 20 10:45:31 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:45:31 user nova-compute[74311]:     </system>
Oct 20 10:45:31 user nova-compute[74311]:   </sysinfo>
Oct 20 10:45:31 user nova-compute[74311]:   <os>
Oct 20 10:45:31 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:45:31 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:45:31 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:45:31 user nova-compute[74311]:   </os>
Oct 20 10:45:31 user nova-compute[74311]:   <features>
Oct 20 10:45:31 user nova-compute[74311]:     <acpi/>
Oct 20 10:45:31 user nova-compute[74311]:     <apic/>
Oct 20 10:45:31 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:45:31 user nova-compute[74311]:   </features>
Oct 20 10:45:31 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:45:31 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:45:31 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:45:31 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:45:31 user nova-compute[74311]:   </clock>
Oct 20 10:45:31 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:45:31 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:45:31 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:45:31 user nova-compute[74311]:   </cpu>
Oct 20 10:45:31 user nova-compute[74311]:   <devices>
Oct 20 10:45:31 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:45:31 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:45:31 user nova-compute[74311]:       <source dev="/dev/sde"/>
Oct 20 10:45:31 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:45:31 user nova-compute[74311]:       <serial>e4b55e17-9b40-477a-8918-536f0e39236b</serial>
Oct 20 10:45:31 user nova-compute[74311]:     </disk>
Oct 20 10:45:31 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:45:31 user nova-compute[74311]:       <mac address="fa:16:3e:0e:34:85"/>
Oct 20 10:45:31 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:45:31 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:45:31 user nova-compute[74311]:       <target dev="tapf04b4733-87"/>
Oct 20 10:45:31 user nova-compute[74311]:     </interface>
Oct 20 10:45:31 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:45:31 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/bd1f0ae9-d07b-45db-94f2-81baf48010bf/console.log" append="off"/>
Oct 20 10:45:31 user nova-compute[74311]:     </serial>
Oct 20 10:45:31 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:45:31 user nova-compute[74311]:     <video>
Oct 20 10:45:31 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:45:31 user nova-compute[74311]:     </video>
Oct 20 10:45:31 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:45:31 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:45:31 user nova-compute[74311]:     </rng>
Oct 20 10:45:31 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:45:31 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:45:31 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:45:31 user nova-compute[74311]:     </memballoon>
Oct 20 10:45:31 user nova-compute[74311]:   </devices>
Oct 20 10:45:31 user nova-compute[74311]: </domain>
Oct 20 10:45:31 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1238377505',display_name='tempest-TestVolumeBootPattern-server-1238377505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1238377505',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3a39KFZ17bE3ncvzIcH4Vxw/Y2gdrgDREcztfOEHBNO1uipHHk2Y+XPwHgE3eoiT29JTcO8Ys40E+uqpMDlmjQ529gbmWean5D7IYFP305bqhP5ciafYVbX9wu+N+nLQ==',key_name='tempest-TestVolumeBootPattern-1713092442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-qb074cae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:45:12Z,user_data=None,user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=bd1f0ae9-d07b-45db-94f2-81baf48010bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "address": "fa:16:3e:0e:34:85", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04b4733-87", "ovs_interfaceid": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "address": "fa:16:3e:0e:34:85", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04b4733-87", "ovs_interfaceid": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:34:85,bridge_name='br-int',has_traffic_filtering=True,id=f04b4733-87a4-4ecf-961f-0d5232d7c480,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04b4733-87') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG os_vif [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:34:85,bridge_name='br-int',has_traffic_filtering=True,id=f04b4733-87a4-4ecf-961f-0d5232d7c480,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04b4733-87') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b39dd85-3670-53c1-a62b-8170e5408fa6', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf04b4733-87, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf04b4733-87, col_values=(('qos', UUID('02b8a4df-2e37-4181-b635-a3e846ab4259')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf04b4733-87, col_values=(('external_ids', {'iface-id': 'f04b4733-87a4-4ecf-961f-0d5232d7c480', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:34:85', 'vm-uuid': 'bd1f0ae9-d07b-45db-94f2-81baf48010bf'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:31 user nova-compute[74311]: INFO os_vif [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:34:85,bridge_name='br-int',has_traffic_filtering=True,id=f04b4733-87a4-4ecf-961f-0d5232d7c480,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04b4733-87')
Oct 20 10:45:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:45:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] No VIF found with MAC fa:16:3e:0e:34:85, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-486b0dc0-8c84-40a9-9f2f-66ebbcefea32 req-a1c396d9-bf0c-4906-b7b0-3f55961e5624 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Received event network-vif-plugged-f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-486b0dc0-8c84-40a9-9f2f-66ebbcefea32 req-a1c396d9-bf0c-4906-b7b0-3f55961e5624 service nova] Acquiring lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-486b0dc0-8c84-40a9-9f2f-66ebbcefea32 req-a1c396d9-bf0c-4906-b7b0-3f55961e5624 service nova] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-486b0dc0-8c84-40a9-9f2f-66ebbcefea32 req-a1c396d9-bf0c-4906-b7b0-3f55961e5624 service nova] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG nova.compute.manager [req-486b0dc0-8c84-40a9-9f2f-66ebbcefea32 req-a1c396d9-bf0c-4906-b7b0-3f55961e5624 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] No waiting events found dispatching network-vif-plugged-f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:45:33 user nova-compute[74311]: WARNING nova.compute.manager [req-486b0dc0-8c84-40a9-9f2f-66ebbcefea32 req-a1c396d9-bf0c-4906-b7b0-3f55961e5624 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Received unexpected event network-vif-plugged-f04b4733-87a4-4ecf-961f-0d5232d7c480 for instance with vm_state building and task_state spawning.
Oct 20 10:45:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:33 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:45:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:45:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:45:34 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:45:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:45:34 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.compute.manager [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-b42e19be-803e-4c82-8fd3-37a78cf55c0c req-1f7da914-df93-4408-bb61-e70adcc53dcd service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Received event network-vif-plugged-f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b42e19be-803e-4c82-8fd3-37a78cf55c0c req-1f7da914-df93-4408-bb61-e70adcc53dcd service nova] Acquiring lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b42e19be-803e-4c82-8fd3-37a78cf55c0c req-1f7da914-df93-4408-bb61-e70adcc53dcd service nova] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b42e19be-803e-4c82-8fd3-37a78cf55c0c req-1f7da914-df93-4408-bb61-e70adcc53dcd service nova] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-b42e19be-803e-4c82-8fd3-37a78cf55c0c req-1f7da914-df93-4408-bb61-e70adcc53dcd service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] No waiting events found dispatching network-vif-plugged-f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:45:35 user nova-compute[74311]: WARNING nova.compute.manager [req-b42e19be-803e-4c82-8fd3-37a78cf55c0c req-1f7da914-df93-4408-bb61-e70adcc53dcd service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Received unexpected event network-vif-plugged-f04b4733-87a4-4ecf-961f-0d5232d7c480 for instance with vm_state building and task_state spawning.
Oct 20 10:45:35 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:45:35 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8518MB free_disk=25.0538330078125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:45:35 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Instance spawned successfully.
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 785fdcb1-5995-485c-a931-3a2537700785 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance bb318c53-c058-439c-86f5-35847ac9c90e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance da32cd92-f1d7-4f26-9f74-6a1a23a02e60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance bd1f0ae9-d07b-45db-94f2-81baf48010bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:45:35 user nova-compute[74311]: INFO nova.compute.manager [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Took 5.67 seconds to spawn the instance on the hypervisor.
Oct 20 10:45:35 user nova-compute[74311]: DEBUG nova.compute.manager [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:45:36 user nova-compute[74311]: INFO nova.compute.manager [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Took 24.66 seconds to build instance.
Oct 20 10:45:36 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:45:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-53ae22dc-1eb6-431e-9d6b-3063d3f1f84f tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.774s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:45:36 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:45:36 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:45:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:45:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:39 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:45:39 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:45:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:45:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:45:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:45:41 user nova-compute[74311]: INFO nova.compute.manager [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Detaching volume 69823483-dd50-43df-a345-b117eb9786e5
Oct 20 10:45:41 user nova-compute[74311]: INFO nova.virt.block_device [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Attempting to driver detach volume 69823483-dd50-43df-a345-b117eb9786e5 from mountpoint /dev/vdb
Oct 20 10:45:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Attempting to detach device vdb from instance bb318c53-c058-439c-86f5-35847ac9c90e from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:45:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:45:41 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:45:41 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:45:41 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:45:41 user nova-compute[74311]:   <serial>69823483-dd50-43df-a345-b117eb9786e5</serial>
Oct 20 10:45:41 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:45:41 user nova-compute[74311]: </disk>
Oct 20 10:45:41 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:45:41 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Successfully detached device vdb from instance bb318c53-c058-439c-86f5-35847ac9c90e from the persistent domain config.
Oct 20 10:45:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb318c53-c058-439c-86f5-35847ac9c90e from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:45:41 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:45:41 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:45:41 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:45:41 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:45:41 user nova-compute[74311]:   <serial>69823483-dd50-43df-a345-b117eb9786e5</serial>
Oct 20 10:45:41 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:45:41 user nova-compute[74311]: </disk>
Oct 20 10:45:41 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:45:42 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:45:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:45:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:02 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bb318c53-c058-439c-86f5-35847ac9c90e is timed out.
Oct 20 10:46:02 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Successfully detached device vdb from instance bb318c53-c058-439c-86f5-35847ac9c90e from the live domain config.
Oct 20 10:46:02 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YtogCxym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:46:02 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[18afa517-5e08-4f0c-bb38-4ff4044c4594]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:46:02 user nova-compute[74311]: No targets found.
Oct 20 10:46:02 user nova-compute[74311]: iSNS:
Oct 20 10:46:02 user nova-compute[74311]: No targets found.
Oct 20 10:46:02 user nova-compute[74311]: STATIC:
Oct 20 10:46:02 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd
Oct 20 10:46:02 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:46:02 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:46:02 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b
Oct 20 10:46:02 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:46:02 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:46:02 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5
Oct 20 10:46:02 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:46:02 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:46:02 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748
Oct 20 10:46:02 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:46:02 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:46:02 user nova-compute[74311]: FIRMWARE:
Oct 20 10:46:02 user nova-compute[74311]: No targets found.
Oct 20 10:46:02 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:46:02 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:46:02 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4a5fc5-f7bf-402b-aafe-70718df4491a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8268d3c4-2642-41eb-a7ea-134529285195]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:46:02 user nova-compute[74311]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)
Oct 20 10:46:02 user nova-compute[74311]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)
Oct 20 10:46:02 user nova-compute[74311]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:46:02 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:46:02 user nova-compute[74311]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 (non-flash)
Oct 20 10:46:02 user nova-compute[74311]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)
Oct 20 10:46:02 user nova-compute[74311]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:46:02 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164e94430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5'): ({'sdc'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Removing single pathed devices sdc {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83f1b27-080c-4165-9b55-c343868e73c0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[067befbf-b5ff-47ee-9c8e-57663b0af113]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Flushing IO for device /dev/sdc {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[83de6d17-4673-424f-a95f-f563d7a9b215]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a432ed11-330b-4c4a-a3f4-205b1652e104]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[75046c5c-d460-49db-b97f-ae8043a4cb21]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b42509-7efa-47eb-a981-9a0ef6b52de6]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5, portal: 172.16.0.220,3260]
Oct 20 10:46:02 user nova-compute[74311]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5, portal: 172.16.0.220,3260] successful.
Oct 20 10:46:02 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69823483-dd50-43df-a345-b117eb9786e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6d3060-4afa-474a-9032-dd24ae322826]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] <== disconnect_volume: return (305ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:46:02 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:46:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:09 user nova-compute[74311]: INFO nova.compute.manager [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Detaching volume ccba51a7-18ca-4489-b4bb-39b60f0d4acd
Oct 20 10:46:10 user nova-compute[74311]: INFO nova.virt.block_device [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Attempting to driver detach volume ccba51a7-18ca-4489-b4bb-39b60f0d4acd from mountpoint /dev/vdb
Oct 20 10:46:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Attempting to detach device vdb from instance da32cd92-f1d7-4f26-9f74-6a1a23a02e60 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:46:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:46:10 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:46:10 user nova-compute[74311]:   <source dev="/dev/sdd"/>
Oct 20 10:46:10 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:46:10 user nova-compute[74311]:   <serial>ccba51a7-18ca-4489-b4bb-39b60f0d4acd</serial>
Oct 20 10:46:10 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:46:10 user nova-compute[74311]: </disk>
Oct 20 10:46:10 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:46:10 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Successfully detached device vdb from instance da32cd92-f1d7-4f26-9f74-6a1a23a02e60 from the persistent domain config.
Oct 20 10:46:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da32cd92-f1d7-4f26-9f74-6a1a23a02e60 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:46:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:46:10 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:46:10 user nova-compute[74311]:   <source dev="/dev/sdd"/>
Oct 20 10:46:10 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:46:10 user nova-compute[74311]:   <serial>ccba51a7-18ca-4489-b4bb-39b60f0d4acd</serial>
Oct 20 10:46:10 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:46:10 user nova-compute[74311]: </disk>
Oct 20 10:46:10 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:46:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:10 user nova-compute[74311]: DEBUG nova.objects.instance [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lazy-loading 'flavor' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:46:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2fd999f6-813f-48a9-a1d2-de36e07d06c4 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.517s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:10 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da32cd92-f1d7-4f26-9f74-6a1a23a02e60 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:46:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:46:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:46:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:46:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:46:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:18 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:46:18 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:46:18 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Skipping network cache update for instance because it is being deleted. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 20 10:46:18 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Didn't find any instances for network info cache update. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 10:46:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:22 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:46:25 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:46:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:46:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:46:29 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:46:30 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance da32cd92-f1d7-4f26-9f74-6a1a23a02e60 is timed out.
Oct 20 10:46:30 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Successfully detached device vdb from instance da32cd92-f1d7-4f26-9f74-6a1a23a02e60 from the live domain config.
Oct 20 10:46:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vawiejon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:46:30 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c50811-b618-48fe-af7e-730481d81da6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:46:30 user nova-compute[74311]: No targets found.
Oct 20 10:46:30 user nova-compute[74311]: iSNS:
Oct 20 10:46:30 user nova-compute[74311]: No targets found.
Oct 20 10:46:30 user nova-compute[74311]: STATIC:
Oct 20 10:46:30 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd
Oct 20 10:46:30 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:46:30 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:46:30 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b
Oct 20 10:46:30 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:46:30 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:46:30 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748
Oct 20 10:46:30 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:46:30 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:46:30 user nova-compute[74311]: FIRMWARE:
Oct 20 10:46:30 user nova-compute[74311]: No targets found.
Oct 20 10:46:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:46:30 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:46:30 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[442b68a6-b0f6-4e2d-b0c2-92fe62c5570d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b969ec73-fad4-4fd8-b970-cf0d5df20b3c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:46:30 user nova-compute[74311]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)
Oct 20 10:46:30 user nova-compute[74311]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:46:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:46:30 user nova-compute[74311]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd (non-flash)
Oct 20 10:46:30 user nova-compute[74311]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:46:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164e949d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd'): ({'sdd'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Removing single pathed devices sdd {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6a38c2-18a8-4f6f-b029-69fda92d6b26]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f307d52-792b-47e1-8286-2b6501047ea6]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Flushing IO for device /dev/sdd {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede2c13b-19ec-4ad6-99b5-9e7dc2889d08]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35dd655-35c4-405a-97fe-dd9c5cb2ddb8]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] SCSI volumes sdd have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3307b0e8-3d5c-4a58-a6a6-3b4308a70b07]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[15360136-4639-4bb5-bcab-3cc7e02ec168]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd, portal: 172.16.0.220,3260]
Oct 20 10:46:30 user nova-compute[74311]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd, portal: 172.16.0.220,3260] successful.
Oct 20 10:46:30 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[24df7951-b202-49e0-bb80-9e528f9c6588]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] <== disconnect_volume: return (296ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:46:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG nova.objects.instance [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lazy-loading 'flavor' on Instance uuid da32cd92-f1d7-4f26-9f74-6a1a23a02e60 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-fa7c1efa-d429-4163-8295-2c7ea4385ac1 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.881s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.749s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:31 user nova-compute[74311]: INFO nova.compute.manager [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Terminating instance
Oct 20 10:46:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-445deedb-9b7f-4e25-95a1-aa636cd1088e req-126e0f1e-5b3d-4790-a944-4a3bfaa708d7 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received event network-vif-unplugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-445deedb-9b7f-4e25-95a1-aa636cd1088e req-126e0f1e-5b3d-4790-a944-4a3bfaa708d7 service nova] Acquiring lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-445deedb-9b7f-4e25-95a1-aa636cd1088e req-126e0f1e-5b3d-4790-a944-4a3bfaa708d7 service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-445deedb-9b7f-4e25-95a1-aa636cd1088e req-126e0f1e-5b3d-4790-a944-4a3bfaa708d7 service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-445deedb-9b7f-4e25-95a1-aa636cd1088e req-126e0f1e-5b3d-4790-a944-4a3bfaa708d7 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] No waiting events found dispatching network-vif-unplugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-445deedb-9b7f-4e25-95a1-aa636cd1088e req-126e0f1e-5b3d-4790-a944-4a3bfaa708d7 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received event network-vif-unplugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Instance destroyed successfully.
Oct 20 10:46:32 user nova-compute[74311]: DEBUG nova.objects.instance [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lazy-loading 'resources' on Instance uuid da32cd92-f1d7-4f26-9f74-6a1a23a02e60 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1250216490',display_name='tempest-VolumesSnapshotTestJSON-instance-1250216490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1250216490',id=48,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzrUmkZaOCJjaKRXYAcv/mcb33i1uoqeC0gduWvYLm1YCng761yJgPlVHvU+QtCWsCD6XGkX3bP3hSXpbo9IpJxqLr9iLZebzOAooql/sGTrxSbGSGvirKKrtH45e/sQw==',key_name='tempest-keypair-1532010150',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:43:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e14e8b4071d4f0591e65fededd0f2fd',ramdisk_id='',reservation_id='r-r8ugzbay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1070048329',owner_user_name='tempest-VolumesSnapshotTestJSON-1070048329-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:43:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4dda3552abdb4cee967ce9cac71580ba',uuid=da32cd92-f1d7-4f26-9f74-6a1a23a02e60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "address": "fa:16:3e:8d:1d:e4", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5241d8-bb", "ovs_interfaceid": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Converting VIF {"id": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "address": "fa:16:3e:8d:1d:e4", "network": {"id": "3f659357-90d1-42cc-99de-5959812bf2fb", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1502227910-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e14e8b4071d4f0591e65fededd0f2fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa5241d8-bb", "ovs_interfaceid": "aa5241d8-bb82-4c93-9bfd-116406ee4dd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:1d:e4,bridge_name='br-int',has_traffic_filtering=True,id=aa5241d8-bb82-4c93-9bfd-116406ee4dd9,network=Network(3f659357-90d1-42cc-99de-5959812bf2fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5241d8-bb') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG os_vif [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:1d:e4,bridge_name='br-int',has_traffic_filtering=True,id=aa5241d8-bb82-4c93-9bfd-116406ee4dd9,network=Network(3f659357-90d1-42cc-99de-5959812bf2fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5241d8-bb') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa5241d8-bb, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c928d79b-f24a-4349-9a5f-76539d5c4ae6) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:32 user nova-compute[74311]: INFO os_vif [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:1d:e4,bridge_name='br-int',has_traffic_filtering=True,id=aa5241d8-bb82-4c93-9bfd-116406ee4dd9,network=Network(3f659357-90d1-42cc-99de-5959812bf2fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa5241d8-bb')
Oct 20 10:46:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vawiejon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:46:32 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:46:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[879c35bd-7264-4bb7-b4ba-2128b600ba77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:46:32 user nova-compute[74311]: No targets found.
Oct 20 10:46:32 user nova-compute[74311]: iSNS:
Oct 20 10:46:32 user nova-compute[74311]: No targets found.
Oct 20 10:46:32 user nova-compute[74311]: STATIC:
Oct 20 10:46:32 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b
Oct 20 10:46:32 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:46:32 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:46:32 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748
Oct 20 10:46:32 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:46:32 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:46:32 user nova-compute[74311]: FIRMWARE:
Oct 20 10:46:32 user nova-compute[74311]: No targets found.
Oct 20 10:46:32 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:46:32 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:46:32 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccba51a7-18ca-4489-b4bb-39b60f0d4acd', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67ab5b6-0a37-4204-af35-967790ca6fbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfd9b65-3bff-4bc9-b14f-479f9f6e8046]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:46:32 user nova-compute[74311]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:46:32 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:46:32 user nova-compute[74311]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:46:32 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1887a3ac0>, {}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Disconnecting from: [] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] <== disconnect_volume: return (86ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:46:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Deleting instance files /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60_del
Oct 20 10:46:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Deletion of /opt/stack/data/nova/instances/da32cd92-f1d7-4f26-9f74-6a1a23a02e60_del complete
Oct 20 10:46:32 user nova-compute[74311]: INFO nova.compute.manager [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 20 10:46:32 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:46:32 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:46:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received event network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] Acquiring lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] No waiting events found dispatching network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:46:34 user nova-compute[74311]: WARNING nova.compute.manager [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received unexpected event network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 for instance with vm_state active and task_state deleting.
Oct 20 10:46:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received event network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] Acquiring lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] No waiting events found dispatching network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:46:34 user nova-compute[74311]: WARNING nova.compute.manager [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received unexpected event network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 for instance with vm_state active and task_state deleting.
Oct 20 10:46:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received event network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] Acquiring lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] No waiting events found dispatching network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:46:34 user nova-compute[74311]: WARNING nova.compute.manager [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received unexpected event network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 for instance with vm_state active and task_state deleting.
Oct 20 10:46:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received event network-vif-unplugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] Acquiring lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] No waiting events found dispatching network-vif-unplugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-8ac52b34-ed65-4e49-b553-2c1a63016f74 req-02fd36b9-a855-4763-89e7-fd16fcbed520 service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received event network-vif-unplugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:46:34 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Took 1.39 seconds to deallocate network for instance.
Oct 20 10:46:34 user nova-compute[74311]: WARNING nova.volume.cinder [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Attachment bad0642b-6058-457d-b0d8-c0a191407492 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = bad0642b-6058-457d-b0d8-c0a191407492. (HTTP 404) (Request-ID: req-9bade247-0b1f-42cc-b52e-95ef60a01e90)
Oct 20 10:46:34 user nova-compute[74311]: INFO nova.compute.manager [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Took 0.03 seconds to detach 1 volumes for instance.
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:34 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Deleted allocations for instance da32cd92-f1d7-4f26-9f74-6a1a23a02e60
Oct 20 10:46:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-85128b1d-724f-4cef-bf36-007365ad5553 tempest-VolumesSnapshotTestJSON-1070048329 tempest-VolumesSnapshotTestJSON-1070048329-project-member] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.866s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG nova.compute.manager [req-0c45603a-77af-4e33-9e49-21d363c1f261 req-ee8d7e88-75f1-499a-867b-3609f5194edc service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received event network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0c45603a-77af-4e33-9e49-21d363c1f261 req-ee8d7e88-75f1-499a-867b-3609f5194edc service nova] Acquiring lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0c45603a-77af-4e33-9e49-21d363c1f261 req-ee8d7e88-75f1-499a-867b-3609f5194edc service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0c45603a-77af-4e33-9e49-21d363c1f261 req-ee8d7e88-75f1-499a-867b-3609f5194edc service nova] Lock "da32cd92-f1d7-4f26-9f74-6a1a23a02e60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG nova.compute.manager [req-0c45603a-77af-4e33-9e49-21d363c1f261 req-ee8d7e88-75f1-499a-867b-3609f5194edc service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] No waiting events found dispatching network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:46:36 user nova-compute[74311]: WARNING nova.compute.manager [req-0c45603a-77af-4e33-9e49-21d363c1f261 req-ee8d7e88-75f1-499a-867b-3609f5194edc service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received unexpected event network-vif-plugged-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 for instance with vm_state deleted and task_state None.
Oct 20 10:46:36 user nova-compute[74311]: DEBUG nova.compute.manager [req-0c45603a-77af-4e33-9e49-21d363c1f261 req-ee8d7e88-75f1-499a-867b-3609f5194edc service nova] [instance: da32cd92-f1d7-4f26-9f74-6a1a23a02e60] Received event network-vif-deleted-aa5241d8-bb82-4c93-9bfd-116406ee4dd9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:46:36 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:46:36 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:46:36 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8518MB free_disk=25.079696655273438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 785fdcb1-5995-485c-a931-3a2537700785 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance bb318c53-c058-439c-86f5-35847ac9c90e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance bd1f0ae9-d07b-45db-94f2-81baf48010bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:46:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG nova.objects.instance [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lazy-loading 'flavor' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:37 user nova-compute[74311]: INFO nova.compute.manager [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Attaching volume 68d39100-35cd-40fd-8a1b-a4342f8c95f5 to /dev/vdb
Oct 20 10:46:37 user nova-compute[74311]: DEBUG os_brick.utils [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5900144-5101-4112-8a6c-62213cd126aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fb5ea5-dff5-4732-80ac-f19412d3c46b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1a3c35-2a30-4305-b8e1-daff35fe2a59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e83f18a-e126-43a5-8d12-b4a63203f861]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:46:37 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae8e16d-c3c1-4026-a25d-ed11d388cb2f]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG os_brick.utils [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updating existing volume attachment record: a0737c5b-bd5c-4d36-8d2a-89956497a136 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:37 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:46:38 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:46:38 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:46:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-ef026431-06e8-4956-a5ab-15f0f467394a req-4f50098e-02e5-4345-8b5f-c11bfc8bc516 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-changed-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:46:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-ef026431-06e8-4956-a5ab-15f0f467394a req-4f50098e-02e5-4345-8b5f-c11bfc8bc516 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Refreshing instance network info cache due to event network-changed-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:46:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ef026431-06e8-4956-a5ab-15f0f467394a req-4f50098e-02e5-4345-8b5f-c11bfc8bc516 service nova] Acquiring lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:46:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ef026431-06e8-4956-a5ab-15f0f467394a req-4f50098e-02e5-4345-8b5f-c11bfc8bc516 service nova] Acquired lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:46:45 user nova-compute[74311]: DEBUG nova.network.neutron [req-ef026431-06e8-4956-a5ab-15f0f467394a req-4f50098e-02e5-4345-8b5f-c11bfc8bc516 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Refreshing network info cache for port 7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:46:45 user nova-compute[74311]: DEBUG nova.network.neutron [req-ef026431-06e8-4956-a5ab-15f0f467394a req-4f50098e-02e5-4345-8b5f-c11bfc8bc516 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updated VIF entry in instance network info cache for port 7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:46:45 user nova-compute[74311]: DEBUG nova.network.neutron [req-ef026431-06e8-4956-a5ab-15f0f467394a req-4f50098e-02e5-4345-8b5f-c11bfc8bc516 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updating instance_info_cache with network_info: [{"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:46:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ef026431-06e8-4956-a5ab-15f0f467394a req-4f50098e-02e5-4345-8b5f-c11bfc8bc516 service nova] Releasing lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:46:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "785fdcb1-5995-485c-a931-3a2537700785" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:46 user nova-compute[74311]: INFO nova.compute.manager [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Detaching volume 4db5caad-99d2-4f77-960a-3d318c290748
Oct 20 10:46:46 user nova-compute[74311]: INFO nova.virt.block_device [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Attempting to driver detach volume 4db5caad-99d2-4f77-960a-3d318c290748 from mountpoint /dev/vdb
Oct 20 10:46:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Attempting to detach device vdb from instance 785fdcb1-5995-485c-a931-3a2537700785 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:46:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:46:46 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:46:46 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:46:46 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:46:46 user nova-compute[74311]:   <serial>4db5caad-99d2-4f77-960a-3d318c290748</serial>
Oct 20 10:46:46 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 10:46:46 user nova-compute[74311]: </disk>
Oct 20 10:46:46 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:46:46 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Successfully detached device vdb from instance 785fdcb1-5995-485c-a931-3a2537700785 from the persistent domain config.
Oct 20 10:46:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 785fdcb1-5995-485c-a931-3a2537700785 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:46:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:46:46 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:46:46 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:46:46 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:46:46 user nova-compute[74311]:   <serial>4db5caad-99d2-4f77-960a-3d318c290748</serial>
Oct 20 10:46:46 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 10:46:46 user nova-compute[74311]: </disk>
Oct 20 10:46:46 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:46:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 785fdcb1-5995-485c-a931-3a2537700785 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:46:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-f5728870-d6dd-4270-b989-9e15f4dba86d req-ec85c3ef-936e-425d-b8c6-1b4e1f1b77e9 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-changed-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:46:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-f5728870-d6dd-4270-b989-9e15f4dba86d req-ec85c3ef-936e-425d-b8c6-1b4e1f1b77e9 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Refreshing instance network info cache due to event network-changed-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:46:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f5728870-d6dd-4270-b989-9e15f4dba86d req-ec85c3ef-936e-425d-b8c6-1b4e1f1b77e9 service nova] Acquiring lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:46:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f5728870-d6dd-4270-b989-9e15f4dba86d req-ec85c3ef-936e-425d-b8c6-1b4e1f1b77e9 service nova] Acquired lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:46:47 user nova-compute[74311]: DEBUG nova.network.neutron [req-f5728870-d6dd-4270-b989-9e15f4dba86d req-ec85c3ef-936e-425d-b8c6-1b4e1f1b77e9 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Refreshing network info cache for port 7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:46:47 user nova-compute[74311]: DEBUG nova.network.neutron [req-f5728870-d6dd-4270-b989-9e15f4dba86d req-ec85c3ef-936e-425d-b8c6-1b4e1f1b77e9 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updated VIF entry in instance network info cache for port 7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:46:47 user nova-compute[74311]: DEBUG nova.network.neutron [req-f5728870-d6dd-4270-b989-9e15f4dba86d req-ec85c3ef-936e-425d-b8c6-1b4e1f1b77e9 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updating instance_info_cache with network_info: [{"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:46:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f5728870-d6dd-4270-b989-9e15f4dba86d req-ec85c3ef-936e-425d-b8c6-1b4e1f1b77e9 service nova] Releasing lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:46:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDXZhsqm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:46:54 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:46:54 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:46:54 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff214ea8-c2a4-498a-b8bb-ec8d94296fdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:46:54 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a9abb7-f9b4-4dfd-b788-f118deff5d8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5] added
Oct 20 10:46:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[390dc014-f31e-4968-9316-facc762e8573]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d829ca4-478e-4674-964a-82aa0cc80975]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDXZhsqm {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDXZhsqm" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[429c3bef-4fa4-47bd-967b-39da0b4ce990]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QDXZhsqm'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc9625a-b9c5-4d27-97b8-a7b2a44ffdb3]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dbc6b3-2ff6-494d-846e-7886e1960b06]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:46:54 user nova-compute[74311]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:46:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:46:54 user nova-compute[74311]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:46:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[680e7a01-6808-4f66-803c-46ec8adbb548]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5, portal: 172.16.0.220,3260]
Oct 20 10:46:54 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5, portal: 172.16.0.220,3260] successful.
Oct 20 10:46:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ce9648-fd67-4a5b-8f7c-8b60bfaba8e9]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca18eee-3623-4149-9683-73f4aeb5d65d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:46:54 user nova-compute[74311]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:46:54 user nova-compute[74311]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 (non-flash)
Oct 20 10:46:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:46:54 user nova-compute[74311]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:46:54 user nova-compute[74311]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 (non-flash)
Oct 20 10:46:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[95087c1e-b6ce-4a9a-be49-b632b7dac5cc]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:46:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDXZhsqm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:46:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:46:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26238666464353162', 'path': '/dev/sdc'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:46:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238666464353162', 'path': '/dev/sdc'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:46:55 user nova-compute[74311]: DEBUG nova.objects.instance [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lazy-loading 'flavor' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:46:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:46:55 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:46:55 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:46:55 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:46:55 user nova-compute[74311]:   <serial>68d39100-35cd-40fd-8a1b-a4342f8c95f5</serial>
Oct 20 10:46:55 user nova-compute[74311]: </disk>
Oct 20 10:46:55 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:46:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:46:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:46:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] No VIF found with MAC fa:16:3e:56:4a:4d, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:46:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5828d979-b143-40dd-b69e-190a22ca98dc tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.768s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:46:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:46:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:46:57 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:46:57 user nova-compute[74311]: INFO nova.compute.manager [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Detaching volume 68d39100-35cd-40fd-8a1b-a4342f8c95f5
Oct 20 10:46:58 user nova-compute[74311]: INFO nova.virt.block_device [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Attempting to driver detach volume 68d39100-35cd-40fd-8a1b-a4342f8c95f5 from mountpoint /dev/vdb
Oct 20 10:46:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Attempting to detach device vdb from instance bb318c53-c058-439c-86f5-35847ac9c90e from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:46:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:46:58 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:46:58 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:46:58 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:46:58 user nova-compute[74311]:   <serial>68d39100-35cd-40fd-8a1b-a4342f8c95f5</serial>
Oct 20 10:46:58 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:46:58 user nova-compute[74311]: </disk>
Oct 20 10:46:58 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:46:58 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Successfully detached device vdb from instance bb318c53-c058-439c-86f5-35847ac9c90e from the persistent domain config.
Oct 20 10:46:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb318c53-c058-439c-86f5-35847ac9c90e from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:46:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:46:58 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:46:58 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:46:58 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:46:58 user nova-compute[74311]:   <serial>68d39100-35cd-40fd-8a1b-a4342f8c95f5</serial>
Oct 20 10:46:58 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:46:58 user nova-compute[74311]: </disk>
Oct 20 10:46:58 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:46:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:46:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:03 user nova-compute[74311]: DEBUG nova.compute.manager [req-48b61f12-5dbd-4459-9409-57e62562548f req-853eaab4-37a1-4055-8cf0-b9d8d218480b service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Received event network-changed-f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:47:03 user nova-compute[74311]: DEBUG nova.compute.manager [req-48b61f12-5dbd-4459-9409-57e62562548f req-853eaab4-37a1-4055-8cf0-b9d8d218480b service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Refreshing instance network info cache due to event network-changed-f04b4733-87a4-4ecf-961f-0d5232d7c480. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:47:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-48b61f12-5dbd-4459-9409-57e62562548f req-853eaab4-37a1-4055-8cf0-b9d8d218480b service nova] Acquiring lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:47:03 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-48b61f12-5dbd-4459-9409-57e62562548f req-853eaab4-37a1-4055-8cf0-b9d8d218480b service nova] Acquired lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:47:03 user nova-compute[74311]: DEBUG nova.network.neutron [req-48b61f12-5dbd-4459-9409-57e62562548f req-853eaab4-37a1-4055-8cf0-b9d8d218480b service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Refreshing network info cache for port f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:47:03 user nova-compute[74311]: DEBUG nova.network.neutron [req-48b61f12-5dbd-4459-9409-57e62562548f req-853eaab4-37a1-4055-8cf0-b9d8d218480b service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Updated VIF entry in instance network info cache for port f04b4733-87a4-4ecf-961f-0d5232d7c480. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:47:04 user nova-compute[74311]: DEBUG nova.network.neutron [req-48b61f12-5dbd-4459-9409-57e62562548f req-853eaab4-37a1-4055-8cf0-b9d8d218480b service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Updating instance_info_cache with network_info: [{"id": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "address": "fa:16:3e:0e:34:85", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04b4733-87", "ovs_interfaceid": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:47:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-48b61f12-5dbd-4459-9409-57e62562548f req-853eaab4-37a1-4055-8cf0-b9d8d218480b service nova] Releasing lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:47:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:06 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 785fdcb1-5995-485c-a931-3a2537700785 is timed out.
Oct 20 10:47:06 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Successfully detached device vdb from instance 785fdcb1-5995-485c-a931-3a2537700785 from the live domain config.
Oct 20 10:47:06 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mcRblCMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:47:06 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:47:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c5464c-9885-435b-841f-c222e91e179d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:47:06 user nova-compute[74311]: No targets found.
Oct 20 10:47:06 user nova-compute[74311]: iSNS:
Oct 20 10:47:06 user nova-compute[74311]: No targets found.
Oct 20 10:47:06 user nova-compute[74311]: STATIC:
Oct 20 10:47:06 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b
Oct 20 10:47:06 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:47:06 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:47:06 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5
Oct 20 10:47:06 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:47:06 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:47:06 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748
Oct 20 10:47:06 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:47:06 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:47:06 user nova-compute[74311]: FIRMWARE:
Oct 20 10:47:06 user nova-compute[74311]: No targets found.
Oct 20 10:47:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:47:06 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:47:06 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae1020b-8feb-40a5-abb9-4d946f1fbe70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c230d6a5-fe82-47ca-bc8e-6ef773e67490]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:47:06 user nova-compute[74311]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:47:06 user nova-compute[74311]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 (non-flash)
Oct 20 10:47:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 (non-flash)
Oct 20 10:47:06 user nova-compute[74311]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:47:06 user nova-compute[74311]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 (non-flash)
Oct 20 10:47:06 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1b50dbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5d1d0d-b983-41e0-bf6e-acf5ad8a86c5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b276abb-e63f-4fc9-8ae3-4d2ad8b5a60a]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dd3b53-0cd7-441e-b885-ae382e8dfc29]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:47:06 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[54251088-b5d5-4b76-a987-db1c7e9ade8f]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[885473fa-e89f-4368-b721-ef60aa16e277]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[179c025b-87ba-4644-af4d-f5ca17449f9b]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260]
Oct 20 10:47:07 user nova-compute[74311]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748, portal: 172.16.0.220,3260] successful.
Oct 20 10:47:07 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4db5caad-99d2-4f77-960a-3d318c290748 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b529d8b-3385-4ddd-ba02-d36e2cbea12a]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] <== disconnect_volume: return (339ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:47:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:08 user nova-compute[74311]: DEBUG nova.objects.instance [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'flavor' on Instance uuid 785fdcb1-5995-485c-a931-3a2537700785 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:47:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9a6e6a3e-8de6-4bff-8fb8-859d7883b7cf tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "785fdcb1-5995-485c-a931-3a2537700785" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.811s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:47:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:18 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bb318c53-c058-439c-86f5-35847ac9c90e is timed out.
Oct 20 10:47:18 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Successfully detached device vdb from instance bb318c53-c058-439c-86f5-35847ac9c90e from the live domain config.
Oct 20 10:47:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDXZhsqm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:47:18 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fd5e52-797a-45b9-864f-ab496af2191f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:47:18 user nova-compute[74311]: No targets found.
Oct 20 10:47:18 user nova-compute[74311]: iSNS:
Oct 20 10:47:18 user nova-compute[74311]: No targets found.
Oct 20 10:47:18 user nova-compute[74311]: STATIC:
Oct 20 10:47:18 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b
Oct 20 10:47:18 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:47:18 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:47:18 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5
Oct 20 10:47:18 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:47:18 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:47:18 user nova-compute[74311]: FIRMWARE:
Oct 20 10:47:18 user nova-compute[74311]: No targets found.
Oct 20 10:47:18 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:47:18 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:47:18 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb89e54-c0f8-4a26-b3c8-65b62560c2f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5553a2-8c3a-457f-a7b7-48426939a8af]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:47:18 user nova-compute[74311]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 (non-flash)
Oct 20 10:47:18 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:47:18 user nova-compute[74311]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 (non-flash)
Oct 20 10:47:18 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1a827c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5'): ({'sdc'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Removing single pathed devices sdc {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[165b102f-b0ee-49b7-9f8d-874d2ca6da67]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e6e17f-24ca-4d46-9643-895142a17b59]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Flushing IO for device /dev/sdc {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a89925-e201-4f53-90f3-e13c291e7529]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f890546e-9557-44e1-9946-850c3d6b0d13]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[782e4060-2991-4918-85a5-08dddf292482]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8ec7b5-8668-4120-bae5-2c487857fdd6]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5, portal: 172.16.0.220,3260]
Oct 20 10:47:18 user nova-compute[74311]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5, portal: 172.16.0.220,3260] successful.
Oct 20 10:47:18 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68d39100-35cd-40fd-8a1b-a4342f8c95f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3173f7e-1132-4781-808b-2c1f9a8e2e7d]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] <== disconnect_volume: return (303ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:47:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:47:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:19 user nova-compute[74311]: DEBUG nova.objects.instance [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lazy-loading 'flavor' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:47:19 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-baaa6b55-af3e-4304-a1c6-172e668bc322 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.703s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:47:20 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:47:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:47:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:47:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:47:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:47:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:47:20 user nova-compute[74311]: DEBUG nova.objects.instance [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lazy-loading 'info_cache' on Instance uuid 785fdcb1-5995-485c-a931-3a2537700785 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:47:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updating instance_info_cache with network_info: [{"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:47:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-785fdcb1-5995-485c-a931-3a2537700785" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:47:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:47:22 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:47:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:25 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:47:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:47:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:47:31 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:47:31 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:47:32 user nova-compute[74311]: INFO nova.compute.claims [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Claim successful on node user
Oct 20 10:47:32 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG nova.network.neutron [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:47:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:47:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:47:32 user nova-compute[74311]: INFO nova.virt.block_device [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Booting with volume 7175b37a-77d6-4d6e-83f1-e0e3020108a2 at /dev/vda
Oct 20 10:47:32 user nova-compute[74311]: DEBUG nova.policy [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9634a3daf064bf2aad6ea38454f7639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7a52d2fa8243fabc22baa8694e14d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG os_brick.utils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[55578306-6aef-4350-9526-82d6604a3482]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac67703-6972-4fd2-9ded-7683089e2b0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f235e0-7091-4630-9247-4a06948c36e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb2c9c6-61d4-4a98-9af8-2cd086a81894]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:47:32 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:47:32 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b4178f-11a3-41df-80ae-294b1c937d8f]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG os_brick.utils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:47:32 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Updating existing volume attachment record: 2f96c683-b175-47fa-8b3b-87612e015488 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:47:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:33 user nova-compute[74311]: DEBUG nova.network.neutron [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Successfully created port: dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG nova.network.neutron [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Successfully updated port: dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "refresh_cache-8235aafb-daf7-4e14-a4ba-8f7e34e4da49" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquired lock "refresh_cache-8235aafb-daf7-4e14-a4ba-8f7e34e4da49" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG nova.network.neutron [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-f84f2aa7-bb81-4f94-bc82-467476a9d321 req-5e8d471b-de85-49d6-b1ad-6504da4ef45e service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Received event network-changed-dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-f84f2aa7-bb81-4f94-bc82-467476a9d321 req-5e8d471b-de85-49d6-b1ad-6504da4ef45e service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Refreshing instance network info cache due to event network-changed-dda433e2-4923-456b-ac8d-71a405b7ef02. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f84f2aa7-bb81-4f94-bc82-467476a9d321 req-5e8d471b-de85-49d6-b1ad-6504da4ef45e service nova] Acquiring lock "refresh_cache-8235aafb-daf7-4e14-a4ba-8f7e34e4da49" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG nova.network.neutron [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG nova.network.neutron [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Updating instance_info_cache with network_info: [{"id": "dda433e2-4923-456b-ac8d-71a405b7ef02", "address": "fa:16:3e:10:d2:56", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda433e2-49", "ovs_interfaceid": "dda433e2-4923-456b-ac8d-71a405b7ef02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Releasing lock "refresh_cache-8235aafb-daf7-4e14-a4ba-8f7e34e4da49" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG nova.compute.manager [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Instance network_info: |[{"id": "dda433e2-4923-456b-ac8d-71a405b7ef02", "address": "fa:16:3e:10:d2:56", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda433e2-49", "ovs_interfaceid": "dda433e2-4923-456b-ac8d-71a405b7ef02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f84f2aa7-bb81-4f94-bc82-467476a9d321 req-5e8d471b-de85-49d6-b1ad-6504da4ef45e service nova] Acquired lock "refresh_cache-8235aafb-daf7-4e14-a4ba-8f7e34e4da49" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG nova.network.neutron [req-f84f2aa7-bb81-4f94-bc82-467476a9d321 req-5e8d471b-de85-49d6-b1ad-6504da4ef45e service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Refreshing network info cache for port dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG nova.network.neutron [req-f84f2aa7-bb81-4f94-bc82-467476a9d321 req-5e8d471b-de85-49d6-b1ad-6504da4ef45e service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Updated VIF entry in instance network info cache for port dda433e2-4923-456b-ac8d-71a405b7ef02. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG nova.network.neutron [req-f84f2aa7-bb81-4f94-bc82-467476a9d321 req-5e8d471b-de85-49d6-b1ad-6504da4ef45e service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Updating instance_info_cache with network_info: [{"id": "dda433e2-4923-456b-ac8d-71a405b7ef02", "address": "fa:16:3e:10:d2:56", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda433e2-49", "ovs_interfaceid": "dda433e2-4923-456b-ac8d-71a405b7ef02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:47:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f84f2aa7-bb81-4f94-bc82-467476a9d321 req-5e8d471b-de85-49d6-b1ad-6504da4ef45e service nova] Releasing lock "refresh_cache-8235aafb-daf7-4e14-a4ba-8f7e34e4da49" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:47:36 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:47:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:47:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:47:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:47:36 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:47:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:47:37 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:47:37 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:47:37 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=25.077198028564453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:47:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:47:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:47:37 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 785fdcb1-5995-485c-a931-3a2537700785 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:47:37 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance bb318c53-c058-439c-86f5-35847ac9c90e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:47:37 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance bd1f0ae9-d07b-45db-94f2-81baf48010bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:47:37 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 8235aafb-daf7-4e14-a4ba-8f7e34e4da49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:47:37 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:47:37 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:47:37 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:47:37 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:47:37 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:47:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:47:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:39 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:47:39 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:47:39 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:47:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "785fdcb1-5995-485c-a931-3a2537700785" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:47:46 user nova-compute[74311]: INFO nova.compute.manager [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Terminating instance
Oct 20 10:47:46 user nova-compute[74311]: DEBUG nova.compute.manager [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-9bc5b5db-a580-49fd-91fd-6d7d63c9806b req-b96d4e5b-be94-4c70-8af7-d5a89691e153 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-vif-unplugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9bc5b5db-a580-49fd-91fd-6d7d63c9806b req-b96d4e5b-be94-4c70-8af7-d5a89691e153 service nova] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9bc5b5db-a580-49fd-91fd-6d7d63c9806b req-b96d4e5b-be94-4c70-8af7-d5a89691e153 service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9bc5b5db-a580-49fd-91fd-6d7d63c9806b req-b96d4e5b-be94-4c70-8af7-d5a89691e153 service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-9bc5b5db-a580-49fd-91fd-6d7d63c9806b req-b96d4e5b-be94-4c70-8af7-d5a89691e153 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] No waiting events found dispatching network-vif-unplugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:47:46 user nova-compute[74311]: DEBUG nova.compute.manager [req-9bc5b5db-a580-49fd-91fd-6d7d63c9806b req-b96d4e5b-be94-4c70-8af7-d5a89691e153 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-vif-unplugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:47 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Instance destroyed successfully.
Oct 20 10:47:47 user nova-compute[74311]: DEBUG nova.objects.instance [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'resources' on Instance uuid 785fdcb1-5995-485c-a931-3a2537700785 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1156781070',display_name='tempest-TestMinimumBasicScenario-server-1156781070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1156781070',id=45,image_ref='706b4482-9d7a-46aa-99c8-d2406826b5cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIj/D+1WyPOap3Jo+vC1Q5hCcw2yS28HXSOkgxqKTeUc8i0RUKyxTssv6yVsUkIvEWvb+Zgt5GLVTyuUKFt32znAPpJwn0pqltkVaRupLZFTExIPcZcBWT14VOcMt4epMQ==',key_name='tempest-TestMinimumBasicScenario-43511418',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:42:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b78bfc1cd59d4be3b98ddad43a8d3002',ramdisk_id='',reservation_id='r-uwxccota',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='706b4482-9d7a-46aa-99c8-d2406826b5cd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1072164048',owner_user_name='tempest-TestMinimumBasicScenario-1072164048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:45:01Z,user_data=None,user_id='24c8f83400ef489e88a4f719e301b284',uuid=785fdcb1-5995-485c-a931-3a2537700785,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converting VIF {"id": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "address": "fa:16:3e:d2:32:c1", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7dadfb0d-8e", "ovs_interfaceid": "7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:32:c1,bridge_name='br-int',has_traffic_filtering=True,id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dadfb0d-8e') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG os_vif [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:32:c1,bridge_name='br-int',has_traffic_filtering=True,id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dadfb0d-8e') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7dadfb0d-8e, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3838d48b-aa39-4ad5-8139-69bf41c9b08b) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:47:47 user nova-compute[74311]: INFO os_vif [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:32:c1,bridge_name='br-int',has_traffic_filtering=True,id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7dadfb0d-8e')
Oct 20 10:47:47 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Deleting instance files /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785_del
Oct 20 10:47:47 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Deletion of /opt/stack/data/nova/instances/785fdcb1-5995-485c-a931-3a2537700785_del complete
Oct 20 10:47:47 user nova-compute[74311]: INFO nova.compute.manager [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 20 10:47:47 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 785fdcb1-5995-485c-a931-3a2537700785] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:47:47 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Took 0.42 seconds to deallocate network for instance.
Oct 20 10:47:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-9e4781b0-254d-48b3-bee3-7835cb2f1c33 req-cbe4d54b-75a4-49f2-b92c-c70f5f219fba service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-vif-deleted-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:47:47 user nova-compute[74311]: INFO nova.compute.manager [req-9e4781b0-254d-48b3-bee3-7835cb2f1c33 req-cbe4d54b-75a4-49f2-b92c-c70f5f219fba service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Neutron deleted interface 7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9; detaching it from the instance and deleting it from the info cache
Oct 20 10:47:47 user nova-compute[74311]: DEBUG nova.network.neutron [req-9e4781b0-254d-48b3-bee3-7835cb2f1c33 req-cbe4d54b-75a4-49f2-b92c-c70f5f219fba service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-9e4781b0-254d-48b3-bee3-7835cb2f1c33 req-cbe4d54b-75a4-49f2-b92c-c70f5f219fba service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Detach interface failed, port_id=7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9, reason: Instance 785fdcb1-5995-485c-a931-3a2537700785 could not be found. {{(pid=74311) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:47:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:47:47 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Deleted allocations for instance 785fdcb1-5995-485c-a931-3a2537700785
Oct 20 10:47:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-3a2731c6-ce3e-4771-8b58-eb96d35ebb92 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "785fdcb1-5995-485c-a931-3a2537700785" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.645s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:47:48 user nova-compute[74311]: DEBUG nova.compute.manager [req-3724432b-e5a6-4b05-bf4f-c1c1ddb01b82 req-9b9b05bb-b8c9-490b-9add-bf35c9f25528 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received event network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:47:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3724432b-e5a6-4b05-bf4f-c1c1ddb01b82 req-9b9b05bb-b8c9-490b-9add-bf35c9f25528 service nova] Acquiring lock "785fdcb1-5995-485c-a931-3a2537700785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:47:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3724432b-e5a6-4b05-bf4f-c1c1ddb01b82 req-9b9b05bb-b8c9-490b-9add-bf35c9f25528 service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:47:48 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3724432b-e5a6-4b05-bf4f-c1c1ddb01b82 req-9b9b05bb-b8c9-490b-9add-bf35c9f25528 service nova] Lock "785fdcb1-5995-485c-a931-3a2537700785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:47:48 user nova-compute[74311]: DEBUG nova.compute.manager [req-3724432b-e5a6-4b05-bf4f-c1c1ddb01b82 req-9b9b05bb-b8c9-490b-9add-bf35c9f25528 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] No waiting events found dispatching network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:47:48 user nova-compute[74311]: WARNING nova.compute.manager [req-3724432b-e5a6-4b05-bf4f-c1c1ddb01b82 req-9b9b05bb-b8c9-490b-9add-bf35c9f25528 service nova] [instance: 785fdcb1-5995-485c-a931-3a2537700785] Received unexpected event network-vif-plugged-7dadfb0d-8e61-44c2-a1c9-f25c750ef9f9 for instance with vm_state deleted and task_state None.
Oct 20 10:47:52 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Verify base images {{(pid=74311) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74311) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Image id 4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa yields fingerprint a7b7375650f64ac9e015788cc2a40cca40856223 {{(pid=74311) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 10:47:52 user nova-compute[74311]: INFO nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] image 4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa at (/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223): checking
Oct 20 10:47:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] image 4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa at (/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223): image is in use {{(pid=74311) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] bb318c53-c058-439c-86f5-35847ac9c90e is a valid instance name {{(pid=74311) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] bb318c53-c058-439c-86f5-35847ac9c90e has a disk file {{(pid=74311) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance bb318c53-c058-439c-86f5-35847ac9c90e is backed by a7b7375650f64ac9e015788cc2a40cca40856223 {{(pid=74311) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] bd1f0ae9-d07b-45db-94f2-81baf48010bf is a valid instance name {{(pid=74311) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 10:47:52 user nova-compute[74311]: WARNING nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec
Oct 20 10:47:52 user nova-compute[74311]: WARNING nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3
Oct 20 10:47:52 user nova-compute[74311]: WARNING nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Unknown base file: /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a
Oct 20 10:47:52 user nova-compute[74311]: WARNING nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca
Oct 20 10:47:52 user nova-compute[74311]: WARNING nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2
Oct 20 10:47:52 user nova-compute[74311]: WARNING nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19
Oct 20 10:47:52 user nova-compute[74311]: WARNING nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427
Oct 20 10:47:52 user nova-compute[74311]: INFO nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Active base files: /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223
Oct 20 10:47:52 user nova-compute[74311]: INFO nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Removable base files: /opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec /opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3 /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca /opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2 /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19 /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427
Oct 20 10:47:52 user nova-compute[74311]: INFO nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9a936f8f01e4f7f995cc91890cfa0e2f9b3893ec
Oct 20 10:47:52 user nova-compute[74311]: INFO nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5642d7050e9009ba2c59697cf5eafe85833c92f3
Oct 20 10:47:52 user nova-compute[74311]: INFO nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/06848d39871d8b1145d2899fba6f32185867605a
Oct 20 10:47:52 user nova-compute[74311]: INFO nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7b0a35bcc40d426ebbd72433b8afc05bab52e3ca
Oct 20 10:47:52 user nova-compute[74311]: INFO nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e809d771ebaad94f1216ea87d0e582564aa3def2
Oct 20 10:47:52 user nova-compute[74311]: INFO nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0b8b5d735e983b7b9dc305a975928e1319543f19
Oct 20 10:47:52 user nova-compute[74311]: INFO nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1dd8a5351d36f0b71969628a045ad413e2085427
Oct 20 10:47:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Verification complete {{(pid=74311) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Verify swap images {{(pid=74311) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 20 10:47:52 user nova-compute[74311]: DEBUG nova.virt.libvirt.imagecache [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Verify ephemeral images {{(pid=74311) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG nova.objects.instance [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lazy-loading 'flavor' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:47:53 user nova-compute[74311]: INFO nova.compute.manager [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Attaching volume 2173c8fe-c5e2-4397-b9d0-792f223010b1 to /dev/vdb
Oct 20 10:47:53 user nova-compute[74311]: DEBUG os_brick.utils [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cd7d87-5363-4789-80b4-e21b88c7890e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[435006ed-470e-47a0-a0a6-0064993fe981]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7c4652-94f9-45fa-b84b-1ee189543810]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb209e7f-1f7f-4cb6-bca8-3907840cb3ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:47:53 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:47:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dc89ba-5e72-4f42-b609-b3b8b96449be]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG os_brick.utils [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:47:53 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updating existing volume attachment record: 42dd3800-b260-4252-9224-d3c74f6564d8 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:47:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:47:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VscDwyUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:48:09 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:48:09 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:48:09 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:48:09 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:48:09 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:48:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ffe752-05b7-4085-9845-5849ccd37eef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:48:09 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e34a3d9-c069-4a5c-8ad5-4fadf33a2519]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1] added
Oct 20 10:48:09 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[27130d22-a222-45d3-80f5-318fd1009c62]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:09 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9581d9-5128-4303-a186-c9d7819e1ea7]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VscDwyUu {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VscDwyUu" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3774b198-15f1-491b-8e55-41198da245a1]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VscDwyUu'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[883a6325-e22b-4daf-a256-4050e9e26dff]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f00b39-c635-41b9-8995-a2ac5ff8745c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:48:10 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:48:10 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a227e909-e7e7-4299-a931-b5a7372ecb37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1, portal: 172.16.0.220,3260]
Oct 20 10:48:10 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1, portal: 172.16.0.220,3260] successful.
Oct 20 10:48:10 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fa804d-4d71-4f6c-a698-29e83cd55cff]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a88101b-0490-47da-9b00-e1e94d71a420]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:48:10 user nova-compute[74311]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 (non-flash)
Oct 20 10:48:10 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:48:10 user nova-compute[74311]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 (non-flash)
Oct 20 10:48:10 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d6118a-f132-4815-a504-1a797167b611]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:10 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:48:11 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:48:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VscDwyUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:48:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:48:11 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23361643538326462', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:48:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361643538326462', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:48:11 user nova-compute[74311]: DEBUG nova.objects.instance [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lazy-loading 'flavor' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:48:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:48:11 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:48:11 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:48:11 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:48:11 user nova-compute[74311]:   <serial>2173c8fe-c5e2-4397-b9d0-792f223010b1</serial>
Oct 20 10:48:11 user nova-compute[74311]: </disk>
Oct 20 10:48:11 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:48:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:48:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:48:11 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] No VIF found with MAC fa:16:3e:56:4a:4d, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:48:11 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-51b5af3b-6e6e-4f90-8c74-26952d9a2226 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.439s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.compute.manager [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:48:13 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Creating image(s)
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Did not create local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Ensure instance console log exists: /opt/stack/data/nova/instances/8235aafb-daf7-4e14-a4ba-8f7e34e4da49/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Start _get_guest_xml network_info=[{"id": "dda433e2-4923-456b-ac8d-71a405b7ef02", "address": "fa:16:3e:10:d2:56", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda433e2-49", "ovs_interfaceid": "dda433e2-4923-456b-ac8d-71a405b7ef02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '2f96c683-b175-47fa-8b3b-87612e015488', 'guest_format': None, 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AvlzhQrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8235aafb-daf7-4e14-a4ba-8f7e34e4da49', 'attached_at': '', 'detached_at': '', 'volume_id': '7175b37a-77d6-4d6e-83f1-e0e3020108a2', 'serial': '7175b37a-77d6-4d6e-83f1-e0e3020108a2'}, 'boot_index': 0, 'device_type': 'disk', 'volume_type': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:48:13 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:48:13 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AvlzhQrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:48:13 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:48:13 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:48:13 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ff9b6f-a83c-4e48-98ab-9ac6666e8984]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:48:13 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c66c25c-581a-4b00-84e9-5911c32df017]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2] added
Oct 20 10:48:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd84a1fd-0c9d-4af2-ba15-817042606274]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec541ad-29e9-4d5c-a4ea-d049d23d1807]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AvlzhQrT {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AvlzhQrT" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c84b2a-b1df-4a8a-81eb-21c2d6ae4265]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AvlzhQrT'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d8b4b4-b7f0-40dd-9144-899c61622037]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c98a54-983e-4fb3-aeae-3356adc79a6a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:48:13 user nova-compute[74311]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 (non-flash)
Oct 20 10:48:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:48:13 user nova-compute[74311]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 (non-flash)
Oct 20 10:48:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f921a2c-625d-439c-b852-82b13e1a605c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2, portal: 172.16.0.220,3260]
Oct 20 10:48:13 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2, portal: 172.16.0.220,3260] successful.
Oct 20 10:48:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3903e63e-7f06-4bb8-8efe-54bce24f01ef]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eb34b3-bffa-4629-907c-cc26f2a67801]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:48:13 user nova-compute[74311]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 (non-flash)
Oct 20 10:48:13 user nova-compute[74311]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 (non-flash)
Oct 20 10:48:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:48:13 user nova-compute[74311]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 (non-flash)
Oct 20 10:48:13 user nova-compute[74311]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 (non-flash)
Oct 20 10:48:13 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[907bc023-18fc-4171-a318-784cde65ee0d]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:48:13 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AvlzhQrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:48:14 user nova-compute[74311]: INFO nova.compute.manager [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Detaching volume 2173c8fe-c5e2-4397-b9d0-792f223010b1
Oct 20 10:48:14 user nova-compute[74311]: INFO nova.virt.block_device [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Attempting to driver detach volume 2173c8fe-c5e2-4397-b9d0-792f223010b1 from mountpoint /dev/vdb
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Attempting to detach device vdb from instance bb318c53-c058-439c-86f5-35847ac9c90e from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:48:14 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:48:14 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:48:14 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:48:14 user nova-compute[74311]:   <serial>2173c8fe-c5e2-4397-b9d0-792f223010b1</serial>
Oct 20 10:48:14 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:48:14 user nova-compute[74311]: </disk>
Oct 20 10:48:14 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:48:14 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Successfully detached device vdb from instance bb318c53-c058-439c-86f5-35847ac9c90e from the persistent domain config.
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb318c53-c058-439c-86f5-35847ac9c90e from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:48:14 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:48:14 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:48:14 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:48:14 user nova-compute[74311]:   <serial>2173c8fe-c5e2-4397-b9d0-792f223010b1</serial>
Oct 20 10:48:14 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:48:14 user nova-compute[74311]: </disk>
Oct 20 10:48:14 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26566376330333735', 'path': '/dev/sdc'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566376330333735', 'path': '/dev/sdc'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:47:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1579348340',display_name='tempest-TestVolumeBootPattern-server-1579348340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1579348340',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3a39KFZ17bE3ncvzIcH4Vxw/Y2gdrgDREcztfOEHBNO1uipHHk2Y+XPwHgE3eoiT29JTcO8Ys40E+uqpMDlmjQ529gbmWean5D7IYFP305bqhP5ciafYVbX9wu+N+nLQ==',key_name='tempest-TestVolumeBootPattern-1713092442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-66pmab69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:47:33Z,user_data=None,user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=8235aafb-daf7-4e14-a4ba-8f7e34e4da49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dda433e2-4923-456b-ac8d-71a405b7ef02", "address": "fa:16:3e:10:d2:56", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda433e2-49", "ovs_interfaceid": "dda433e2-4923-456b-ac8d-71a405b7ef02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "dda433e2-4923-456b-ac8d-71a405b7ef02", "address": "fa:16:3e:10:d2:56", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda433e2-49", "ovs_interfaceid": "dda433e2-4923-456b-ac8d-71a405b7ef02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:d2:56,bridge_name='br-int',has_traffic_filtering=True,id=dda433e2-4923-456b-ac8d-71a405b7ef02,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda433e2-49') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.objects.instance [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lazy-loading 'pci_devices' on Instance uuid 8235aafb-daf7-4e14-a4ba-8f7e34e4da49 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:48:14 user nova-compute[74311]:   <uuid>8235aafb-daf7-4e14-a4ba-8f7e34e4da49</uuid>
Oct 20 10:48:14 user nova-compute[74311]:   <name>instance-00000032</name>
Oct 20 10:48:14 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:48:14 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:48:14 user nova-compute[74311]:   <metadata>
Oct 20 10:48:14 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:48:14 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:48:14 user nova-compute[74311]:       <nova:name>tempest-TestVolumeBootPattern-server-1579348340</nova:name>
Oct 20 10:48:14 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:48:13</nova:creationTime>
Oct 20 10:48:14 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:48:14 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:48:14 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:48:14 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:48:14 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:48:14 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:48:14 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:48:14 user nova-compute[74311]:       <nova:owner>
Oct 20 10:48:14 user nova-compute[74311]:         <nova:user uuid="f9634a3daf064bf2aad6ea38454f7639">tempest-TestVolumeBootPattern-1419375529-project-member</nova:user>
Oct 20 10:48:14 user nova-compute[74311]:         <nova:project uuid="aa7a52d2fa8243fabc22baa8694e14d6">tempest-TestVolumeBootPattern-1419375529</nova:project>
Oct 20 10:48:14 user nova-compute[74311]:       </nova:owner>
Oct 20 10:48:14 user nova-compute[74311]:       <nova:ports>
Oct 20 10:48:14 user nova-compute[74311]:         <nova:port uuid="dda433e2-4923-456b-ac8d-71a405b7ef02">
Oct 20 10:48:14 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 10:48:14 user nova-compute[74311]:         </nova:port>
Oct 20 10:48:14 user nova-compute[74311]:       </nova:ports>
Oct 20 10:48:14 user nova-compute[74311]:     </nova:instance>
Oct 20 10:48:14 user nova-compute[74311]:   </metadata>
Oct 20 10:48:14 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:48:14 user nova-compute[74311]:     <system>
Oct 20 10:48:14 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:48:14 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:48:14 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:48:14 user nova-compute[74311]:       <entry name="serial">8235aafb-daf7-4e14-a4ba-8f7e34e4da49</entry>
Oct 20 10:48:14 user nova-compute[74311]:       <entry name="uuid">8235aafb-daf7-4e14-a4ba-8f7e34e4da49</entry>
Oct 20 10:48:14 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:48:14 user nova-compute[74311]:     </system>
Oct 20 10:48:14 user nova-compute[74311]:   </sysinfo>
Oct 20 10:48:14 user nova-compute[74311]:   <os>
Oct 20 10:48:14 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:48:14 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:48:14 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:48:14 user nova-compute[74311]:   </os>
Oct 20 10:48:14 user nova-compute[74311]:   <features>
Oct 20 10:48:14 user nova-compute[74311]:     <acpi/>
Oct 20 10:48:14 user nova-compute[74311]:     <apic/>
Oct 20 10:48:14 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:48:14 user nova-compute[74311]:   </features>
Oct 20 10:48:14 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:48:14 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:48:14 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:48:14 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:48:14 user nova-compute[74311]:   </clock>
Oct 20 10:48:14 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:48:14 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:48:14 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:48:14 user nova-compute[74311]:   </cpu>
Oct 20 10:48:14 user nova-compute[74311]:   <devices>
Oct 20 10:48:14 user nova-compute[74311]:     <disk type="block" device="disk">
Oct 20 10:48:14 user nova-compute[74311]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:48:14 user nova-compute[74311]:       <source dev="/dev/sdc"/>
Oct 20 10:48:14 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:48:14 user nova-compute[74311]:       <serial>7175b37a-77d6-4d6e-83f1-e0e3020108a2</serial>
Oct 20 10:48:14 user nova-compute[74311]:     </disk>
Oct 20 10:48:14 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:48:14 user nova-compute[74311]:       <mac address="fa:16:3e:10:d2:56"/>
Oct 20 10:48:14 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:48:14 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:48:14 user nova-compute[74311]:       <target dev="tapdda433e2-49"/>
Oct 20 10:48:14 user nova-compute[74311]:     </interface>
Oct 20 10:48:14 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:48:14 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/8235aafb-daf7-4e14-a4ba-8f7e34e4da49/console.log" append="off"/>
Oct 20 10:48:14 user nova-compute[74311]:     </serial>
Oct 20 10:48:14 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:48:14 user nova-compute[74311]:     <video>
Oct 20 10:48:14 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:48:14 user nova-compute[74311]:     </video>
Oct 20 10:48:14 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:48:14 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:48:14 user nova-compute[74311]:     </rng>
Oct 20 10:48:14 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:48:14 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:48:14 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:48:14 user nova-compute[74311]:     </memballoon>
Oct 20 10:48:14 user nova-compute[74311]:   </devices>
Oct 20 10:48:14 user nova-compute[74311]: </domain>
Oct 20 10:48:14 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:47:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1579348340',display_name='tempest-TestVolumeBootPattern-server-1579348340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1579348340',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3a39KFZ17bE3ncvzIcH4Vxw/Y2gdrgDREcztfOEHBNO1uipHHk2Y+XPwHgE3eoiT29JTcO8Ys40E+uqpMDlmjQ529gbmWean5D7IYFP305bqhP5ciafYVbX9wu+N+nLQ==',key_name='tempest-TestVolumeBootPattern-1713092442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-66pmab69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:47:33Z,user_data=None,user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=8235aafb-daf7-4e14-a4ba-8f7e34e4da49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dda433e2-4923-456b-ac8d-71a405b7ef02", "address": "fa:16:3e:10:d2:56", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda433e2-49", "ovs_interfaceid": "dda433e2-4923-456b-ac8d-71a405b7ef02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "dda433e2-4923-456b-ac8d-71a405b7ef02", "address": "fa:16:3e:10:d2:56", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda433e2-49", "ovs_interfaceid": "dda433e2-4923-456b-ac8d-71a405b7ef02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:d2:56,bridge_name='br-int',has_traffic_filtering=True,id=dda433e2-4923-456b-ac8d-71a405b7ef02,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda433e2-49') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG os_vif [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:d2:56,bridge_name='br-int',has_traffic_filtering=True,id=dda433e2-4923-456b-ac8d-71a405b7ef02,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda433e2-49') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4c76d4d-d59f-5a4f-baf0-9ace5fa3f0bb', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdda433e2-49, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdda433e2-49, col_values=(('qos', UUID('93b5cd30-a07c-47f9-8540-55eec2f5ee38')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdda433e2-49, col_values=(('external_ids', {'iface-id': 'dda433e2-4923-456b-ac8d-71a405b7ef02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:d2:56', 'vm-uuid': '8235aafb-daf7-4e14-a4ba-8f7e34e4da49'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:14 user nova-compute[74311]: INFO os_vif [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:d2:56,bridge_name='br-int',has_traffic_filtering=True,id=dda433e2-4923-456b-ac8d-71a405b7ef02,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda433e2-49')
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:48:14 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] No VIF found with MAC fa:16:3e:10:d2:56, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:48:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:48:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-7d83a7bc-875e-4e7b-a65a-53c3c9657773 req-5996b684-de67-40b5-bf76-2701b824112d service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Received event network-vif-plugged-dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:48:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7d83a7bc-875e-4e7b-a65a-53c3c9657773 req-5996b684-de67-40b5-bf76-2701b824112d service nova] Acquiring lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:48:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7d83a7bc-875e-4e7b-a65a-53c3c9657773 req-5996b684-de67-40b5-bf76-2701b824112d service nova] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:48:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-7d83a7bc-875e-4e7b-a65a-53c3c9657773 req-5996b684-de67-40b5-bf76-2701b824112d service nova] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:16 user nova-compute[74311]: DEBUG nova.compute.manager [req-7d83a7bc-875e-4e7b-a65a-53c3c9657773 req-5996b684-de67-40b5-bf76-2701b824112d service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] No waiting events found dispatching network-vif-plugged-dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:48:16 user nova-compute[74311]: WARNING nova.compute.manager [req-7d83a7bc-875e-4e7b-a65a-53c3c9657773 req-5996b684-de67-40b5-bf76-2701b824112d service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Received unexpected event network-vif-plugged-dda433e2-4923-456b-ac8d-71a405b7ef02 for instance with vm_state building and task_state spawning.
Oct 20 10:48:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:18 user nova-compute[74311]: DEBUG nova.compute.manager [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:48:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:48:18 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Instance spawned successfully.
Oct 20 10:48:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:48:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:48:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:48:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:48:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:48:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:48:18 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:48:18 user nova-compute[74311]: INFO nova.compute.manager [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Took 5.09 seconds to spawn the instance on the hypervisor.
Oct 20 10:48:18 user nova-compute[74311]: DEBUG nova.compute.manager [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:48:18 user nova-compute[74311]: INFO nova.compute.manager [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Took 46.41 seconds to build instance.
Oct 20 10:48:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-54cb3b23-a283-4ea0-abe9-8a5d87245a20 tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.506s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:18 user nova-compute[74311]: DEBUG nova.compute.manager [req-9a05a706-15c4-4c8b-a23f-241cba7a92bd req-f3b914ac-a89b-4e59-8506-b4fd41bbb9f0 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Received event network-vif-plugged-dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:48:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9a05a706-15c4-4c8b-a23f-241cba7a92bd req-f3b914ac-a89b-4e59-8506-b4fd41bbb9f0 service nova] Acquiring lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:48:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9a05a706-15c4-4c8b-a23f-241cba7a92bd req-f3b914ac-a89b-4e59-8506-b4fd41bbb9f0 service nova] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:48:18 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-9a05a706-15c4-4c8b-a23f-241cba7a92bd req-f3b914ac-a89b-4e59-8506-b4fd41bbb9f0 service nova] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:18 user nova-compute[74311]: DEBUG nova.compute.manager [req-9a05a706-15c4-4c8b-a23f-241cba7a92bd req-f3b914ac-a89b-4e59-8506-b4fd41bbb9f0 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] No waiting events found dispatching network-vif-plugged-dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:48:18 user nova-compute[74311]: WARNING nova.compute.manager [req-9a05a706-15c4-4c8b-a23f-241cba7a92bd req-f3b914ac-a89b-4e59-8506-b4fd41bbb9f0 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Received unexpected event network-vif-plugged-dda433e2-4923-456b-ac8d-71a405b7ef02 for instance with vm_state active and task_state None.
Oct 20 10:48:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:20 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:48:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:48:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:48:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:48:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:48:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updating instance_info_cache with network_info: [{"id": "af3cce47-5348-449e-b5ca-c006515a379e", "address": "fa:16:3e:56:4a:4d", "network": {"id": "fa57bf52-f1a0-4605-878e-a936f3c7e717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1036604684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a090a44405c45ee9bcdd6a34c0173a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cce47-53", "ovs_interfaceid": "af3cce47-5348-449e-b5ca-c006515a379e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:48:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:48:21 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:48:22 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:48:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:25 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:48:29 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:48:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:48:32 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:48:32 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:48:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:35 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bb318c53-c058-439c-86f5-35847ac9c90e is timed out.
Oct 20 10:48:35 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Successfully detached device vdb from instance bb318c53-c058-439c-86f5-35847ac9c90e from the live domain config.
Oct 20 10:48:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VscDwyUu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:48:35 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa3d68e-cfe5-42c5-9d0d-15132ecdc3f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:48:35 user nova-compute[74311]: No targets found.
Oct 20 10:48:35 user nova-compute[74311]: iSNS:
Oct 20 10:48:35 user nova-compute[74311]: No targets found.
Oct 20 10:48:35 user nova-compute[74311]: STATIC:
Oct 20 10:48:35 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2
Oct 20 10:48:35 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:48:35 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:48:35 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b
Oct 20 10:48:35 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:48:35 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:48:35 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1
Oct 20 10:48:35 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:48:35 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:48:35 user nova-compute[74311]: FIRMWARE:
Oct 20 10:48:35 user nova-compute[74311]: No targets found.
Oct 20 10:48:35 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:48:35 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:48:35 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ba5311-db7d-47a2-9433-5cd905492062]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[289791dc-c820-44f1-9389-d27d14d55a1b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:48:35 user nova-compute[74311]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 (non-flash)
Oct 20 10:48:35 user nova-compute[74311]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 (non-flash)
Oct 20 10:48:35 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:48:35 user nova-compute[74311]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 (non-flash)
Oct 20 10:48:35 user nova-compute[74311]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 (non-flash)
Oct 20 10:48:35 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164fc05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9825c8-8a0c-455f-84d6-f14cfb21defb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db63482-d69f-49b2-8da1-b5d6d59e9c2b]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[52916994-6b5b-4d85-94b0-af32a4c28ca4]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ac6d0d-98db-4e88-aa3e-0e31b55f6799]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acf4729-aae8-44d9-81c8-3a4cc1b9c4a2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a25ed3-88e7-40b2-b9c2-59682004e099]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1, portal: 172.16.0.220,3260]
Oct 20 10:48:35 user nova-compute[74311]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1, portal: 172.16.0.220,3260] successful.
Oct 20 10:48:35 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2173c8fe-c5e2-4397-b9d0-792f223010b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ec8a11-f025-4f71-bc7a-5249e05d6c78]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] <== disconnect_volume: return (286ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:48:35 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:48:36 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lazy-loading 'flavor' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:48:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e03d6966-9d8d-4b19-9b2f-7dff4b11fbae tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.755s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:38 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:48:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:48:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:48:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:38 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:48:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:48:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:38 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:48:39 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:48:39 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:48:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8522MB free_disk=25.13436508178711GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance bb318c53-c058-439c-86f5-35847ac9c90e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance bd1f0ae9-d07b-45db-94f2-81baf48010bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance 8235aafb-daf7-4e14-a4ba-8f7e34e4da49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing inventories for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Updating ProviderTree inventory for provider 77cac819-3c22-4fec-a59d-0525ac40a90b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Updating inventory in ProviderTree for provider 77cac819-3c22-4fec-a59d-0525ac40a90b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing aggregate associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, aggregates: None {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing trait associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3 {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:48:40 user nova-compute[74311]: INFO nova.compute.claims [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Claim successful on node user
Oct 20 10:48:40 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:48:40 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:48:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG nova.policy [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24c8f83400ef489e88a4f719e301b284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78bfc1cd59d4be3b98ddad43a8d3002', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:48:40 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Creating image(s)
Oct 20 10:48:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "/opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "/opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "/opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "a46626b64d25da98360e5f9a7ff2389f5e56f4d0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:48:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "a46626b64d25da98360e5f9a7ff2389f5e56f4d0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:48:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0.part --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:41 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Successfully created port: 22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:48:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0.part --force-share --output=json" returned: 0 in 0.182s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:41 user nova-compute[74311]: DEBUG nova.virt.images [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] 1c864e1a-a318-427c-95fd-071b761913ff was qcow2, converting to raw {{(pid=74311) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 10:48:41 user nova-compute[74311]: DEBUG nova.privsep.utils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74311) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 10:48:41 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0.part /opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0.converted {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0.part /opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0.converted" returned: 0 in 0.593s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0.converted --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "a46626b64d25da98360e5f9a7ff2389f5e56f4d0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.533s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Successfully updated port: 22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquired lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-12d0ea72-5b15-43a8-815f-c273048c90a2 req-2c76f16f-0251-48a7-8639-5549a6c77fd3 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-changed-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG nova.compute.manager [req-12d0ea72-5b15-43a8-815f-c273048c90a2 req-2c76f16f-0251-48a7-8639-5549a6c77fd3 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Refreshing instance network info cache due to event network-changed-22da36aa-5f45-4489-b1f1-1095d5d1b2b6. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-12d0ea72-5b15-43a8-815f-c273048c90a2 req-2c76f16f-0251-48a7-8639-5549a6c77fd3 service nova] Acquiring lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0 --force-share --output=json" returned: 0 in 0.207s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "a46626b64d25da98360e5f9a7ff2389f5e56f4d0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "a46626b64d25da98360e5f9a7ff2389f5e56f4d0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0 --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0,backing_fmt=raw /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG nova.network.neutron [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updating instance_info_cache with network_info: [{"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0,backing_fmt=raw /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk 1073741824" returned: 0 in 0.053s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "a46626b64d25da98360e5f9a7ff2389f5e56f4d0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Releasing lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Instance network_info: |[{"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-12d0ea72-5b15-43a8-815f-c273048c90a2 req-2c76f16f-0251-48a7-8639-5549a6c77fd3 service nova] Acquired lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:48:42 user nova-compute[74311]: DEBUG nova.network.neutron [req-12d0ea72-5b15-43a8-815f-c273048c90a2 req-2c76f16f-0251-48a7-8639-5549a6c77fd3 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Refreshing network info cache for port 22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a46626b64d25da98360e5f9a7ff2389f5e56f4d0 --force-share --output=json" returned: 0 in 0.191s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Cannot resize image /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Ensure instance console log exists: /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Start _get_guest_xml network_info=[{"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:48:37Z,direct_url=<?>,disk_format='qcow2',id=1c864e1a-a318-427c-95fd-071b761913ff,min_disk=0,min_ram=0,name='tempest-scenario-img--385093561',owner='b78bfc1cd59d4be3b98ddad43a8d3002',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:48:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '1c864e1a-a318-427c-95fd-071b761913ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:48:43 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:48:43 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:48:37Z,direct_url=<?>,disk_format='qcow2',id=1c864e1a-a318-427c-95fd-071b761913ff,min_disk=0,min_ram=0,name='tempest-scenario-img--385093561',owner='b78bfc1cd59d4be3b98ddad43a8d3002',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:48:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1566596305',display_name='tempest-TestMinimumBasicScenario-server-1566596305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1566596305',id=51,image_ref='1c864e1a-a318-427c-95fd-071b761913ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeE7i/E7FINN1QylH7HdB6tuCExyhgxrSFkTEPyrT0tzgZAQUN0iHOqAzwgmXOOkwj2AsckrueD88jJIHcHfZ25+OAGEpjIzG9zC04WkE/bICe7AWsBEXo9pQoBuyUL+A==',key_name='tempest-TestMinimumBasicScenario-877989772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b78bfc1cd59d4be3b98ddad43a8d3002',ramdisk_id='',reservation_id='r-fql4oj3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c864e1a-a318-427c-95fd-071b761913ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1072164048',owner_user_name='tempest-TestMinimumBasicScenario-1072164048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:48:41Z,user_data=None,user_id='24c8f83400ef489e88a4f719e301b284',uuid=f89bf3f8-7ecc-4ada-af50-6585c11bb303,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converting VIF {"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:69:b6,bridge_name='br-int',has_traffic_filtering=True,id=22da36aa-5f45-4489-b1f1-1095d5d1b2b6,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22da36aa-5f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.objects.instance [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'pci_devices' on Instance uuid f89bf3f8-7ecc-4ada-af50-6585c11bb303 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:48:43 user nova-compute[74311]:   <uuid>f89bf3f8-7ecc-4ada-af50-6585c11bb303</uuid>
Oct 20 10:48:43 user nova-compute[74311]:   <name>instance-00000033</name>
Oct 20 10:48:43 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:48:43 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:48:43 user nova-compute[74311]:   <metadata>
Oct 20 10:48:43 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:48:43 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:48:43 user nova-compute[74311]:       <nova:name>tempest-TestMinimumBasicScenario-server-1566596305</nova:name>
Oct 20 10:48:43 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:48:43</nova:creationTime>
Oct 20 10:48:43 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:48:43 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:48:43 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:48:43 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:48:43 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:48:43 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:48:43 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:48:43 user nova-compute[74311]:       <nova:owner>
Oct 20 10:48:43 user nova-compute[74311]:         <nova:user uuid="24c8f83400ef489e88a4f719e301b284">tempest-TestMinimumBasicScenario-1072164048-project-member</nova:user>
Oct 20 10:48:43 user nova-compute[74311]:         <nova:project uuid="b78bfc1cd59d4be3b98ddad43a8d3002">tempest-TestMinimumBasicScenario-1072164048</nova:project>
Oct 20 10:48:43 user nova-compute[74311]:       </nova:owner>
Oct 20 10:48:43 user nova-compute[74311]:       <nova:root type="image" uuid="1c864e1a-a318-427c-95fd-071b761913ff"/>
Oct 20 10:48:43 user nova-compute[74311]:       <nova:ports>
Oct 20 10:48:43 user nova-compute[74311]:         <nova:port uuid="22da36aa-5f45-4489-b1f1-1095d5d1b2b6">
Oct 20 10:48:43 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 10:48:43 user nova-compute[74311]:         </nova:port>
Oct 20 10:48:43 user nova-compute[74311]:       </nova:ports>
Oct 20 10:48:43 user nova-compute[74311]:     </nova:instance>
Oct 20 10:48:43 user nova-compute[74311]:   </metadata>
Oct 20 10:48:43 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:48:43 user nova-compute[74311]:     <system>
Oct 20 10:48:43 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:48:43 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:48:43 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:48:43 user nova-compute[74311]:       <entry name="serial">f89bf3f8-7ecc-4ada-af50-6585c11bb303</entry>
Oct 20 10:48:43 user nova-compute[74311]:       <entry name="uuid">f89bf3f8-7ecc-4ada-af50-6585c11bb303</entry>
Oct 20 10:48:43 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:48:43 user nova-compute[74311]:     </system>
Oct 20 10:48:43 user nova-compute[74311]:   </sysinfo>
Oct 20 10:48:43 user nova-compute[74311]:   <os>
Oct 20 10:48:43 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:48:43 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:48:43 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:48:43 user nova-compute[74311]:   </os>
Oct 20 10:48:43 user nova-compute[74311]:   <features>
Oct 20 10:48:43 user nova-compute[74311]:     <acpi/>
Oct 20 10:48:43 user nova-compute[74311]:     <apic/>
Oct 20 10:48:43 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:48:43 user nova-compute[74311]:   </features>
Oct 20 10:48:43 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:48:43 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:48:43 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:48:43 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:48:43 user nova-compute[74311]:   </clock>
Oct 20 10:48:43 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:48:43 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:48:43 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:48:43 user nova-compute[74311]:   </cpu>
Oct 20 10:48:43 user nova-compute[74311]:   <devices>
Oct 20 10:48:43 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:48:43 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:48:43 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk"/>
Oct 20 10:48:43 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:48:43 user nova-compute[74311]:     </disk>
Oct 20 10:48:43 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:48:43 user nova-compute[74311]:       <mac address="fa:16:3e:d8:69:b6"/>
Oct 20 10:48:43 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:48:43 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:48:43 user nova-compute[74311]:       <target dev="tap22da36aa-5f"/>
Oct 20 10:48:43 user nova-compute[74311]:     </interface>
Oct 20 10:48:43 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:48:43 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/console.log" append="off"/>
Oct 20 10:48:43 user nova-compute[74311]:     </serial>
Oct 20 10:48:43 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:48:43 user nova-compute[74311]:     <video>
Oct 20 10:48:43 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:48:43 user nova-compute[74311]:     </video>
Oct 20 10:48:43 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:48:43 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:48:43 user nova-compute[74311]:     </rng>
Oct 20 10:48:43 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:48:43 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:48:43 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:48:43 user nova-compute[74311]:     </memballoon>
Oct 20 10:48:43 user nova-compute[74311]:   </devices>
Oct 20 10:48:43 user nova-compute[74311]: </domain>
Oct 20 10:48:43 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1566596305',display_name='tempest-TestMinimumBasicScenario-server-1566596305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1566596305',id=51,image_ref='1c864e1a-a318-427c-95fd-071b761913ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeE7i/E7FINN1QylH7HdB6tuCExyhgxrSFkTEPyrT0tzgZAQUN0iHOqAzwgmXOOkwj2AsckrueD88jJIHcHfZ25+OAGEpjIzG9zC04WkE/bICe7AWsBEXo9pQoBuyUL+A==',key_name='tempest-TestMinimumBasicScenario-877989772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b78bfc1cd59d4be3b98ddad43a8d3002',ramdisk_id='',reservation_id='r-fql4oj3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c864e1a-a318-427c-95fd-071b761913ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1072164048',owner_user_name='tempest-TestMinimumBasicScenario-1072164048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:48:41Z,user_data=None,user_id='24c8f83400ef489e88a4f719e301b284',uuid=f89bf3f8-7ecc-4ada-af50-6585c11bb303,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converting VIF {"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:69:b6,bridge_name='br-int',has_traffic_filtering=True,id=22da36aa-5f45-4489-b1f1-1095d5d1b2b6,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22da36aa-5f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG os_vif [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:69:b6,bridge_name='br-int',has_traffic_filtering=True,id=22da36aa-5f45-4489-b1f1-1095d5d1b2b6,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22da36aa-5f') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa71c547-7c7b-5c00-97e4-e608ff45a98f', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22da36aa-5f, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22da36aa-5f, col_values=(('qos', UUID('46642005-1b10-47d0-88a9-169953ffd538')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22da36aa-5f, col_values=(('external_ids', {'iface-id': '22da36aa-5f45-4489-b1f1-1095d5d1b2b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:69:b6', 'vm-uuid': 'f89bf3f8-7ecc-4ada-af50-6585c11bb303'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:43 user nova-compute[74311]: INFO os_vif [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:69:b6,bridge_name='br-int',has_traffic_filtering=True,id=22da36aa-5f45-4489-b1f1-1095d5d1b2b6,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22da36aa-5f')
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.network.neutron [req-12d0ea72-5b15-43a8-815f-c273048c90a2 req-2c76f16f-0251-48a7-8639-5549a6c77fd3 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updated VIF entry in instance network info cache for port 22da36aa-5f45-4489-b1f1-1095d5d1b2b6. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.network.neutron [req-12d0ea72-5b15-43a8-815f-c273048c90a2 req-2c76f16f-0251-48a7-8639-5549a6c77fd3 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updating instance_info_cache with network_info: [{"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-12d0ea72-5b15-43a8-815f-c273048c90a2 req-2c76f16f-0251-48a7-8639-5549a6c77fd3 service nova] Releasing lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:48:43 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] No VIF found with MAC fa:16:3e:d8:69:b6, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:48:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-5a2ebe7e-1477-4e1b-bfca-bb10670c1f1c req-820ec5ec-3005-46b0-9167-1564419e360d service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:48:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5a2ebe7e-1477-4e1b-bfca-bb10670c1f1c req-820ec5ec-3005-46b0-9167-1564419e360d service nova] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:48:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5a2ebe7e-1477-4e1b-bfca-bb10670c1f1c req-820ec5ec-3005-46b0-9167-1564419e360d service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:48:45 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-5a2ebe7e-1477-4e1b-bfca-bb10670c1f1c req-820ec5ec-3005-46b0-9167-1564419e360d service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:45 user nova-compute[74311]: DEBUG nova.compute.manager [req-5a2ebe7e-1477-4e1b-bfca-bb10670c1f1c req-820ec5ec-3005-46b0-9167-1564419e360d service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] No waiting events found dispatching network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:48:45 user nova-compute[74311]: WARNING nova.compute.manager [req-5a2ebe7e-1477-4e1b-bfca-bb10670c1f1c req-820ec5ec-3005-46b0-9167-1564419e360d service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received unexpected event network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 for instance with vm_state building and task_state spawning.
Oct 20 10:48:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:45 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:46 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:48:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:48:46 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Instance spawned successfully.
Oct 20 10:48:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:48:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:48:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:48:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:48:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:48:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:48:46 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:48:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-4082ba0d-758d-4889-8e4a-56c3740d081b req-a5763748-062b-45ad-828a-3f3aad0b90d4 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:48:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4082ba0d-758d-4889-8e4a-56c3740d081b req-a5763748-062b-45ad-828a-3f3aad0b90d4 service nova] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:48:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4082ba0d-758d-4889-8e4a-56c3740d081b req-a5763748-062b-45ad-828a-3f3aad0b90d4 service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:48:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-4082ba0d-758d-4889-8e4a-56c3740d081b req-a5763748-062b-45ad-828a-3f3aad0b90d4 service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:47 user nova-compute[74311]: DEBUG nova.compute.manager [req-4082ba0d-758d-4889-8e4a-56c3740d081b req-a5763748-062b-45ad-828a-3f3aad0b90d4 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] No waiting events found dispatching network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:48:47 user nova-compute[74311]: WARNING nova.compute.manager [req-4082ba0d-758d-4889-8e4a-56c3740d081b req-a5763748-062b-45ad-828a-3f3aad0b90d4 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received unexpected event network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 for instance with vm_state building and task_state spawning.
Oct 20 10:48:47 user nova-compute[74311]: INFO nova.compute.manager [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Took 6.14 seconds to spawn the instance on the hypervisor.
Oct 20 10:48:47 user nova-compute[74311]: DEBUG nova.compute.manager [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:48:47 user nova-compute[74311]: INFO nova.compute.manager [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Took 6.72 seconds to build instance.
Oct 20 10:48:47 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ab085c91-8826-48dc-9516-9eb21220184c tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.823s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:48:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:51 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:48:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 10:48:51 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] There are 0 instances to clean {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 10:48:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:48:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:49:01 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:49:01 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74311) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 10:49:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:49:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:49:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:49:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:49:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid bd1f0ae9-d07b-45db-94f2-81baf48010bf {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid 8235aafb-daf7-4e14-a4ba-8f7e34e4da49 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Triggering sync for uuid f89bf3f8-7ecc-4ada-af50-6585c11bb303 {{(pid=74311) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:09 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lazy-loading 'flavor' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:49:09 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.046s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:10 user nova-compute[74311]: INFO nova.compute.manager [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Attaching volume e4184fc1-7e25-41e7-967a-661a699b4b5b to /dev/vdb
Oct 20 10:49:10 user nova-compute[74311]: DEBUG os_brick.utils [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bbc078-5cd5-4dc1-8dbe-0657febf834e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4346fb8e-8dad-4901-9a43-436aad741a87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9e04ec-b891-4673-a4b5-ee2e8b9b0196]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[10af1eb6-b9b3-4e2c-9abf-69ebcc540bdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:49:10 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:49:10 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b8e5f9-0b82-4457-9fa3-fa008ba59334]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG os_brick.utils [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:49:10 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updating existing volume attachment record: 3024a6cb-62c5-4cee-af38-0611f4c2eb6a {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:49:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:20 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:49:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:49:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:49:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:49:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:49:20 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Updating instance_info_cache with network_info: [{"id": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "address": "fa:16:3e:0e:34:85", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04b4733-87", "ovs_interfaceid": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:49:20 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:49:20 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:49:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:23 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:49:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-b80723e6-6908-461d-9d79-62f94d438c08 req-0ac5768c-e381-41dc-8920-dad76cfabce1 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Received event network-changed-dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:49:24 user nova-compute[74311]: DEBUG nova.compute.manager [req-b80723e6-6908-461d-9d79-62f94d438c08 req-0ac5768c-e381-41dc-8920-dad76cfabce1 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Refreshing instance network info cache due to event network-changed-dda433e2-4923-456b-ac8d-71a405b7ef02. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:49:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b80723e6-6908-461d-9d79-62f94d438c08 req-0ac5768c-e381-41dc-8920-dad76cfabce1 service nova] Acquiring lock "refresh_cache-8235aafb-daf7-4e14-a4ba-8f7e34e4da49" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:49:24 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b80723e6-6908-461d-9d79-62f94d438c08 req-0ac5768c-e381-41dc-8920-dad76cfabce1 service nova] Acquired lock "refresh_cache-8235aafb-daf7-4e14-a4ba-8f7e34e4da49" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:49:24 user nova-compute[74311]: DEBUG nova.network.neutron [req-b80723e6-6908-461d-9d79-62f94d438c08 req-0ac5768c-e381-41dc-8920-dad76cfabce1 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Refreshing network info cache for port dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:49:25 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:49:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:25 user nova-compute[74311]: INFO nova.compute.manager [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Terminating instance
Oct 20 10:49:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:49:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:25 user nova-compute[74311]: DEBUG nova.network.neutron [req-b80723e6-6908-461d-9d79-62f94d438c08 req-0ac5768c-e381-41dc-8920-dad76cfabce1 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Updated VIF entry in instance network info cache for port dda433e2-4923-456b-ac8d-71a405b7ef02. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:49:25 user nova-compute[74311]: DEBUG nova.network.neutron [req-b80723e6-6908-461d-9d79-62f94d438c08 req-0ac5768c-e381-41dc-8920-dad76cfabce1 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Updating instance_info_cache with network_info: [{"id": "dda433e2-4923-456b-ac8d-71a405b7ef02", "address": "fa:16:3e:10:d2:56", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda433e2-49", "ovs_interfaceid": "dda433e2-4923-456b-ac8d-71a405b7ef02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:49:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b80723e6-6908-461d-9d79-62f94d438c08 req-0ac5768c-e381-41dc-8920-dad76cfabce1 service nova] Releasing lock "refresh_cache-8235aafb-daf7-4e14-a4ba-8f7e34e4da49" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:49:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:26 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Instance destroyed successfully.
Oct 20 10:49:26 user nova-compute[74311]: DEBUG nova.objects.instance [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lazy-loading 'resources' on Instance uuid 8235aafb-daf7-4e14-a4ba-8f7e34e4da49 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:47:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1579348340',display_name='tempest-TestVolumeBootPattern-server-1579348340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1579348340',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3a39KFZ17bE3ncvzIcH4Vxw/Y2gdrgDREcztfOEHBNO1uipHHk2Y+XPwHgE3eoiT29JTcO8Ys40E+uqpMDlmjQ529gbmWean5D7IYFP305bqhP5ciafYVbX9wu+N+nLQ==',key_name='tempest-TestVolumeBootPattern-1713092442',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:48:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-66pmab69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:48:19Z,user_data=None,user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=8235aafb-daf7-4e14-a4ba-8f7e34e4da49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dda433e2-4923-456b-ac8d-71a405b7ef02", "address": "fa:16:3e:10:d2:56", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda433e2-49", "ovs_interfaceid": "dda433e2-4923-456b-ac8d-71a405b7ef02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "dda433e2-4923-456b-ac8d-71a405b7ef02", "address": "fa:16:3e:10:d2:56", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda433e2-49", "ovs_interfaceid": "dda433e2-4923-456b-ac8d-71a405b7ef02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:d2:56,bridge_name='br-int',has_traffic_filtering=True,id=dda433e2-4923-456b-ac8d-71a405b7ef02,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda433e2-49') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_vif [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:d2:56,bridge_name='br-int',has_traffic_filtering=True,id=dda433e2-4923-456b-ac8d-71a405b7ef02,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda433e2-49') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdda433e2-49, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93b5cd30-a07c-47f9-8540-55eec2f5ee38) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:49:26 user nova-compute[74311]: INFO os_vif [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:d2:56,bridge_name='br-int',has_traffic_filtering=True,id=dda433e2-4923-456b-ac8d-71a405b7ef02,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdda433e2-49')
Oct 20 10:49:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AvlzhQrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:49:26 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3847df40-501c-41ab-842c-ea9a07114fc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:49:26 user nova-compute[74311]: No targets found.
Oct 20 10:49:26 user nova-compute[74311]: iSNS:
Oct 20 10:49:26 user nova-compute[74311]: No targets found.
Oct 20 10:49:26 user nova-compute[74311]: STATIC:
Oct 20 10:49:26 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2
Oct 20 10:49:26 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:49:26 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:49:26 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b
Oct 20 10:49:26 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:49:26 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:49:26 user nova-compute[74311]: FIRMWARE:
Oct 20 10:49:26 user nova-compute[74311]: No targets found.
Oct 20 10:49:26 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:49:26 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:49:26 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1cad06-349a-43eb-a3f4-7c6944c0bbb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7ea96c-7d12-4e42-9910-4377e7776a09]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:49:26 user nova-compute[74311]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 (non-flash)
Oct 20 10:49:26 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:49:26 user nova-compute[74311]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 (non-flash)
Oct 20 10:49:26 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164b37c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2'): ({'sdc'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Removing single pathed devices sdc {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd785b1-1574-445c-b04b-82ee2b793cb8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4644d3-ff55-4a3b-8122-0ad234412430]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flushing IO for device /dev/sdc {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6de60f8-ad91-46d1-af21-0d9b4d8f6d57]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb75ca0-6c20-4185-a262-ac8bc0aefef6]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO129a994c-ef7c037537858d4e', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_129a994c', '/dev/disk/by-id/scsi-26566376330333735') {{(pid=85589) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fee07d-c4f4-471b-be6d-b0aa9f0f4de1]: (4, None) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Received event network-changed-dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG nova.compute.manager [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Refreshing instance network info cache due to event network-changed-dda433e2-4923-456b-ac8d-71a405b7ef02. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] Acquiring lock "refresh_cache-8235aafb-daf7-4e14-a4ba-8f7e34e4da49" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] Acquired lock "refresh_cache-8235aafb-daf7-4e14-a4ba-8f7e34e4da49" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG nova.network.neutron [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Refreshing network info cache for port dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[093bd4d0-e5c6-42ab-b484-bdbc54654d74]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6187c15a-cf94-4c5a-a00a-ec80a2c1cdb4]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2, portal: 172.16.0.220,3260]
Oct 20 10:49:26 user nova-compute[74311]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2, portal: 172.16.0.220,3260] successful.
Oct 20 10:49:26 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7175b37a-77d6-4d6e-83f1-e0e3020108a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[66280e26-6266-4884-82a3-705f3fb2ea41]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== disconnect_volume: return (399ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:49:26 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Deleting instance files /opt/stack/data/nova/instances/8235aafb-daf7-4e14-a4ba-8f7e34e4da49_del
Oct 20 10:49:26 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Deletion of /opt/stack/data/nova/instances/8235aafb-daf7-4e14-a4ba-8f7e34e4da49_del complete
Oct 20 10:49:26 user nova-compute[74311]: INFO nova.compute.manager [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Took 1.29 seconds to destroy the instance on the hypervisor.
Oct 20 10:49:26 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:49:26 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:49:27 user nova-compute[74311]: DEBUG nova.network.neutron [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Updated VIF entry in instance network info cache for port dda433e2-4923-456b-ac8d-71a405b7ef02. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:49:27 user nova-compute[74311]: DEBUG nova.network.neutron [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Updating instance_info_cache with network_info: [{"id": "dda433e2-4923-456b-ac8d-71a405b7ef02", "address": "fa:16:3e:10:d2:56", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdda433e2-49", "ovs_interfaceid": "dda433e2-4923-456b-ac8d-71a405b7ef02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:49:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] Releasing lock "refresh_cache-8235aafb-daf7-4e14-a4ba-8f7e34e4da49" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:49:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Received event network-vif-unplugged-dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:49:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] Acquiring lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] No waiting events found dispatching network-vif-unplugged-dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:49:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Received event network-vif-unplugged-dda433e2-4923-456b-ac8d-71a405b7ef02 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:49:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Received event network-vif-plugged-dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:49:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] Acquiring lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:27 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:27 user nova-compute[74311]: DEBUG nova.compute.manager [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] No waiting events found dispatching network-vif-plugged-dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:49:27 user nova-compute[74311]: WARNING nova.compute.manager [req-ee485bf2-0b55-4638-99df-2b65ad1ffdb1 req-9fb855e7-e511-4f71-8f46-befb39468537 service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Received unexpected event network-vif-plugged-dda433e2-4923-456b-ac8d-71a405b7ef02 for instance with vm_state active and task_state deleting.
Oct 20 10:49:27 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:49:27 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Took 0.72 seconds to deallocate network for instance.
Oct 20 10:49:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKnyQMNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:49:28 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:49:28 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:49:28 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9885ff1b-39e2-4f8e-9b8d-0abf6760e029]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:49:28 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcab16d7-2e00-4f08-bd63-151fbafa8df0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b] added
Oct 20 10:49:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:28 user nova-compute[74311]: INFO nova.compute.manager [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Took 1.02 seconds to detach 1 volumes for instance.
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e834e045-ed95-4e87-bf1a-552d54a8e86c]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3035e7c2-44e4-4384-9d6c-a43bcb2f345f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKnyQMNw {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKnyQMNw" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[637d9424-73c0-412e-9199-a44b12c89dd0]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dKnyQMNw'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b5d6fd-ad4e-49cb-a753-4bf20a49e672]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9367923-5953-4476-bb42-ea1db934335e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:49:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:49:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG nova.compute.manager [req-dfbaf71a-75b0-45ef-a8a3-e6870afee622 req-c3271a08-3e27-454a-b59b-dcc8a885e06a service nova] [instance: 8235aafb-daf7-4e14-a4ba-8f7e34e4da49] Received event network-vif-deleted-dda433e2-4923-456b-ac8d-71a405b7ef02 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[617d9ee7-f878-4c81-b764-4dedd9a5b0f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b, portal: 172.16.0.220,3260]
Oct 20 10:49:28 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b, portal: 172.16.0.220,3260] successful.
Oct 20 10:49:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b562e62c-cc36-49c4-8f89-1a29231ac58f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[750e95cb-0210-4a5f-8122-98989cf773ba]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:49:28 user nova-compute[74311]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b (non-flash)
Oct 20 10:49:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:49:28 user nova-compute[74311]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b (non-flash)
Oct 20 10:49:28 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee9708f-ee38-4946-825c-44b83b0ca014]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKnyQMNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:49:28 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:28 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Deleted allocations for instance 8235aafb-daf7-4e14-a4ba-8f7e34e4da49
Oct 20 10:49:29 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-359d8a0b-0d41-4a8c-9ef6-0129cc72b7cc tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "8235aafb-daf7-4e14-a4ba-8f7e34e4da49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.499s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:49:29 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23765343361303261', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:49:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765343361303261', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:49:29 user nova-compute[74311]: DEBUG nova.objects.instance [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lazy-loading 'flavor' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:49:29 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:49:29 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:49:29 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:49:29 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:49:29 user nova-compute[74311]:   <serial>e4184fc1-7e25-41e7-967a-661a699b4b5b</serial>
Oct 20 10:49:29 user nova-compute[74311]: </disk>
Oct 20 10:49:29 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:49:30 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:49:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:49:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:49:30 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] No VIF found with MAC fa:16:3e:56:4a:4d, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:49:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-7656ed11-f1b8-4d70-9b93-687033c4b075 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.437s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "f632820f-b394-426a-bc96-8896b3dece44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "f632820f-b394-426a-bc96-8896b3dece44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Starting instance... {{(pid=74311) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74311) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 10:49:31 user nova-compute[74311]: INFO nova.compute.claims [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Claim successful on node user
Oct 20 10:49:31 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Start building networks asynchronously for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Allocating IP information in the background. {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] allocate_for_instance() {{(pid=74311) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 10:49:31 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 10:49:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Start building block device mappings for instance. {{(pid=74311) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG nova.policy [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec258f753038417199ffa329b865519a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00ff3fe2f2247328c2febdb51e5acd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74311) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Start spawning the instance on the hypervisor. {{(pid=74311) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Creating instance directory {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 10:49:31 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Creating image(s)
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "/opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "/opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "/opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "a7b7375650f64ac9e015788cc2a40cca40856223" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:31 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk 1073741824 {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223,backing_fmt=raw /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk 1073741824" returned: 0 in 0.063s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "a7b7375650f64ac9e015788cc2a40cca40856223" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Successfully created port: 63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a7b7375650f64ac9e015788cc2a40cca40856223 --force-share --output=json" returned: 0 in 0.185s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk. size=1073741824 {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.disk.api [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Cannot resize image /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk to a smaller size. {{(pid=74311) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Created local disks {{(pid=74311) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Ensure instance console log exists: /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/console.log {{(pid=74311) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Successfully updated port: 63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "refresh_cache-f632820f-b394-426a-bc96-8896b3dece44" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquired lock "refresh_cache-f632820f-b394-426a-bc96-8896b3dece44" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-0c9b9d96-69ff-4e47-a581-496d78e98684 req-2e68a772-be53-4faa-a4e3-c2d5e8f5b773 service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Received event network-changed-63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-0c9b9d96-69ff-4e47-a581-496d78e98684 req-2e68a772-be53-4faa-a4e3-c2d5e8f5b773 service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Refreshing instance network info cache due to event network-changed-63fcbf99-332c-4e9a-a992-0b7f766cbb2f. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0c9b9d96-69ff-4e47-a581-496d78e98684 req-2e68a772-be53-4faa-a4e3-c2d5e8f5b773 service nova] Acquiring lock "refresh_cache-f632820f-b394-426a-bc96-8896b3dece44" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Instance cache missing network info. {{(pid=74311) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.network.neutron [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Updating instance_info_cache with network_info: [{"id": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "address": "fa:16:3e:88:0a:b8", "network": {"id": "8acd9e99-ab1c-4abb-a951-406701ea04f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1291194185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ff3fe2f2247328c2febdb51e5acd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fcbf99-33", "ovs_interfaceid": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Releasing lock "refresh_cache-f632820f-b394-426a-bc96-8896b3dece44" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Instance network_info: |[{"id": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "address": "fa:16:3e:88:0a:b8", "network": {"id": "8acd9e99-ab1c-4abb-a951-406701ea04f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1291194185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ff3fe2f2247328c2febdb51e5acd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fcbf99-33", "ovs_interfaceid": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74311) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0c9b9d96-69ff-4e47-a581-496d78e98684 req-2e68a772-be53-4faa-a4e3-c2d5e8f5b773 service nova] Acquired lock "refresh_cache-f632820f-b394-426a-bc96-8896b3dece44" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.network.neutron [req-0c9b9d96-69ff-4e47-a581-496d78e98684 req-2e68a772-be53-4faa-a4e3-c2d5e8f5b773 service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Refreshing network info cache for port 63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Start _get_guest_xml network_info=[{"id": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "address": "fa:16:3e:88:0a:b8", "network": {"id": "8acd9e99-ab1c-4abb-a951-406701ea04f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1291194185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ff3fe2f2247328c2febdb51e5acd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fcbf99-33", "ovs_interfaceid": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'boot_index': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'encryption_format': None, 'encryption_options': None, 'image_id': '4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 10:49:32 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:49:32 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] CPU controller missing on host. {{(pid=74311) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.host [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] CPU controller found on host. {{(pid=74311) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74311) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T10:08:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T10:08:21Z,direct_url=<?>,disk_format='qcow2',id=4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88a2448f77204da4b76f4108232814ca',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T10:08:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Flavor limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Image limits 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Flavor pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Image pref 0:0:0 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74311) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Got 1 possible topologies {{(pid=74311) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 10:49:32 user nova-compute[74311]: DEBUG nova.virt.hardware [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74311) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-473149571',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-473149571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4731495',id=52,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5wAsBh9M1QcLzc/0I4HZMAh/U07TITj/gt+IOo9ZJ3olCthPaW8WeoOpgLiDK+sEEKFVRevaPS3E6yPFbT0tW0ZBrREOXl77DZc6IbwblzsjMa5WZwrOLwums4+iWUcw==',key_name='tempest-keypair-105537298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c00ff3fe2f2247328c2febdb51e5acd4',ramdisk_id='',reservation_id='r-gn3nxepy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1157924576',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:49:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec258f753038417199ffa329b865519a',uuid=f632820f-b394-426a-bc96-8896b3dece44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "address": "fa:16:3e:88:0a:b8", "network": {"id": "8acd9e99-ab1c-4abb-a951-406701ea04f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1291194185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ff3fe2f2247328c2febdb51e5acd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fcbf99-33", "ovs_interfaceid": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74311) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Converting VIF {"id": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "address": "fa:16:3e:88:0a:b8", "network": {"id": "8acd9e99-ab1c-4abb-a951-406701ea04f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1291194185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ff3fe2f2247328c2febdb51e5acd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fcbf99-33", "ovs_interfaceid": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:0a:b8,bridge_name='br-int',has_traffic_filtering=True,id=63fcbf99-332c-4e9a-a992-0b7f766cbb2f,network=Network(8acd9e99-ab1c-4abb-a951-406701ea04f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fcbf99-33') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.objects.instance [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lazy-loading 'pci_devices' on Instance uuid f632820f-b394-426a-bc96-8896b3dece44 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] End _get_guest_xml xml=<domain type="kvm">
Oct 20 10:49:33 user nova-compute[74311]:   <uuid>f632820f-b394-426a-bc96-8896b3dece44</uuid>
Oct 20 10:49:33 user nova-compute[74311]:   <name>instance-00000034</name>
Oct 20 10:49:33 user nova-compute[74311]:   <memory>524288</memory>
Oct 20 10:49:33 user nova-compute[74311]:   <vcpu>1</vcpu>
Oct 20 10:49:33 user nova-compute[74311]:   <metadata>
Oct 20 10:49:33 user nova-compute[74311]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 10:49:33 user nova-compute[74311]:       <nova:package version="0.0.0"/>
Oct 20 10:49:33 user nova-compute[74311]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-473149571</nova:name>
Oct 20 10:49:33 user nova-compute[74311]:       <nova:creationTime>2023-10-20 10:49:32</nova:creationTime>
Oct 20 10:49:33 user nova-compute[74311]:       <nova:flavor name="m1.tiny">
Oct 20 10:49:33 user nova-compute[74311]:         <nova:memory>512</nova:memory>
Oct 20 10:49:33 user nova-compute[74311]:         <nova:disk>1</nova:disk>
Oct 20 10:49:33 user nova-compute[74311]:         <nova:swap>0</nova:swap>
Oct 20 10:49:33 user nova-compute[74311]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 10:49:33 user nova-compute[74311]:         <nova:vcpus>1</nova:vcpus>
Oct 20 10:49:33 user nova-compute[74311]:       </nova:flavor>
Oct 20 10:49:33 user nova-compute[74311]:       <nova:owner>
Oct 20 10:49:33 user nova-compute[74311]:         <nova:user uuid="ec258f753038417199ffa329b865519a">tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member</nova:user>
Oct 20 10:49:33 user nova-compute[74311]:         <nova:project uuid="c00ff3fe2f2247328c2febdb51e5acd4">tempest-TestServerVolumeAttachScenarioOldVersion-1157924576</nova:project>
Oct 20 10:49:33 user nova-compute[74311]:       </nova:owner>
Oct 20 10:49:33 user nova-compute[74311]:       <nova:root type="image" uuid="4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa"/>
Oct 20 10:49:33 user nova-compute[74311]:       <nova:ports>
Oct 20 10:49:33 user nova-compute[74311]:         <nova:port uuid="63fcbf99-332c-4e9a-a992-0b7f766cbb2f">
Oct 20 10:49:33 user nova-compute[74311]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 10:49:33 user nova-compute[74311]:         </nova:port>
Oct 20 10:49:33 user nova-compute[74311]:       </nova:ports>
Oct 20 10:49:33 user nova-compute[74311]:     </nova:instance>
Oct 20 10:49:33 user nova-compute[74311]:   </metadata>
Oct 20 10:49:33 user nova-compute[74311]:   <sysinfo type="smbios">
Oct 20 10:49:33 user nova-compute[74311]:     <system>
Oct 20 10:49:33 user nova-compute[74311]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 10:49:33 user nova-compute[74311]:       <entry name="product">OpenStack Nova</entry>
Oct 20 10:49:33 user nova-compute[74311]:       <entry name="version">0.0.0</entry>
Oct 20 10:49:33 user nova-compute[74311]:       <entry name="serial">f632820f-b394-426a-bc96-8896b3dece44</entry>
Oct 20 10:49:33 user nova-compute[74311]:       <entry name="uuid">f632820f-b394-426a-bc96-8896b3dece44</entry>
Oct 20 10:49:33 user nova-compute[74311]:       <entry name="family">Virtual Machine</entry>
Oct 20 10:49:33 user nova-compute[74311]:     </system>
Oct 20 10:49:33 user nova-compute[74311]:   </sysinfo>
Oct 20 10:49:33 user nova-compute[74311]:   <os>
Oct 20 10:49:33 user nova-compute[74311]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 10:49:33 user nova-compute[74311]:     <boot dev="hd"/>
Oct 20 10:49:33 user nova-compute[74311]:     <smbios mode="sysinfo"/>
Oct 20 10:49:33 user nova-compute[74311]:   </os>
Oct 20 10:49:33 user nova-compute[74311]:   <features>
Oct 20 10:49:33 user nova-compute[74311]:     <acpi/>
Oct 20 10:49:33 user nova-compute[74311]:     <apic/>
Oct 20 10:49:33 user nova-compute[74311]:     <vmcoreinfo/>
Oct 20 10:49:33 user nova-compute[74311]:   </features>
Oct 20 10:49:33 user nova-compute[74311]:   <clock offset="utc">
Oct 20 10:49:33 user nova-compute[74311]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 10:49:33 user nova-compute[74311]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 10:49:33 user nova-compute[74311]:     <timer name="hpet" present="no"/>
Oct 20 10:49:33 user nova-compute[74311]:   </clock>
Oct 20 10:49:33 user nova-compute[74311]:   <cpu mode="custom" match="exact">
Oct 20 10:49:33 user nova-compute[74311]:     <model>Nehalem</model>
Oct 20 10:49:33 user nova-compute[74311]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 10:49:33 user nova-compute[74311]:   </cpu>
Oct 20 10:49:33 user nova-compute[74311]:   <devices>
Oct 20 10:49:33 user nova-compute[74311]:     <disk type="file" device="disk">
Oct 20 10:49:33 user nova-compute[74311]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 10:49:33 user nova-compute[74311]:       <source file="/opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk"/>
Oct 20 10:49:33 user nova-compute[74311]:       <target dev="vda" bus="virtio"/>
Oct 20 10:49:33 user nova-compute[74311]:     </disk>
Oct 20 10:49:33 user nova-compute[74311]:     <interface type="ethernet">
Oct 20 10:49:33 user nova-compute[74311]:       <mac address="fa:16:3e:88:0a:b8"/>
Oct 20 10:49:33 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:49:33 user nova-compute[74311]:       <mtu size="1442"/>
Oct 20 10:49:33 user nova-compute[74311]:       <target dev="tap63fcbf99-33"/>
Oct 20 10:49:33 user nova-compute[74311]:     </interface>
Oct 20 10:49:33 user nova-compute[74311]:     <serial type="pty">
Oct 20 10:49:33 user nova-compute[74311]:       <log file="/opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/console.log" append="off"/>
Oct 20 10:49:33 user nova-compute[74311]:     </serial>
Oct 20 10:49:33 user nova-compute[74311]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 10:49:33 user nova-compute[74311]:     <video>
Oct 20 10:49:33 user nova-compute[74311]:       <model type="virtio"/>
Oct 20 10:49:33 user nova-compute[74311]:     </video>
Oct 20 10:49:33 user nova-compute[74311]:     <rng model="virtio">
Oct 20 10:49:33 user nova-compute[74311]:       <backend model="random">/dev/urandom</backend>
Oct 20 10:49:33 user nova-compute[74311]:     </rng>
Oct 20 10:49:33 user nova-compute[74311]:     <controller type="usb" index="0" model="none"/>
Oct 20 10:49:33 user nova-compute[74311]:     <memballoon model="virtio">
Oct 20 10:49:33 user nova-compute[74311]:       <stats period="10"/>
Oct 20 10:49:33 user nova-compute[74311]:     </memballoon>
Oct 20 10:49:33 user nova-compute[74311]:   </devices>
Oct 20 10:49:33 user nova-compute[74311]: </domain>
Oct 20 10:49:33 user nova-compute[74311]:  {{(pid=74311) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-473149571',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-473149571',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4731495',id=52,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5wAsBh9M1QcLzc/0I4HZMAh/U07TITj/gt+IOo9ZJ3olCthPaW8WeoOpgLiDK+sEEKFVRevaPS3E6yPFbT0tW0ZBrREOXl77DZc6IbwblzsjMa5WZwrOLwums4+iWUcw==',key_name='tempest-keypair-105537298',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c00ff3fe2f2247328c2febdb51e5acd4',ramdisk_id='',reservation_id='r-gn3nxepy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1157924576',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T10:49:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec258f753038417199ffa329b865519a',uuid=f632820f-b394-426a-bc96-8896b3dece44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "address": "fa:16:3e:88:0a:b8", "network": {"id": "8acd9e99-ab1c-4abb-a951-406701ea04f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1291194185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ff3fe2f2247328c2febdb51e5acd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fcbf99-33", "ovs_interfaceid": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Converting VIF {"id": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "address": "fa:16:3e:88:0a:b8", "network": {"id": "8acd9e99-ab1c-4abb-a951-406701ea04f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1291194185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ff3fe2f2247328c2febdb51e5acd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fcbf99-33", "ovs_interfaceid": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:0a:b8,bridge_name='br-int',has_traffic_filtering=True,id=63fcbf99-332c-4e9a-a992-0b7f766cbb2f,network=Network(8acd9e99-ab1c-4abb-a951-406701ea04f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fcbf99-33') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG os_vif [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:0a:b8,bridge_name='br-int',has_traffic_filtering=True,id=63fcbf99-332c-4e9a-a992-0b7f766cbb2f,network=Network(8acd9e99-ab1c-4abb-a951-406701ea04f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fcbf99-33') {{(pid=74311) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4255b326-2bd3-5fe0-b55a-452b1896f788', '_type': 'linux-noop'}}, row=False) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63fcbf99-33, may_exist=True, interface_attrs={}) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63fcbf99-33, col_values=(('qos', UUID('978396c2-f68b-4a9c-b8aa-69d3947b93c0')),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63fcbf99-33, col_values=(('external_ids', {'iface-id': '63fcbf99-332c-4e9a-a992-0b7f766cbb2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:0a:b8', 'vm-uuid': 'f632820f-b394-426a-bc96-8896b3dece44'}),), if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:33 user nova-compute[74311]: INFO os_vif [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:0a:b8,bridge_name='br-int',has_traffic_filtering=True,id=63fcbf99-332c-4e9a-a992-0b7f766cbb2f,network=Network(8acd9e99-ab1c-4abb-a951-406701ea04f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fcbf99-33')
Oct 20 10:49:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:33 user nova-compute[74311]: INFO nova.compute.manager [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Detaching volume e4184fc1-7e25-41e7-967a-661a699b4b5b
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] No VIF found with MAC fa:16:3e:88:0a:b8, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:49:33 user nova-compute[74311]: INFO nova.virt.block_device [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Attempting to driver detach volume e4184fc1-7e25-41e7-967a-661a699b4b5b from mountpoint /dev/vdb
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Attempting to detach device vdb from instance bb318c53-c058-439c-86f5-35847ac9c90e from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:49:33 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:49:33 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:49:33 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:49:33 user nova-compute[74311]:   <serial>e4184fc1-7e25-41e7-967a-661a699b4b5b</serial>
Oct 20 10:49:33 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:49:33 user nova-compute[74311]: </disk>
Oct 20 10:49:33 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:49:33 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Successfully detached device vdb from instance bb318c53-c058-439c-86f5-35847ac9c90e from the persistent domain config.
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb318c53-c058-439c-86f5-35847ac9c90e from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:49:33 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:49:33 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:49:33 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:49:33 user nova-compute[74311]:   <serial>e4184fc1-7e25-41e7-967a-661a699b4b5b</serial>
Oct 20 10:49:33 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:49:33 user nova-compute[74311]: </disk>
Oct 20 10:49:33 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.network.neutron [req-0c9b9d96-69ff-4e47-a581-496d78e98684 req-2e68a772-be53-4faa-a4e3-c2d5e8f5b773 service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Updated VIF entry in instance network info cache for port 63fcbf99-332c-4e9a-a992-0b7f766cbb2f. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.network.neutron [req-0c9b9d96-69ff-4e47-a581-496d78e98684 req-2e68a772-be53-4faa-a4e3-c2d5e8f5b773 service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Updating instance_info_cache with network_info: [{"id": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "address": "fa:16:3e:88:0a:b8", "network": {"id": "8acd9e99-ab1c-4abb-a951-406701ea04f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1291194185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ff3fe2f2247328c2febdb51e5acd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fcbf99-33", "ovs_interfaceid": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-0c9b9d96-69ff-4e47-a581-496d78e98684 req-2e68a772-be53-4faa-a4e3-c2d5e8f5b773 service nova] Releasing lock "refresh_cache-f632820f-b394-426a-bc96-8896b3dece44" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:49:33 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:49:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:35 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:49:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-53c4bd5f-dda4-4109-a518-d73aaf2b2aea req-018edbf8-54e2-400a-bf76-d84277363a9f service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Received event network-vif-plugged-63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:49:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-53c4bd5f-dda4-4109-a518-d73aaf2b2aea req-018edbf8-54e2-400a-bf76-d84277363a9f service nova] Acquiring lock "f632820f-b394-426a-bc96-8896b3dece44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-53c4bd5f-dda4-4109-a518-d73aaf2b2aea req-018edbf8-54e2-400a-bf76-d84277363a9f service nova] Lock "f632820f-b394-426a-bc96-8896b3dece44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-53c4bd5f-dda4-4109-a518-d73aaf2b2aea req-018edbf8-54e2-400a-bf76-d84277363a9f service nova] Lock "f632820f-b394-426a-bc96-8896b3dece44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-53c4bd5f-dda4-4109-a518-d73aaf2b2aea req-018edbf8-54e2-400a-bf76-d84277363a9f service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] No waiting events found dispatching network-vif-plugged-63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:49:35 user nova-compute[74311]: WARNING nova.compute.manager [req-53c4bd5f-dda4-4109-a518-d73aaf2b2aea req-018edbf8-54e2-400a-bf76-d84277363a9f service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Received unexpected event network-vif-plugged-63fcbf99-332c-4e9a-a992-0b7f766cbb2f for instance with vm_state building and task_state spawning.
Oct 20 10:49:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:36 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Instance event wait completed in 0 seconds for  {{(pid=74311) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 10:49:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Guest created on hypervisor {{(pid=74311) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 10:49:36 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: f632820f-b394-426a-bc96-8896b3dece44] Instance spawned successfully.
Oct 20 10:49:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 10:49:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Found default for hw_cdrom_bus of ide {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:49:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Found default for hw_disk_bus of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:49:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Found default for hw_input_bus of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:49:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Found default for hw_pointer_model of None {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:49:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Found default for hw_video_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:49:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Found default for hw_vif_model of virtio {{(pid=74311) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 10:49:36 user nova-compute[74311]: INFO nova.compute.manager [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Took 5.28 seconds to spawn the instance on the hypervisor.
Oct 20 10:49:36 user nova-compute[74311]: DEBUG nova.compute.manager [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:49:36 user nova-compute[74311]: INFO nova.compute.manager [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Took 5.85 seconds to build instance.
Oct 20 10:49:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0dd9677d-292a-4fb6-8a73-f26ae51657d3 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "f632820f-b394-426a-bc96-8896b3dece44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.956s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-ec411ffd-57ef-4805-8ca4-d36f26f63cdc req-42c3d902-a768-4719-b40c-5bfe69422a59 service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Received event network-vif-plugged-63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:49:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ec411ffd-57ef-4805-8ca4-d36f26f63cdc req-42c3d902-a768-4719-b40c-5bfe69422a59 service nova] Acquiring lock "f632820f-b394-426a-bc96-8896b3dece44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ec411ffd-57ef-4805-8ca4-d36f26f63cdc req-42c3d902-a768-4719-b40c-5bfe69422a59 service nova] Lock "f632820f-b394-426a-bc96-8896b3dece44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-ec411ffd-57ef-4805-8ca4-d36f26f63cdc req-42c3d902-a768-4719-b40c-5bfe69422a59 service nova] Lock "f632820f-b394-426a-bc96-8896b3dece44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-ec411ffd-57ef-4805-8ca4-d36f26f63cdc req-42c3d902-a768-4719-b40c-5bfe69422a59 service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] No waiting events found dispatching network-vif-plugged-63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:49:37 user nova-compute[74311]: WARNING nova.compute.manager [req-ec411ffd-57ef-4805-8ca4-d36f26f63cdc req-42c3d902-a768-4719-b40c-5bfe69422a59 service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Received unexpected event network-vif-plugged-63fcbf99-332c-4e9a-a992-0b7f766cbb2f for instance with vm_state active and task_state None.
Oct 20 10:49:38 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:49:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:38 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:49:38 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:39 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:49:39 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:49:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8499MB free_disk=25.040668487548828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance bb318c53-c058-439c-86f5-35847ac9c90e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance bd1f0ae9-d07b-45db-94f2-81baf48010bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance f89bf3f8-7ecc-4ada-af50-6585c11bb303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance f632820f-b394-426a-bc96-8896b3dece44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:49:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:40 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:49:42 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:49:42 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:49:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:48 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:53 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bb318c53-c058-439c-86f5-35847ac9c90e is timed out.
Oct 20 10:49:53 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Successfully detached device vdb from instance bb318c53-c058-439c-86f5-35847ac9c90e from the live domain config.
Oct 20 10:49:53 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKnyQMNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:49:53 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6f10d4-6eb3-4301-a1df-4cb9663524d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:49:53 user nova-compute[74311]: No targets found.
Oct 20 10:49:53 user nova-compute[74311]: iSNS:
Oct 20 10:49:53 user nova-compute[74311]: No targets found.
Oct 20 10:49:53 user nova-compute[74311]: STATIC:
Oct 20 10:49:53 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b
Oct 20 10:49:53 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:49:53 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:49:53 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b
Oct 20 10:49:53 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:49:53 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:49:53 user nova-compute[74311]: FIRMWARE:
Oct 20 10:49:53 user nova-compute[74311]: No targets found.
Oct 20 10:49:53 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:49:53 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:49:53 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00472a0-302e-4b57-9008-ec0af432453e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4188298a-0b17-4983-81b4-f8419925d9a0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:49:53 user nova-compute[74311]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b (non-flash)
Oct 20 10:49:53 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:49:53 user nova-compute[74311]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b (non-flash)
Oct 20 10:49:53 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164c6ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedd579b-17ca-4e8e-9c4e-e07108f3660b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31924e4-ea18-41b0-8d61-3ff416aa7fe1]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[65daa307-5fb1-41c0-a58a-210c09623017]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d2704b-a96a-4641-98ac-8812ff932875]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc34bea-cf3c-4bd6-8c99-62d667251ff0]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:49:53 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[412cd652-1cb7-478b-bc29-d9bfee05f676]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b, portal: 172.16.0.220,3260]
Oct 20 10:49:54 user nova-compute[74311]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b, portal: 172.16.0.220,3260] successful.
Oct 20 10:49:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:49:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:49:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4184fc1-7e25-41e7-967a-661a699b4b5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:49:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fef81a-afdf-48ab-9342-6ab2b67b869a]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:49:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:49:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:49:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] <== disconnect_volume: return (316ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:49:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:49:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:54 user nova-compute[74311]: DEBUG nova.objects.instance [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lazy-loading 'flavor' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:49:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-0ca822dd-fd7e-4a68-bf4e-71026b8fa499 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.836s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:49:58 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:49:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:03 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:08 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:13 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:50:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:50:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:50:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:50:18 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:21 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:50:21 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:50:21 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:50:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:50:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:50:21 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:50:21 user nova-compute[74311]: DEBUG nova.objects.instance [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lazy-loading 'info_cache' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:50:21 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updating instance_info_cache with network_info: [{"id": "af3cce47-5348-449e-b5ca-c006515a379e", "address": "fa:16:3e:56:4a:4d", "network": {"id": "fa57bf52-f1a0-4605-878e-a936f3c7e717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1036604684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a090a44405c45ee9bcdd6a34c0173a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cce47-53", "ovs_interfaceid": "af3cce47-5348-449e-b5ca-c006515a379e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:50:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-bb318c53-c058-439c-86f5-35847ac9c90e" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:50:21 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:50:23 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:50:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:50:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:50:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:50:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:50:23 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:26 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:50:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:50:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:50:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:50:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:50:28 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:32 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:50:32 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:50:33 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:50:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-56eb7182-146d-46f4-8c76-a8b5992279ca req-5b9d83a2-768e-4e51-a49f-19ed8b04308a service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Received event network-changed-f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:50:35 user nova-compute[74311]: DEBUG nova.compute.manager [req-56eb7182-146d-46f4-8c76-a8b5992279ca req-5b9d83a2-768e-4e51-a49f-19ed8b04308a service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Refreshing instance network info cache due to event network-changed-f04b4733-87a4-4ecf-961f-0d5232d7c480. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:50:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-56eb7182-146d-46f4-8c76-a8b5992279ca req-5b9d83a2-768e-4e51-a49f-19ed8b04308a service nova] Acquiring lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:50:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-56eb7182-146d-46f4-8c76-a8b5992279ca req-5b9d83a2-768e-4e51-a49f-19ed8b04308a service nova] Acquired lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:50:35 user nova-compute[74311]: DEBUG nova.network.neutron [req-56eb7182-146d-46f4-8c76-a8b5992279ca req-5b9d83a2-768e-4e51-a49f-19ed8b04308a service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Refreshing network info cache for port f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:50:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:50:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:50:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:50:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:50:35 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:50:35 user nova-compute[74311]: INFO nova.compute.manager [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Terminating instance
Oct 20 10:50:35 user nova-compute[74311]: DEBUG nova.compute.manager [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:50:35 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:35 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG nova.network.neutron [req-56eb7182-146d-46f4-8c76-a8b5992279ca req-5b9d83a2-768e-4e51-a49f-19ed8b04308a service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Updated VIF entry in instance network info cache for port f04b4733-87a4-4ecf-961f-0d5232d7c480. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG nova.network.neutron [req-56eb7182-146d-46f4-8c76-a8b5992279ca req-5b9d83a2-768e-4e51-a49f-19ed8b04308a service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Updating instance_info_cache with network_info: [{"id": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "address": "fa:16:3e:0e:34:85", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04b4733-87", "ovs_interfaceid": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-56eb7182-146d-46f4-8c76-a8b5992279ca req-5b9d83a2-768e-4e51-a49f-19ed8b04308a service nova] Releasing lock "refresh_cache-bd1f0ae9-d07b-45db-94f2-81baf48010bf" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:50:36 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Instance destroyed successfully.
Oct 20 10:50:36 user nova-compute[74311]: DEBUG nova.objects.instance [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lazy-loading 'resources' on Instance uuid bd1f0ae9-d07b-45db-94f2-81baf48010bf {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1238377505',display_name='tempest-TestVolumeBootPattern-server-1238377505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1238377505',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3a39KFZ17bE3ncvzIcH4Vxw/Y2gdrgDREcztfOEHBNO1uipHHk2Y+XPwHgE3eoiT29JTcO8Ys40E+uqpMDlmjQ529gbmWean5D7IYFP305bqhP5ciafYVbX9wu+N+nLQ==',key_name='tempest-TestVolumeBootPattern-1713092442',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa7a52d2fa8243fabc22baa8694e14d6',ramdisk_id='',reservation_id='r-qb074cae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1419375529',owner_user_name='tempest-TestVolumeBootPattern-1419375529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:45:36Z,user_data=None,user_id='f9634a3daf064bf2aad6ea38454f7639',uuid=bd1f0ae9-d07b-45db-94f2-81baf48010bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "address": "fa:16:3e:0e:34:85", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04b4733-87", "ovs_interfaceid": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converting VIF {"id": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "address": "fa:16:3e:0e:34:85", "network": {"id": "00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-992591734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa7a52d2fa8243fabc22baa8694e14d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf04b4733-87", "ovs_interfaceid": "f04b4733-87a4-4ecf-961f-0d5232d7c480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:34:85,bridge_name='br-int',has_traffic_filtering=True,id=f04b4733-87a4-4ecf-961f-0d5232d7c480,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04b4733-87') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_vif [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:34:85,bridge_name='br-int',has_traffic_filtering=True,id=f04b4733-87a4-4ecf-961f-0d5232d7c480,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04b4733-87') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf04b4733-87, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02b8a4df-2e37-4181-b635-a3e846ab4259) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:50:36 user nova-compute[74311]: INFO os_vif [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:34:85,bridge_name='br-int',has_traffic_filtering=True,id=f04b4733-87a4-4ecf-961f-0d5232d7c480,network=Network(00af2ade-ecad-44dd-b6b6-f6f3e59a4a8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf04b4733-87')
Oct 20 10:50:36 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TojvNfEc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:50:36 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd313ee-f691-4b1c-857e-eb391d10c6ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:50:36 user nova-compute[74311]: No targets found.
Oct 20 10:50:36 user nova-compute[74311]: iSNS:
Oct 20 10:50:36 user nova-compute[74311]: No targets found.
Oct 20 10:50:36 user nova-compute[74311]: STATIC:
Oct 20 10:50:36 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b
Oct 20 10:50:36 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:50:36 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:50:36 user nova-compute[74311]: FIRMWARE:
Oct 20 10:50:36 user nova-compute[74311]: No targets found.
Oct 20 10:50:36 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:50:36 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:50:36 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[74073212-2041-4054-a63a-40663bc5f5e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[840d3def-18d7-440c-818a-39638b2301ba]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:50:36 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b (non-flash)
Oct 20 10:50:36 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164f90ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b'): ({'sde'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Removing single pathed devices sde {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d709884-de47-4368-a462-9efbef6b9917]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[191644b8-6e3b-47c3-bd69-1b5950aed00b]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Flushing IO for device /dev/sde {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[37379cea-fb3a-42c3-9ee5-8cfc6e32e925]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69d6af6-7fc4-4a49-8faf-c10727dce216]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] SCSI volumes sde have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c804141d-63f3-421b-9bde-b1be5e524e5a]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:50:36 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --logout" returned: 0 in 0.119s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a8585e-2e4b-4b0c-b75b-f8057ff5805c]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260]
Oct 20 10:50:37 user nova-compute[74311]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b, portal: 172.16.0.220,3260] successful.
Oct 20 10:50:37 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4b55e17-9b40-477a-8918-536f0e39236b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce3557b-f1fc-431f-80d8-e22cb43626f1]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] <== disconnect_volume: return (374ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:50:37 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Deleting instance files /opt/stack/data/nova/instances/bd1f0ae9-d07b-45db-94f2-81baf48010bf_del
Oct 20 10:50:37 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Deletion of /opt/stack/data/nova/instances/bd1f0ae9-d07b-45db-94f2-81baf48010bf_del complete
Oct 20 10:50:37 user nova-compute[74311]: INFO nova.compute.manager [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Took 1.26 seconds to destroy the instance on the hypervisor.
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'flavor' on Instance uuid f89bf3f8-7ecc-4ada-af50-6585c11bb303 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:50:37 user nova-compute[74311]: INFO nova.compute.manager [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Attaching volume 506849cd-226c-4225-b881-eb169884a713 to /dev/vdb
Oct 20 10:50:37 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:50:37 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Took 0.47 seconds to deallocate network for instance.
Oct 20 10:50:37 user nova-compute[74311]: DEBUG os_brick.utils [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[321d9b7a-9129-4730-9bef-43efd56db39f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb9bd57-0dfd-4af5-8c82-80dd19b2d51e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf66e0f7-d3d7-4b0a-8e44-b1ac808e816c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[08069683-20b5-41ab-915b-1d5898303309]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:50:37 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[015f3392-2c38-47f8-a76f-6362ed30f4c0]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG os_brick.utils [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updating existing volume attachment record: 5091395b-6c1f-4f7a-b3d4-59f99bb4d106 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-06860f8f-98f3-4f1c-92fc-7233a5c22d1a req-81b13b2a-76fd-416b-b8f3-0c822cde5b06 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Received event network-vif-unplugged-f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-06860f8f-98f3-4f1c-92fc-7233a5c22d1a req-81b13b2a-76fd-416b-b8f3-0c822cde5b06 service nova] Acquiring lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-06860f8f-98f3-4f1c-92fc-7233a5c22d1a req-81b13b2a-76fd-416b-b8f3-0c822cde5b06 service nova] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-06860f8f-98f3-4f1c-92fc-7233a5c22d1a req-81b13b2a-76fd-416b-b8f3-0c822cde5b06 service nova] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-06860f8f-98f3-4f1c-92fc-7233a5c22d1a req-81b13b2a-76fd-416b-b8f3-0c822cde5b06 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] No waiting events found dispatching network-vif-unplugged-f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-06860f8f-98f3-4f1c-92fc-7233a5c22d1a req-81b13b2a-76fd-416b-b8f3-0c822cde5b06 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Received event network-vif-unplugged-f04b4733-87a4-4ecf-961f-0d5232d7c480 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-06860f8f-98f3-4f1c-92fc-7233a5c22d1a req-81b13b2a-76fd-416b-b8f3-0c822cde5b06 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Received event network-vif-plugged-f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-06860f8f-98f3-4f1c-92fc-7233a5c22d1a req-81b13b2a-76fd-416b-b8f3-0c822cde5b06 service nova] Acquiring lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-06860f8f-98f3-4f1c-92fc-7233a5c22d1a req-81b13b2a-76fd-416b-b8f3-0c822cde5b06 service nova] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-06860f8f-98f3-4f1c-92fc-7233a5c22d1a req-81b13b2a-76fd-416b-b8f3-0c822cde5b06 service nova] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:50:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-06860f8f-98f3-4f1c-92fc-7233a5c22d1a req-81b13b2a-76fd-416b-b8f3-0c822cde5b06 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] No waiting events found dispatching network-vif-plugged-f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:50:37 user nova-compute[74311]: WARNING nova.compute.manager [req-06860f8f-98f3-4f1c-92fc-7233a5c22d1a req-81b13b2a-76fd-416b-b8f3-0c822cde5b06 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Received unexpected event network-vif-plugged-f04b4733-87a4-4ecf-961f-0d5232d7c480 for instance with vm_state active and task_state deleting.
Oct 20 10:50:37 user nova-compute[74311]: DEBUG nova.compute.manager [req-06860f8f-98f3-4f1c-92fc-7233a5c22d1a req-81b13b2a-76fd-416b-b8f3-0c822cde5b06 service nova] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Received event network-vif-deleted-f04b4733-87a4-4ecf-961f-0d5232d7c480 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:50:38 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:50:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:50:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:50:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:50:38 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:50:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:38 user nova-compute[74311]: INFO nova.compute.manager [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] [instance: bd1f0ae9-d07b-45db-94f2-81baf48010bf] Took 0.93 seconds to detach 1 volumes for instance.
Oct 20 10:50:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:50:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:50:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:38 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:50:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:38 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:38 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:50:38 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:50:38 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Deleted allocations for instance bd1f0ae9-d07b-45db-94f2-81baf48010bf
Oct 20 10:50:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-5fc7db6a-c7a6-4f93-869e-8d01c76008fe tempest-TestVolumeBootPattern-1419375529 tempest-TestVolumeBootPattern-1419375529-project-member] Lock "bd1f0ae9-d07b-45db-94f2-81baf48010bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.192s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:50:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:39 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:50:39 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:50:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8542MB free_disk=25.011493682861328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:50:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:50:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:50:40 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance bb318c53-c058-439c-86f5-35847ac9c90e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:50:40 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance f89bf3f8-7ecc-4ada-af50-6585c11bb303 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:50:40 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance f632820f-b394-426a-bc96-8896b3dece44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:50:40 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:50:40 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:50:40 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:50:40 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:50:40 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:50:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:50:41 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:50:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:42 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:50:44 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:50:44 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:50:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyWvdAzP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:50:54 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:50:54 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:50:54 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d015da-b1af-49fd-be93-5f893ab55250]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:50:54 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c1b152-52ac-4658-a870-f5e74cd92944]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713] added
Oct 20 10:50:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89d113d-7df6-4d64-8ac4-030dcb968928]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fbd885-3546-4934-8c18-53e4f945ce81]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GyWvdAzP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GyWvdAzP" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4e5974-c644-4a66-96a1-80cead88c828]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GyWvdAzP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[2189b8e1-a15a-4ef5-ba7b-11619372552b]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[457ada76-83ef-4929-b5e8-aabdb2d5ebea]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:50:54 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 10:50:54 user nova-compute[74311]:  {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:50:54 user nova-compute[74311]: WARNING os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 10:50:54 user nova-compute[74311]: 
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b17383-aea1-441c-af02-0d8ad999278d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713, portal: 172.16.0.220,3260]
Oct 20 10:50:54 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713, portal: 172.16.0.220,3260] successful.
Oct 20 10:50:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55648b8-303a-425e-8534-1f8b5936cf6a]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[3282ec57-e831-42a1-8f8b-2f25edb56020]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)
Oct 20 10:50:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)
Oct 20 10:50:54 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b62fce8-c48b-4185-9cc0-841b8d544050]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:50:54 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyWvdAzP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:50:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:50:55 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23161613032386132', 'path': '/dev/sdb'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:50:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161613032386132', 'path': '/dev/sdb'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:50:55 user nova-compute[74311]: DEBUG nova.objects.instance [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'flavor' on Instance uuid f89bf3f8-7ecc-4ada-af50-6585c11bb303 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:50:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:50:55 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:50:55 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:50:55 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:50:55 user nova-compute[74311]:   <serial>506849cd-226c-4225-b881-eb169884a713</serial>
Oct 20 10:50:55 user nova-compute[74311]: </disk>
Oct 20 10:50:55 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:50:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:50:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:50:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] No VIF found with MAC fa:16:3e:d8:69:b6, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:50:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-e2133e88-d882-4730-86a9-65a1b8f06cec tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.438s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:50:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:50:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-b3b87c4b-8587-4295-bb21-b8aaa5823191 req-1c20afbb-49ef-4227-abe0-f774b2b13707 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-changed-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:50:58 user nova-compute[74311]: DEBUG nova.compute.manager [req-b3b87c4b-8587-4295-bb21-b8aaa5823191 req-1c20afbb-49ef-4227-abe0-f774b2b13707 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Refreshing instance network info cache due to event network-changed-22da36aa-5f45-4489-b1f1-1095d5d1b2b6. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:50:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b3b87c4b-8587-4295-bb21-b8aaa5823191 req-1c20afbb-49ef-4227-abe0-f774b2b13707 service nova] Acquiring lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:50:58 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b3b87c4b-8587-4295-bb21-b8aaa5823191 req-1c20afbb-49ef-4227-abe0-f774b2b13707 service nova] Acquired lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:50:58 user nova-compute[74311]: DEBUG nova.network.neutron [req-b3b87c4b-8587-4295-bb21-b8aaa5823191 req-1c20afbb-49ef-4227-abe0-f774b2b13707 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Refreshing network info cache for port 22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:50:59 user nova-compute[74311]: DEBUG nova.network.neutron [req-b3b87c4b-8587-4295-bb21-b8aaa5823191 req-1c20afbb-49ef-4227-abe0-f774b2b13707 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updated VIF entry in instance network info cache for port 22da36aa-5f45-4489-b1f1-1095d5d1b2b6. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:50:59 user nova-compute[74311]: DEBUG nova.network.neutron [req-b3b87c4b-8587-4295-bb21-b8aaa5823191 req-1c20afbb-49ef-4227-abe0-f774b2b13707 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updating instance_info_cache with network_info: [{"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:50:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b3b87c4b-8587-4295-bb21-b8aaa5823191 req-1c20afbb-49ef-4227-abe0-f774b2b13707 service nova] Releasing lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-395691c5-4dfa-49a3-9c70-712259696e18 req-5ecb46db-1587-40be-be34-a4f10e20cbfa service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-changed-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-395691c5-4dfa-49a3-9c70-712259696e18 req-5ecb46db-1587-40be-be34-a4f10e20cbfa service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Refreshing instance network info cache due to event network-changed-22da36aa-5f45-4489-b1f1-1095d5d1b2b6. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-395691c5-4dfa-49a3-9c70-712259696e18 req-5ecb46db-1587-40be-be34-a4f10e20cbfa service nova] Acquiring lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-395691c5-4dfa-49a3-9c70-712259696e18 req-5ecb46db-1587-40be-be34-a4f10e20cbfa service nova] Acquired lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG nova.network.neutron [req-395691c5-4dfa-49a3-9c70-712259696e18 req-5ecb46db-1587-40be-be34-a4f10e20cbfa service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Refreshing network info cache for port 22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG nova.network.neutron [req-395691c5-4dfa-49a3-9c70-712259696e18 req-5ecb46db-1587-40be-be34-a4f10e20cbfa service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updated VIF entry in instance network info cache for port 22da36aa-5f45-4489-b1f1-1095d5d1b2b6. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG nova.network.neutron [req-395691c5-4dfa-49a3-9c70-712259696e18 req-5ecb46db-1587-40be-be34-a4f10e20cbfa service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updating instance_info_cache with network_info: [{"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-395691c5-4dfa-49a3-9c70-712259696e18 req-5ecb46db-1587-40be-be34-a4f10e20cbfa service nova] Releasing lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5a6cc42-c356-4605-ab26-82cd3796651a tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5a6cc42-c356-4605-ab26-82cd3796651a tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:51:01 user nova-compute[74311]: INFO nova.compute.manager [None req-a5a6cc42-c356-4605-ab26-82cd3796651a tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Rebooting instance
Oct 20 10:51:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5a6cc42-c356-4605-ab26-82cd3796651a tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5a6cc42-c356-4605-ab26-82cd3796651a tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquired lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:51:01 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a5a6cc42-c356-4605-ab26-82cd3796651a tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Building network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 10:51:02 user nova-compute[74311]: DEBUG nova.network.neutron [None req-a5a6cc42-c356-4605-ab26-82cd3796651a tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updating instance_info_cache with network_info: [{"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:51:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5a6cc42-c356-4605-ab26-82cd3796651a tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Releasing lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:51:02 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a5a6cc42-c356-4605-ab26-82cd3796651a tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:51:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:04 user nova-compute[74311]: DEBUG nova.compute.manager [req-2a19952d-5099-4b59-bc90-e593472f9e2f req-0aa8df7a-681b-4974-9298-74cec68d164d service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-vif-unplugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:51:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2a19952d-5099-4b59-bc90-e593472f9e2f req-0aa8df7a-681b-4974-9298-74cec68d164d service nova] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:51:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2a19952d-5099-4b59-bc90-e593472f9e2f req-0aa8df7a-681b-4974-9298-74cec68d164d service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:51:04 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-2a19952d-5099-4b59-bc90-e593472f9e2f req-0aa8df7a-681b-4974-9298-74cec68d164d service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:51:04 user nova-compute[74311]: DEBUG nova.compute.manager [req-2a19952d-5099-4b59-bc90-e593472f9e2f req-0aa8df7a-681b-4974-9298-74cec68d164d service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] No waiting events found dispatching network-vif-unplugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:51:04 user nova-compute[74311]: WARNING nova.compute.manager [req-2a19952d-5099-4b59-bc90-e593472f9e2f req-0aa8df7a-681b-4974-9298-74cec68d164d service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received unexpected event network-vif-unplugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 for instance with vm_state active and task_state reboot_started.
Oct 20 10:51:05 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-a5a6cc42-c356-4605-ab26-82cd3796651a tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Instance shutdown successfully.
Oct 20 10:51:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:06 user nova-compute[74311]: DEBUG nova.compute.manager [req-b32b4fea-db28-4118-8f60-ba8b07016022 req-be4f4af9-75ba-4e06-873e-c2f23090c749 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:51:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b32b4fea-db28-4118-8f60-ba8b07016022 req-be4f4af9-75ba-4e06-873e-c2f23090c749 service nova] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:51:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b32b4fea-db28-4118-8f60-ba8b07016022 req-be4f4af9-75ba-4e06-873e-c2f23090c749 service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:51:06 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-b32b4fea-db28-4118-8f60-ba8b07016022 req-be4f4af9-75ba-4e06-873e-c2f23090c749 service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:51:06 user nova-compute[74311]: DEBUG nova.compute.manager [req-b32b4fea-db28-4118-8f60-ba8b07016022 req-be4f4af9-75ba-4e06-873e-c2f23090c749 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] No waiting events found dispatching network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:51:06 user nova-compute[74311]: WARNING nova.compute.manager [req-b32b4fea-db28-4118-8f60-ba8b07016022 req-be4f4af9-75ba-4e06-873e-c2f23090c749 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received unexpected event network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 for instance with vm_state active and task_state reboot_started.
Oct 20 10:51:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:08 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Instance running successfully.
Oct 20 10:51:08 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-a5a6cc42-c356-4605-ab26-82cd3796651a tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Instance soft rebooted successfully.
Oct 20 10:51:08 user nova-compute[74311]: DEBUG nova.compute.manager [None req-a5a6cc42-c356-4605-ab26-82cd3796651a tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Checking state {{(pid=74311) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 10:51:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-a5a6cc42-c356-4605-ab26-82cd3796651a tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.091s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:51:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8f75b19-ca93-4b02-a1f5-de2fd077439e req-a36cdd02-09d8-4dc7-b306-a4dbd401fa74 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:51:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8f75b19-ca93-4b02-a1f5-de2fd077439e req-a36cdd02-09d8-4dc7-b306-a4dbd401fa74 service nova] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:51:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8f75b19-ca93-4b02-a1f5-de2fd077439e req-a36cdd02-09d8-4dc7-b306-a4dbd401fa74 service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:51:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8f75b19-ca93-4b02-a1f5-de2fd077439e req-a36cdd02-09d8-4dc7-b306-a4dbd401fa74 service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:51:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8f75b19-ca93-4b02-a1f5-de2fd077439e req-a36cdd02-09d8-4dc7-b306-a4dbd401fa74 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] No waiting events found dispatching network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:51:08 user nova-compute[74311]: WARNING nova.compute.manager [req-a8f75b19-ca93-4b02-a1f5-de2fd077439e req-a36cdd02-09d8-4dc7-b306-a4dbd401fa74 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received unexpected event network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 for instance with vm_state active and task_state None.
Oct 20 10:51:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8f75b19-ca93-4b02-a1f5-de2fd077439e req-a36cdd02-09d8-4dc7-b306-a4dbd401fa74 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:51:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8f75b19-ca93-4b02-a1f5-de2fd077439e req-a36cdd02-09d8-4dc7-b306-a4dbd401fa74 service nova] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:51:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8f75b19-ca93-4b02-a1f5-de2fd077439e req-a36cdd02-09d8-4dc7-b306-a4dbd401fa74 service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:51:08 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-a8f75b19-ca93-4b02-a1f5-de2fd077439e req-a36cdd02-09d8-4dc7-b306-a4dbd401fa74 service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:51:08 user nova-compute[74311]: DEBUG nova.compute.manager [req-a8f75b19-ca93-4b02-a1f5-de2fd077439e req-a36cdd02-09d8-4dc7-b306-a4dbd401fa74 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] No waiting events found dispatching network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:51:08 user nova-compute[74311]: WARNING nova.compute.manager [req-a8f75b19-ca93-4b02-a1f5-de2fd077439e req-a36cdd02-09d8-4dc7-b306-a4dbd401fa74 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received unexpected event network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 for instance with vm_state active and task_state None.
Oct 20 10:51:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:21 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:51:21 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:51:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:51:21 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:51:21 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:51:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:51:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:51:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:51:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:51:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:22 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updating instance_info_cache with network_info: [{"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:51:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:51:22 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:51:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-f769aa25-e99c-49a8-9b2c-822c8326835d req-809f3e53-9737-417d-885c-008cf81c6745 service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Received event network-changed-63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:51:22 user nova-compute[74311]: DEBUG nova.compute.manager [req-f769aa25-e99c-49a8-9b2c-822c8326835d req-809f3e53-9737-417d-885c-008cf81c6745 service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Refreshing instance network info cache due to event network-changed-63fcbf99-332c-4e9a-a992-0b7f766cbb2f. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:51:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f769aa25-e99c-49a8-9b2c-822c8326835d req-809f3e53-9737-417d-885c-008cf81c6745 service nova] Acquiring lock "refresh_cache-f632820f-b394-426a-bc96-8896b3dece44" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:51:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f769aa25-e99c-49a8-9b2c-822c8326835d req-809f3e53-9737-417d-885c-008cf81c6745 service nova] Acquired lock "refresh_cache-f632820f-b394-426a-bc96-8896b3dece44" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:51:22 user nova-compute[74311]: DEBUG nova.network.neutron [req-f769aa25-e99c-49a8-9b2c-822c8326835d req-809f3e53-9737-417d-885c-008cf81c6745 service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Refreshing network info cache for port 63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:51:23 user nova-compute[74311]: DEBUG nova.network.neutron [req-f769aa25-e99c-49a8-9b2c-822c8326835d req-809f3e53-9737-417d-885c-008cf81c6745 service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Updated VIF entry in instance network info cache for port 63fcbf99-332c-4e9a-a992-0b7f766cbb2f. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:51:23 user nova-compute[74311]: DEBUG nova.network.neutron [req-f769aa25-e99c-49a8-9b2c-822c8326835d req-809f3e53-9737-417d-885c-008cf81c6745 service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Updating instance_info_cache with network_info: [{"id": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "address": "fa:16:3e:88:0a:b8", "network": {"id": "8acd9e99-ab1c-4abb-a951-406701ea04f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1291194185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ff3fe2f2247328c2febdb51e5acd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fcbf99-33", "ovs_interfaceid": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:51:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-f769aa25-e99c-49a8-9b2c-822c8326835d req-809f3e53-9737-417d-885c-008cf81c6745 service nova] Releasing lock "refresh_cache-f632820f-b394-426a-bc96-8896b3dece44" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:51:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:25 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:51:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:51:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "f632820f-b394-426a-bc96-8896b3dece44" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "f632820f-b394-426a-bc96-8896b3dece44" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG nova.objects.instance [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lazy-loading 'flavor' on Instance uuid f632820f-b394-426a-bc96-8896b3dece44 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "f632820f-b394-426a-bc96-8896b3dece44" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "f632820f-b394-426a-bc96-8896b3dece44" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "f632820f-b394-426a-bc96-8896b3dece44" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:51:30 user nova-compute[74311]: INFO nova.compute.manager [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Attaching volume 736182f5-b88e-43ee-b67f-63d709ec59a4 to /dev/vdb
Oct 20 10:51:30 user nova-compute[74311]: DEBUG os_brick.utils [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[371f8de5-7298-4069-a1fa-8b3f89008645]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:8f76396a5357\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6fc0f2-4ec8-4385-99d4-a813a87c502f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23e3e59-5e79-4b7e-bc29-dc8374916106]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[06023cb5-8c79-44c4-b2e1-042f7933a446]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Running cmd (subprocess): nvme version {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] 'nvme version' failed. Not Retrying. {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] nvme not present on system {{(pid=74311) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 10:51:30 user nova-compute[74311]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 10:51:30 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3f1049-03ae-404b-b44b-ca50a5181ee7]: (4, '') {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74311) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.lightos [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] LIGHTOS: no hostnqn found. {{(pid=74311) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG os_brick.utils [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:8f76396a5357', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:51:30 user nova-compute[74311]: DEBUG nova.virt.block_device [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Updating existing volume attachment record: 3bff4ff7-1262-4a13-8132-6af832ef30f1 {{(pid=74311) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 10:51:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:51:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:51:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:51:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:51:31 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:51:32 user nova-compute[74311]: INFO nova.compute.manager [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Terminating instance
Oct 20 10:51:32 user nova-compute[74311]: DEBUG nova.compute.manager [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-caad7a38-8092-4c29-bc98-76bb820433a5 req-feaa5835-a1b1-4059-9b50-de718afc627b service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Received event network-vif-unplugged-af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-caad7a38-8092-4c29-bc98-76bb820433a5 req-feaa5835-a1b1-4059-9b50-de718afc627b service nova] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-caad7a38-8092-4c29-bc98-76bb820433a5 req-feaa5835-a1b1-4059-9b50-de718afc627b service nova] Lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-caad7a38-8092-4c29-bc98-76bb820433a5 req-feaa5835-a1b1-4059-9b50-de718afc627b service nova] Lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-caad7a38-8092-4c29-bc98-76bb820433a5 req-feaa5835-a1b1-4059-9b50-de718afc627b service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] No waiting events found dispatching network-vif-unplugged-af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG nova.compute.manager [req-caad7a38-8092-4c29-bc98-76bb820433a5 req-feaa5835-a1b1-4059-9b50-de718afc627b service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Received event network-vif-unplugged-af3cce47-5348-449e-b5ca-c006515a379e for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Instance destroyed successfully.
Oct 20 10:51:32 user nova-compute[74311]: DEBUG nova.objects.instance [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lazy-loading 'resources' on Instance uuid bb318c53-c058-439c-86f5-35847ac9c90e {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1120232970',display_name='tempest-SnapshotDataIntegrityTests-server-1120232970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1120232970',id=47,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyzyHHG3N91FPN/pPYmouKQIMsBSdpw3RGR1W0TeYMksWvtAnnsRpFGrXuUpVLgXLSxrELIEvj5gx+/+igVfFNtZKFp5vGiJ73qXjd+fBt9vbZ2FgrTPFwzo6Hpa4ZuJA==',key_name='tempest-keypair-1907055845',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:42:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a090a44405c45ee9bcdd6a34c0173a9',ramdisk_id='',reservation_id='r-pwh0dttx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1924202967',owner_user_name='tempest-SnapshotDataIntegrityTests-1924202967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:42:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a420244b8ea475f91a9a5f27d652b5c',uuid=bb318c53-c058-439c-86f5-35847ac9c90e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af3cce47-5348-449e-b5ca-c006515a379e", "address": "fa:16:3e:56:4a:4d", "network": {"id": "fa57bf52-f1a0-4605-878e-a936f3c7e717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1036604684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a090a44405c45ee9bcdd6a34c0173a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cce47-53", "ovs_interfaceid": "af3cce47-5348-449e-b5ca-c006515a379e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Converting VIF {"id": "af3cce47-5348-449e-b5ca-c006515a379e", "address": "fa:16:3e:56:4a:4d", "network": {"id": "fa57bf52-f1a0-4605-878e-a936f3c7e717", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1036604684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a090a44405c45ee9bcdd6a34c0173a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3cce47-53", "ovs_interfaceid": "af3cce47-5348-449e-b5ca-c006515a379e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:4a:4d,bridge_name='br-int',has_traffic_filtering=True,id=af3cce47-5348-449e-b5ca-c006515a379e,network=Network(fa57bf52-f1a0-4605-878e-a936f3c7e717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3cce47-53') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG os_vif [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:4a:4d,bridge_name='br-int',has_traffic_filtering=True,id=af3cce47-5348-449e-b5ca-c006515a379e,network=Network(fa57bf52-f1a0-4605-878e-a936f3c7e717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3cce47-53') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf3cce47-53, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ea12c16-36d8-437d-b6fb-50e8fe060a77) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:32 user nova-compute[74311]: INFO os_vif [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:4a:4d,bridge_name='br-int',has_traffic_filtering=True,id=af3cce47-5348-449e-b5ca-c006515a379e,network=Network(fa57bf52-f1a0-4605-878e-a936f3c7e717),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3cce47-53')
Oct 20 10:51:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Deleting instance files /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e_del
Oct 20 10:51:32 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Deletion of /opt/stack/data/nova/instances/bb318c53-c058-439c-86f5-35847ac9c90e_del complete
Oct 20 10:51:32 user nova-compute[74311]: INFO nova.compute.manager [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 20 10:51:32 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:51:32 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:51:33 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:51:33 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Took 0.72 seconds to deallocate network for instance.
Oct 20 10:51:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:51:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:51:33 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:51:33 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:51:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:51:33 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Deleted allocations for instance bb318c53-c058-439c-86f5-35847ac9c90e
Oct 20 10:51:33 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-720d8d85-c5af-4ac5-b053-c2e4c8ede7c7 tempest-SnapshotDataIntegrityTests-1924202967 tempest-SnapshotDataIntegrityTests-1924202967-project-member] Lock "bb318c53-c058-439c-86f5-35847ac9c90e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.988s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:51:34 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:51:34 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:51:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-dde5059c-b022-497a-a453-22aa64a7cee9 req-c5b037fa-9908-411a-872a-d5f40c5e2927 service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Received event network-vif-plugged-af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:51:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-dde5059c-b022-497a-a453-22aa64a7cee9 req-c5b037fa-9908-411a-872a-d5f40c5e2927 service nova] Acquiring lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:51:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-dde5059c-b022-497a-a453-22aa64a7cee9 req-c5b037fa-9908-411a-872a-d5f40c5e2927 service nova] Lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:51:34 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-dde5059c-b022-497a-a453-22aa64a7cee9 req-c5b037fa-9908-411a-872a-d5f40c5e2927 service nova] Lock "bb318c53-c058-439c-86f5-35847ac9c90e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:51:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-dde5059c-b022-497a-a453-22aa64a7cee9 req-c5b037fa-9908-411a-872a-d5f40c5e2927 service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] No waiting events found dispatching network-vif-plugged-af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:51:34 user nova-compute[74311]: WARNING nova.compute.manager [req-dde5059c-b022-497a-a453-22aa64a7cee9 req-c5b037fa-9908-411a-872a-d5f40c5e2927 service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Received unexpected event network-vif-plugged-af3cce47-5348-449e-b5ca-c006515a379e for instance with vm_state deleted and task_state None.
Oct 20 10:51:34 user nova-compute[74311]: DEBUG nova.compute.manager [req-dde5059c-b022-497a-a453-22aa64a7cee9 req-c5b037fa-9908-411a-872a-d5f40c5e2927 service nova] [instance: bb318c53-c058-439c-86f5-35847ac9c90e] Received event network-vif-deleted-af3cce47-5348-449e-b5ca-c006515a379e {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:51:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:36 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:51:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:39 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:40 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:51:40 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:51:40 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8633MB free_disk=25.028942108154297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:51:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:51:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:51:40 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance f89bf3f8-7ecc-4ada-af50-6585c11bb303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:51:40 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance f632820f-b394-426a-bc96-8896b3dece44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:51:40 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:51:40 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:51:40 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:51:40 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:51:40 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:51:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:51:41 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:51:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:43 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:44 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:51:44 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:51:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:51:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:51:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:51:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:51:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:56 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Calling os-brick to attach iSCSI Volume {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 10:51:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgQyxpzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:51:56 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:51:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:51:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:51:56 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:51:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:51:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:51:56 user nova-compute[74311]: INFO os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 10:51:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:56 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e823b551-6cdd-43e3-a52d-b4a0f19838f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 10:51:56 user nova-compute[74311]:  {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:51:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:56 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f488f263-f075-4c3b-a237-e7c9d4d492f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4] added\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:56 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4] added
Oct 20 10:51:56 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:51:56 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79cad99-68be-4437-92e9-d5269097ec8f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9388d94-f6ab-407c-810e-f469353ddc86]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgQyxpzU {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgQyxpzU" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e4cd83-4ddd-471f-8d1d-ae19158c48c5]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IgQyxpzU'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a897836f-fe3a-4953-8494-bee9e7fc1f1a]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[08614f9d-fed7-499f-8e32-b747625efbef]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)
Oct 20 10:51:57 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)
Oct 20 10:51:57 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --login {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[56170952-a3d4-4639-9e6b-19a4fe8b9144]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4, portal: 172.16.0.220,3260]
Oct 20 10:51:57 user nova-compute[74311]: Login to [iface: default, target: iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4, portal: 172.16.0.220,3260] successful.
Oct 20 10:51:57 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1603440f-de82-405f-9150-6011a154f7f7]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd4a94c-3224-4843-a200-97b34ee6c131]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)
Oct 20 10:51:57 user nova-compute[74311]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 (non-flash)
Oct 20 10:51:57 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)
Oct 20 10:51:57 user nova-compute[74311]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 (non-flash)
Oct 20 10:51:57 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Connected to 172.16.0.220:3260 {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=74311) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74311) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a16ef7-4f6a-4463-9f05-fbfc17ea4ab0]: (4, ('- - 0', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:51:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:51:58 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74311) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 10:51:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgQyxpzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74311) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 10:51:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:51:58 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23733376132303864', 'path': '/dev/sdc'} {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:51:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733376132303864', 'path': '/dev/sdc'} {{(pid=74311) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 10:51:58 user nova-compute[74311]: DEBUG nova.objects.instance [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lazy-loading 'flavor' on Instance uuid f632820f-b394-426a-bc96-8896b3dece44 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:51:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 10:51:58 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:51:58 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:51:58 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:51:58 user nova-compute[74311]:   <serial>736182f5-b88e-43ee-b67f-63d709ec59a4</serial>
Oct 20 10:51:58 user nova-compute[74311]: </disk>
Oct 20 10:51:58 user nova-compute[74311]:  {{(pid=74311) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 10:51:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] No BDM found with device name vda, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:51:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74311) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 10:51:58 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] No VIF found with MAC fa:16:3e:88:0a:b8, not building metadata {{(pid=74311) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 10:51:59 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-ca4200dc-fba9-4202-8f35-4defb557f454 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "f632820f-b394-426a-bc96-8896b3dece44" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.344s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:52:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "f632820f-b394-426a-bc96-8896b3dece44" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:52:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "f632820f-b394-426a-bc96-8896b3dece44" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:52:00 user nova-compute[74311]: INFO nova.compute.manager [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Detaching volume 736182f5-b88e-43ee-b67f-63d709ec59a4
Oct 20 10:52:00 user nova-compute[74311]: INFO nova.virt.block_device [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Attempting to driver detach volume 736182f5-b88e-43ee-b67f-63d709ec59a4 from mountpoint /dev/vdb
Oct 20 10:52:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Attempting to detach device vdb from instance f632820f-b394-426a-bc96-8896b3dece44 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:52:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:52:00 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:52:00 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:52:00 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:52:00 user nova-compute[74311]:   <serial>736182f5-b88e-43ee-b67f-63d709ec59a4</serial>
Oct 20 10:52:00 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:52:00 user nova-compute[74311]: </disk>
Oct 20 10:52:00 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:52:00 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Successfully detached device vdb from instance f632820f-b394-426a-bc96-8896b3dece44 from the persistent domain config.
Oct 20 10:52:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f632820f-b394-426a-bc96-8896b3dece44 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:52:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:52:00 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:52:00 user nova-compute[74311]:   <source dev="/dev/sdc"/>
Oct 20 10:52:00 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:52:00 user nova-compute[74311]:   <serial>736182f5-b88e-43ee-b67f-63d709ec59a4</serial>
Oct 20 10:52:00 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:52:00 user nova-compute[74311]: </disk>
Oct 20 10:52:00 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:52:00 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f632820f-b394-426a-bc96-8896b3dece44 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:52:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:52:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:52:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:52:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:52:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:52:02 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:52:07 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:52:12 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:52:17 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:52:20 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f632820f-b394-426a-bc96-8896b3dece44 is timed out.
Oct 20 10:52:20 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Successfully detached device vdb from instance f632820f-b394-426a-bc96-8896b3dece44 from the live domain config.
Oct 20 10:52:20 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgQyxpzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:52:20 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:52:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[a666ea71-f518-45f9-9ef9-57112f27671a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:52:20 user nova-compute[74311]: No targets found.
Oct 20 10:52:20 user nova-compute[74311]: iSNS:
Oct 20 10:52:20 user nova-compute[74311]: No targets found.
Oct 20 10:52:20 user nova-compute[74311]: STATIC:
Oct 20 10:52:20 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713
Oct 20 10:52:20 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:52:20 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:52:20 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4
Oct 20 10:52:20 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:52:20 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:52:20 user nova-compute[74311]: FIRMWARE:
Oct 20 10:52:20 user nova-compute[74311]: No targets found.
Oct 20 10:52:20 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:52:20 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:52:20 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7309ed-a2af-4abf-ab89-d275d66050d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[807cffa3-5c2e-4bf4-854e-5feb0be85a52]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)
Oct 20 10:52:20 user nova-compute[74311]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 (non-flash)
Oct 20 10:52:20 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)
Oct 20 10:52:20 user nova-compute[74311]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 (non-flash)
Oct 20 10:52:20 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb164b364d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4'): ({'sdc'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Removing single pathed devices sdc {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:52:20 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[637c90e3-d9e6-42b7-b734-e0b4acd058a8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c3db08-2dd5-43e6-a3d3-bcf7040cbd45]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Flushing IO for device /dev/sdc {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[37faf6b9-e601-4361-8fdf-e3d2c1832ca9]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c92520c-ec13-4174-b848-75fb5f2cd64f]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] SCSI volumes sdc have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9ea59d-09e3-450a-b9df-17078c0512e4]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb48e739-fa5d-4fd3-b0d3-5d39c6582cbd]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4, portal: 172.16.0.220,3260]
Oct 20 10:52:21 user nova-compute[74311]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4, portal: 172.16.0.220,3260] successful.
Oct 20 10:52:21 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:736182f5-b88e-43ee-b67f-63d709ec59a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e398aa-ae12-4559-87fd-b6def1ea6e7f]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] <== disconnect_volume: return (334ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:52:21 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:52:22 user nova-compute[74311]: DEBUG nova.objects.instance [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lazy-loading 'flavor' on Instance uuid f632820f-b394-426a-bc96-8896b3dece44 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:52:22 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-2906bbf2-5402-478b-b13a-66ea51bdc86c tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "f632820f-b394-426a-bc96-8896b3dece44" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.045s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:52:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:52:22 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:52:23 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:52:23 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:52:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-f632820f-b394-426a-bc96-8896b3dece44" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:52:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-f632820f-b394-426a-bc96-8896b3dece44" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:52:23 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: f632820f-b394-426a-bc96-8896b3dece44] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:52:23 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: f632820f-b394-426a-bc96-8896b3dece44] Updating instance_info_cache with network_info: [{"id": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "address": "fa:16:3e:88:0a:b8", "network": {"id": "8acd9e99-ab1c-4abb-a951-406701ea04f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1291194185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ff3fe2f2247328c2febdb51e5acd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fcbf99-33", "ovs_interfaceid": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:52:23 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-f632820f-b394-426a-bc96-8896b3dece44" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:52:23 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: f632820f-b394-426a-bc96-8896b3dece44] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:52:25 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:52:25 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:52:27 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:52:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:52:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:52:32 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:52:35 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:52:36 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:52:36 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:52:37 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:52:40 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:52:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:52:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:52:40 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:52:40 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:52:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:52:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:52:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:52:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:52:40 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74311) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 10:52:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:52:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:52:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:52:40 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:52:41 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:52:41 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:52:41 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=25.025527954101562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:52:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:52:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:52:41 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance f89bf3f8-7ecc-4ada-af50-6585c11bb303 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:52:41 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance f632820f-b394-426a-bc96-8896b3dece44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:52:41 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:52:41 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:52:41 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:52:41 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:52:41 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:52:41 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:52:42 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:52:43 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:52:44 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:52:44 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:52:45 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:52:47 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:52:52 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:52:53 user nova-compute[74311]: DEBUG nova.compute.manager [req-e620b5ab-89df-4426-adf6-750d99d20dbf req-3d87bd4a-46a6-4186-98f9-9f496670c735 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-changed-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:52:53 user nova-compute[74311]: DEBUG nova.compute.manager [req-e620b5ab-89df-4426-adf6-750d99d20dbf req-3d87bd4a-46a6-4186-98f9-9f496670c735 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Refreshing instance network info cache due to event network-changed-22da36aa-5f45-4489-b1f1-1095d5d1b2b6. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:52:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e620b5ab-89df-4426-adf6-750d99d20dbf req-3d87bd4a-46a6-4186-98f9-9f496670c735 service nova] Acquiring lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:52:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e620b5ab-89df-4426-adf6-750d99d20dbf req-3d87bd4a-46a6-4186-98f9-9f496670c735 service nova] Acquired lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:52:53 user nova-compute[74311]: DEBUG nova.network.neutron [req-e620b5ab-89df-4426-adf6-750d99d20dbf req-3d87bd4a-46a6-4186-98f9-9f496670c735 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Refreshing network info cache for port 22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG nova.network.neutron [req-e620b5ab-89df-4426-adf6-750d99d20dbf req-3d87bd4a-46a6-4186-98f9-9f496670c735 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updated VIF entry in instance network info cache for port 22da36aa-5f45-4489-b1f1-1095d5d1b2b6. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG nova.network.neutron [req-e620b5ab-89df-4426-adf6-750d99d20dbf req-3d87bd4a-46a6-4186-98f9-9f496670c735 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updating instance_info_cache with network_info: [{"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e620b5ab-89df-4426-adf6-750d99d20dbf req-3d87bd4a-46a6-4186-98f9-9f496670c735 service nova] Releasing lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-3ce2a481-d9e9-40fb-9c15-36f95add699c req-89f92d95-efc0-4766-98b7-058b4e499a98 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-changed-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-3ce2a481-d9e9-40fb-9c15-36f95add699c req-89f92d95-efc0-4766-98b7-058b4e499a98 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Refreshing instance network info cache due to event network-changed-22da36aa-5f45-4489-b1f1-1095d5d1b2b6. {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3ce2a481-d9e9-40fb-9c15-36f95add699c req-89f92d95-efc0-4766-98b7-058b4e499a98 service nova] Acquiring lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3ce2a481-d9e9-40fb-9c15-36f95add699c req-89f92d95-efc0-4766-98b7-058b4e499a98 service nova] Acquired lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG nova.network.neutron [req-3ce2a481-d9e9-40fb-9c15-36f95add699c req-89f92d95-efc0-4766-98b7-058b4e499a98 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Refreshing network info cache for port 22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:52:54 user nova-compute[74311]: INFO nova.compute.manager [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Detaching volume 506849cd-226c-4225-b881-eb169884a713
Oct 20 10:52:54 user nova-compute[74311]: INFO nova.virt.block_device [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Attempting to driver detach volume 506849cd-226c-4225-b881-eb169884a713 from mountpoint /dev/vdb
Oct 20 10:52:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Attempting to detach device vdb from instance f89bf3f8-7ecc-4ada-af50-6585c11bb303 from the persistent domain config. {{(pid=74311) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:52:54 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:52:54 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:52:54 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:52:54 user nova-compute[74311]:   <serial>506849cd-226c-4225-b881-eb169884a713</serial>
Oct 20 10:52:54 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:52:54 user nova-compute[74311]: </disk>
Oct 20 10:52:54 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:52:54 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Successfully detached device vdb from instance f89bf3f8-7ecc-4ada-af50-6585c11bb303 from the persistent domain config.
Oct 20 10:52:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f89bf3f8-7ecc-4ada-af50-6585c11bb303 from the live domain config. {{(pid=74311) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.guest [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 10:52:54 user nova-compute[74311]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 10:52:54 user nova-compute[74311]:   <source dev="/dev/sdb"/>
Oct 20 10:52:54 user nova-compute[74311]:   <target dev="vdb" bus="virtio"/>
Oct 20 10:52:54 user nova-compute[74311]:   <serial>506849cd-226c-4225-b881-eb169884a713</serial>
Oct 20 10:52:54 user nova-compute[74311]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 10:52:54 user nova-compute[74311]: </disk>
Oct 20 10:52:54 user nova-compute[74311]:  {{(pid=74311) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG nova.network.neutron [req-3ce2a481-d9e9-40fb-9c15-36f95add699c req-89f92d95-efc0-4766-98b7-058b4e499a98 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updated VIF entry in instance network info cache for port 22da36aa-5f45-4489-b1f1-1095d5d1b2b6. {{(pid=74311) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 10:52:54 user nova-compute[74311]: DEBUG nova.network.neutron [req-3ce2a481-d9e9-40fb-9c15-36f95add699c req-89f92d95-efc0-4766-98b7-058b4e499a98 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updating instance_info_cache with network_info: [{"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:52:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-3ce2a481-d9e9-40fb-9c15-36f95add699c req-89f92d95-efc0-4766-98b7-058b4e499a98 service nova] Releasing lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:52:55 user nova-compute[74311]: DEBUG nova.virt.libvirt.driver [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f89bf3f8-7ecc-4ada-af50-6585c11bb303 {{(pid=74311) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 10:52:57 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "f632820f-b394-426a-bc96-8896b3dece44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "f632820f-b394-426a-bc96-8896b3dece44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "f632820f-b394-426a-bc96-8896b3dece44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "f632820f-b394-426a-bc96-8896b3dece44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "f632820f-b394-426a-bc96-8896b3dece44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:53:00 user nova-compute[74311]: INFO nova.compute.manager [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Terminating instance
Oct 20 10:53:00 user nova-compute[74311]: DEBUG nova.compute.manager [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-137b5465-97ba-40d8-a238-8139075a380b req-91face3c-c44a-4a90-b426-c9b3215597ff service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Received event network-vif-unplugged-63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-137b5465-97ba-40d8-a238-8139075a380b req-91face3c-c44a-4a90-b426-c9b3215597ff service nova] Acquiring lock "f632820f-b394-426a-bc96-8896b3dece44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-137b5465-97ba-40d8-a238-8139075a380b req-91face3c-c44a-4a90-b426-c9b3215597ff service nova] Lock "f632820f-b394-426a-bc96-8896b3dece44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-137b5465-97ba-40d8-a238-8139075a380b req-91face3c-c44a-4a90-b426-c9b3215597ff service nova] Lock "f632820f-b394-426a-bc96-8896b3dece44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-137b5465-97ba-40d8-a238-8139075a380b req-91face3c-c44a-4a90-b426-c9b3215597ff service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] No waiting events found dispatching network-vif-unplugged-63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:53:00 user nova-compute[74311]: DEBUG nova.compute.manager [req-137b5465-97ba-40d8-a238-8139075a380b req-91face3c-c44a-4a90-b426-c9b3215597ff service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Received event network-vif-unplugged-63fcbf99-332c-4e9a-a992-0b7f766cbb2f for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:53:01 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: f632820f-b394-426a-bc96-8896b3dece44] Instance destroyed successfully.
Oct 20 10:53:01 user nova-compute[74311]: DEBUG nova.objects.instance [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lazy-loading 'resources' on Instance uuid f632820f-b394-426a-bc96-8896b3dece44 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:49:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-473149571',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-473149571',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4731495',id=52,image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5wAsBh9M1QcLzc/0I4HZMAh/U07TITj/gt+IOo9ZJ3olCthPaW8WeoOpgLiDK+sEEKFVRevaPS3E6yPFbT0tW0ZBrREOXl77DZc6IbwblzsjMa5WZwrOLwums4+iWUcw==',key_name='tempest-keypair-105537298',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c00ff3fe2f2247328c2febdb51e5acd4',ramdisk_id='',reservation_id='r-gn3nxepy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4f3d42e3-c7f8-42b1-ac0c-9548c9d64daa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1157924576',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec258f753038417199ffa329b865519a',uuid=f632820f-b394-426a-bc96-8896b3dece44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "address": "fa:16:3e:88:0a:b8", "network": {"id": "8acd9e99-ab1c-4abb-a951-406701ea04f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1291194185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ff3fe2f2247328c2febdb51e5acd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fcbf99-33", "ovs_interfaceid": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Converting VIF {"id": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "address": "fa:16:3e:88:0a:b8", "network": {"id": "8acd9e99-ab1c-4abb-a951-406701ea04f9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1291194185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00ff3fe2f2247328c2febdb51e5acd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63fcbf99-33", "ovs_interfaceid": "63fcbf99-332c-4e9a-a992-0b7f766cbb2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:0a:b8,bridge_name='br-int',has_traffic_filtering=True,id=63fcbf99-332c-4e9a-a992-0b7f766cbb2f,network=Network(8acd9e99-ab1c-4abb-a951-406701ea04f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fcbf99-33') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG os_vif [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:0a:b8,bridge_name='br-int',has_traffic_filtering=True,id=63fcbf99-332c-4e9a-a992-0b7f766cbb2f,network=Network(8acd9e99-ab1c-4abb-a951-406701ea04f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fcbf99-33') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63fcbf99-33, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=978396c2-f68b-4a9c-b8aa-69d3947b93c0) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:53:01 user nova-compute[74311]: INFO os_vif [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:0a:b8,bridge_name='br-int',has_traffic_filtering=True,id=63fcbf99-332c-4e9a-a992-0b7f766cbb2f,network=Network(8acd9e99-ab1c-4abb-a951-406701ea04f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63fcbf99-33')
Oct 20 10:53:01 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Deleting instance files /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44_del
Oct 20 10:53:01 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Deletion of /opt/stack/data/nova/instances/f632820f-b394-426a-bc96-8896b3dece44_del complete
Oct 20 10:53:01 user nova-compute[74311]: INFO nova.compute.manager [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] [instance: f632820f-b394-426a-bc96-8896b3dece44] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 20 10:53:01 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: f632820f-b394-426a-bc96-8896b3dece44] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: f632820f-b394-426a-bc96-8896b3dece44] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: f632820f-b394-426a-bc96-8896b3dece44] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:53:01 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: f632820f-b394-426a-bc96-8896b3dece44] Took 0.71 seconds to deallocate network for instance.
Oct 20 10:53:01 user nova-compute[74311]: DEBUG nova.compute.manager [req-98dc78cc-118e-425a-9d6d-ef28b8d1d12a req-2820304c-e4e3-461a-a7ff-d2942a175262 service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Received event network-vif-deleted-63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:53:01 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:53:02 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:53:02 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:53:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:53:02 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Deleted allocations for instance f632820f-b394-426a-bc96-8896b3dece44
Oct 20 10:53:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-8920db14-0280-4f2a-9c67-10cc395276aa tempest-TestServerVolumeAttachScenarioOldVersion-1157924576 tempest-TestServerVolumeAttachScenarioOldVersion-1157924576-project-member] Lock "f632820f-b394-426a-bc96-8896b3dece44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.961s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:53:02 user nova-compute[74311]: DEBUG nova.compute.manager [req-e3032f59-b446-4408-8952-e5757d07b8da req-797e83a5-dec3-42c7-a268-fae74763373d service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Received event network-vif-plugged-63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:53:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e3032f59-b446-4408-8952-e5757d07b8da req-797e83a5-dec3-42c7-a268-fae74763373d service nova] Acquiring lock "f632820f-b394-426a-bc96-8896b3dece44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:53:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e3032f59-b446-4408-8952-e5757d07b8da req-797e83a5-dec3-42c7-a268-fae74763373d service nova] Lock "f632820f-b394-426a-bc96-8896b3dece44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:53:02 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-e3032f59-b446-4408-8952-e5757d07b8da req-797e83a5-dec3-42c7-a268-fae74763373d service nova] Lock "f632820f-b394-426a-bc96-8896b3dece44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:53:02 user nova-compute[74311]: DEBUG nova.compute.manager [req-e3032f59-b446-4408-8952-e5757d07b8da req-797e83a5-dec3-42c7-a268-fae74763373d service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] No waiting events found dispatching network-vif-plugged-63fcbf99-332c-4e9a-a992-0b7f766cbb2f {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:53:02 user nova-compute[74311]: WARNING nova.compute.manager [req-e3032f59-b446-4408-8952-e5757d07b8da req-797e83a5-dec3-42c7-a268-fae74763373d service nova] [instance: f632820f-b394-426a-bc96-8896b3dece44] Received unexpected event network-vif-plugged-63fcbf99-332c-4e9a-a992-0b7f766cbb2f for instance with vm_state deleted and task_state None.
Oct 20 10:53:06 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:53:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:53:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:53:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:53:11 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:15 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f89bf3f8-7ecc-4ada-af50-6585c11bb303 is timed out.
Oct 20 10:53:15 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Successfully detached device vdb from instance f89bf3f8-7ecc-4ada-af50-6585c11bb303 from the live domain config.
Oct 20 10:53:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] calling os-brick to detach iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb18864dd80>, {'target_iqn': 'iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GyWvdAzP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 10:53:15 user nova-compute[74311]: WARNING os_brick.initiator.connectors.base [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc478931-aae9-47ff-a332-e9778abb5e26]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 10:53:15 user nova-compute[74311]: No targets found.
Oct 20 10:53:15 user nova-compute[74311]: iSNS:
Oct 20 10:53:15 user nova-compute[74311]: No targets found.
Oct 20 10:53:15 user nova-compute[74311]: STATIC:
Oct 20 10:53:15 user nova-compute[74311]: Target: iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713
Oct 20 10:53:15 user nova-compute[74311]:         Portal: 172.16.0.220:3260,-1
Oct 20 10:53:15 user nova-compute[74311]:                 Iface Name: default
Oct 20 10:53:15 user nova-compute[74311]: FIRMWARE:
Oct 20 10:53:15 user nova-compute[74311]: No targets found.
Oct 20 10:53:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 10:53:15 user nova-compute[74311]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 10:53:15 user nova-compute[74311]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74311) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713', 0)] {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d254827d-7445-4100-b944-e8d7652e93ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[4098542f-37e5-4a61-8667-7681560df904]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)
Oct 20 10:53:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 (non-flash)
Oct 20 10:53:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb1a831d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713'): ({'sdb'}, set())}) {{(pid=74311) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Removing single pathed devices sdb {{(pid=74311) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8a187a-31f4-4880-98f6-ff27e6fd359a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[9880c094-c106-4b67-85bf-aa00bac95425]: (4, ('ok\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Flushing IO for device /dev/sdb {{(pid=74311) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a09addc-bfaf-4754-ad63-b596d2f868a2]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74311) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a720ee-273a-46aa-a9bf-cdf65faff6e0]: (4, ('1', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.linuxscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] SCSI volumes sdb have been removed. {{(pid=74311) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713')] {{(pid=74311) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ba0c78-71e0-4b2e-bea4-1894a2580d68]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --logout {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[14352cf1-ff80-4e08-819b-ad3c99666d24]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713, portal: 172.16.0.220,3260]
Oct 20 10:53:15 user nova-compute[74311]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713, portal: 172.16.0.220,3260] successful.
Oct 20 10:53:15 user nova-compute[74311]:  stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --op delete {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:506849cd-226c-4225-b881-eb169884a713 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85589) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d4d433-37b9-4f68-88fe-9ef6bc4b3420]: (4, ('', '')) {{(pid=85589) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74311) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.base [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] <== disconnect_volume: return (266ms) None {{(pid=74311) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 10:53:15 user nova-compute[74311]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Disconnected iSCSI Volume {{(pid=74311) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 10:53:16 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:16 user nova-compute[74311]: DEBUG nova.objects.instance [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'flavor' on Instance uuid f89bf3f8-7ecc-4ada-af50-6585c11bb303 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:53:16 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-9c521b4e-c86b-459e-b9e4-b4758f1a713f tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.686s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:53:21 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:53:25 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:53:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:53:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:53:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 10:53:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquired lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 10:53:25 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Forcefully refreshing network info cache for instance {{(pid=74311) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 10:53:25 user nova-compute[74311]: DEBUG nova.objects.instance [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lazy-loading 'info_cache' on Instance uuid f89bf3f8-7ecc-4ada-af50-6585c11bb303 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:53:25 user nova-compute[74311]: DEBUG nova.network.neutron [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updating instance_info_cache with network_info: [{"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:53:25 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Releasing lock "refresh_cache-f89bf3f8-7ecc-4ada-af50-6585c11bb303" {{(pid=74311) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 10:53:25 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updated the network info_cache for instance {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 10:53:26 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:53:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:53:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:53:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:53:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:53:26 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:53:31 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:53:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:53:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:53:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:53:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:53:36 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:37 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:53:38 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:53:38 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:53:41 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:53:42 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:53:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:53:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:53:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:53:42 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:53:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:53:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:53:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 10:53:42 user nova-compute[74311]: DEBUG oslo_concurrency.processutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74311) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 10:53:42 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:53:42 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:53:42 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=25.05202865600586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:53:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:53:42 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:53:43 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Instance f89bf3f8-7ecc-4ada-af50-6585c11bb303 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74311) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 10:53:43 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:53:43 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:53:43 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing inventories for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 10:53:43 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Updating ProviderTree inventory for provider 77cac819-3c22-4fec-a59d-0525ac40a90b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 10:53:43 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Updating inventory in ProviderTree for provider 77cac819-3c22-4fec-a59d-0525ac40a90b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 10:53:43 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing aggregate associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, aggregates: None {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 10:53:43 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Refreshing trait associations for resource provider 77cac819-3c22-4fec-a59d-0525ac40a90b, traits: COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3 {{(pid=74311) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 10:53:43 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:53:43 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:53:43 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:53:43 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:53:44 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:53:44 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:53:44 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:53:44 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:53:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:53:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:53:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:53:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:53:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:53:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:53:51 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:53:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:53:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:53:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:53:53 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:53:53 user nova-compute[74311]: INFO nova.compute.manager [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Terminating instance
Oct 20 10:53:53 user nova-compute[74311]: DEBUG nova.compute.manager [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Start destroying the instance on the hypervisor. {{(pid=74311) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 10:53:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:53 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-6fc668fa-47d7-4b06-b7ee-28a2547b0524 req-09fb0ba7-f6e7-4db2-9224-6a1a209c0967 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-vif-unplugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6fc668fa-47d7-4b06-b7ee-28a2547b0524 req-09fb0ba7-f6e7-4db2-9224-6a1a209c0967 service nova] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6fc668fa-47d7-4b06-b7ee-28a2547b0524 req-09fb0ba7-f6e7-4db2-9224-6a1a209c0967 service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-6fc668fa-47d7-4b06-b7ee-28a2547b0524 req-09fb0ba7-f6e7-4db2-9224-6a1a209c0967 service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-6fc668fa-47d7-4b06-b7ee-28a2547b0524 req-09fb0ba7-f6e7-4db2-9224-6a1a209c0967 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] No waiting events found dispatching network-vif-unplugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG nova.compute.manager [req-6fc668fa-47d7-4b06-b7ee-28a2547b0524 req-09fb0ba7-f6e7-4db2-9224-6a1a209c0967 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-vif-unplugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 for instance with task_state deleting. {{(pid=74311) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 10:53:54 user nova-compute[74311]: INFO nova.virt.libvirt.driver [-] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Instance destroyed successfully.
Oct 20 10:53:54 user nova-compute[74311]: DEBUG nova.objects.instance [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lazy-loading 'resources' on Instance uuid f89bf3f8-7ecc-4ada-af50-6585c11bb303 {{(pid=74311) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG nova.virt.libvirt.vif [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T10:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1566596305',display_name='tempest-TestMinimumBasicScenario-server-1566596305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1566596305',id=51,image_ref='1c864e1a-a318-427c-95fd-071b761913ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeE7i/E7FINN1QylH7HdB6tuCExyhgxrSFkTEPyrT0tzgZAQUN0iHOqAzwgmXOOkwj2AsckrueD88jJIHcHfZ25+OAGEpjIzG9zC04WkE/bICe7AWsBEXo9pQoBuyUL+A==',key_name='tempest-TestMinimumBasicScenario-877989772',keypairs=<?>,launch_index=0,launched_at=2023-10-20T10:48:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b78bfc1cd59d4be3b98ddad43a8d3002',ramdisk_id='',reservation_id='r-fql4oj3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1c864e1a-a318-427c-95fd-071b761913ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1072164048',owner_user_name='tempest-TestMinimumBasicScenario-1072164048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T10:51:09Z,user_data=None,user_id='24c8f83400ef489e88a4f719e301b284',uuid=f89bf3f8-7ecc-4ada-af50-6585c11bb303,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converting VIF {"id": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "address": "fa:16:3e:d8:69:b6", "network": {"id": "0996c7b3-d036-4536-b0b2-c95169f58809", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-331723939-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b78bfc1cd59d4be3b98ddad43a8d3002", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22da36aa-5f", "ovs_interfaceid": "22da36aa-5f45-4489-b1f1-1095d5d1b2b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG nova.network.os_vif_util [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:69:b6,bridge_name='br-int',has_traffic_filtering=True,id=22da36aa-5f45-4489-b1f1-1095d5d1b2b6,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22da36aa-5f') {{(pid=74311) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG os_vif [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:69:b6,bridge_name='br-int',has_traffic_filtering=True,id=22da36aa-5f45-4489-b1f1-1095d5d1b2b6,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22da36aa-5f') {{(pid=74311) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22da36aa-5f, bridge=br-int, if_exists=True) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46642005-1b10-47d0-88a9-169953ffd538) {{(pid=74311) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:53:54 user nova-compute[74311]: INFO os_vif [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:69:b6,bridge_name='br-int',has_traffic_filtering=True,id=22da36aa-5f45-4489-b1f1-1095d5d1b2b6,network=Network(0996c7b3-d036-4536-b0b2-c95169f58809),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22da36aa-5f')
Oct 20 10:53:54 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Deleting instance files /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303_del
Oct 20 10:53:54 user nova-compute[74311]: INFO nova.virt.libvirt.driver [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Deletion of /opt/stack/data/nova/instances/f89bf3f8-7ecc-4ada-af50-6585c11bb303_del complete
Oct 20 10:53:54 user nova-compute[74311]: INFO nova.compute.manager [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 20 10:53:54 user nova-compute[74311]: DEBUG oslo.service.loopingcall [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74311) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG nova.compute.manager [-] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Deallocating network for instance {{(pid=74311) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 10:53:54 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] deallocate_for_instance() {{(pid=74311) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 10:53:55 user nova-compute[74311]: DEBUG nova.network.neutron [-] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Updating instance_info_cache with network_info: [] {{(pid=74311) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 10:53:55 user nova-compute[74311]: INFO nova.compute.manager [-] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Took 0.46 seconds to deallocate network for instance.
Oct 20 10:53:55 user nova-compute[74311]: DEBUG nova.compute.manager [req-9f9d0c64-99ab-497e-ae62-231107a91427 req-9840fec8-f2c6-4a57-9b47-f7a88236cafe service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-vif-deleted-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:53:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:53:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:53:55 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:53:55 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:53:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:53:55 user nova-compute[74311]: INFO nova.scheduler.client.report [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Deleted allocations for instance f89bf3f8-7ecc-4ada-af50-6585c11bb303
Oct 20 10:53:55 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-4c20288d-c37a-4443-ad7a-193ea9825449 tempest-TestMinimumBasicScenario-1072164048 tempest-TestMinimumBasicScenario-1072164048-project-member] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.727s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:53:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-712c50e2-82c8-46b6-8a20-d989fdd109ed req-0ed5b7f7-9ecf-43c1-bedb-e53b1d39a930 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received event network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 10:53:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-712c50e2-82c8-46b6-8a20-d989fdd109ed req-0ed5b7f7-9ecf-43c1-bedb-e53b1d39a930 service nova] Acquiring lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:53:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-712c50e2-82c8-46b6-8a20-d989fdd109ed req-0ed5b7f7-9ecf-43c1-bedb-e53b1d39a930 service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:53:56 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [req-712c50e2-82c8-46b6-8a20-d989fdd109ed req-0ed5b7f7-9ecf-43c1-bedb-e53b1d39a930 service nova] Lock "f89bf3f8-7ecc-4ada-af50-6585c11bb303-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:53:56 user nova-compute[74311]: DEBUG nova.compute.manager [req-712c50e2-82c8-46b6-8a20-d989fdd109ed req-0ed5b7f7-9ecf-43c1-bedb-e53b1d39a930 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] No waiting events found dispatching network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 {{(pid=74311) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 10:53:56 user nova-compute[74311]: WARNING nova.compute.manager [req-712c50e2-82c8-46b6-8a20-d989fdd109ed req-0ed5b7f7-9ecf-43c1-bedb-e53b1d39a930 service nova] [instance: f89bf3f8-7ecc-4ada-af50-6585c11bb303] Received unexpected event network-vif-plugged-22da36aa-5f45-4489-b1f1-1095d5d1b2b6 for instance with vm_state deleted and task_state None.
Oct 20 10:53:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:53:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:04 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:54:04 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 10:54:04 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] There are 0 instances to clean {{(pid=74311) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 10:54:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:07 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:54:07 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74311) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 10:54:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:26 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:54:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:54:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:54:26 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Didn't find any instances for network info cache update. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 10:54:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:54:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:54:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:54:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:54:39 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:54:39 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:54:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:54:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:54:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:54:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:54:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:39 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:54:44 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:54:44 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:54:44 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.069984436035156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74311) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74311) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 10:54:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:45 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:54:46 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:50 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:50 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:54:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:56 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:54:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:55:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:55:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:55:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:55:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:55:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:55:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:55:28 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:55:28 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:55:28 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Didn't find any instances for network info cache update. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 10:55:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:55:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:55:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:55:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:55:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:55:41 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:55:41 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:55:41 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:55:44 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:55:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:55:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:55:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:55:44 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:55:44 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:55:44 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:55:44 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=25.107582092285156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:55:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:55:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:55:44 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:55:44 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:55:44 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:55:44 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:55:44 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:55:44 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.114s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:55:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:55:45 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:55:45 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:55:45 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:55:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:55:54 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:55:59 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:56:04 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:56:09 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:56:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:56:14 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:56:19 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:56:24 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 10:56:28 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:56:28 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Starting heal instance info cache {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 10:56:28 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Rebuilding the list of instances to heal {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 10:56:28 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Didn't find any instances for network info cache update. {{(pid=74311) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 10:56:29 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:56:29 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:56:29 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:56:34 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:56:39 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:56:42 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:56:42 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:56:43 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:56:44 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 10:56:45 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:56:45 user nova-compute[74311]: DEBUG nova.compute.manager [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74311) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 10:56:46 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:56:46 user nova-compute[74311]: DEBUG oslo_service.periodic_task [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74311) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 10:56:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:56:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:56:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:56:46 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Auditing locally available compute resources for user (node: user) {{(pid=74311) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 10:56:46 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:56:46 user nova-compute[74311]: WARNING nova.virt.libvirt.driver [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 10:56:46 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Hypervisor/Node resource view: name=user free_ram=9220MB free_disk=25.105697631835938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}] {{(pid=74311) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 10:56:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 10:56:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 10:56:46 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 10:56:46 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74311) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 10:56:46 user nova-compute[74311]: DEBUG nova.compute.provider_tree [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed in ProviderTree for provider: 77cac819-3c22-4fec-a59d-0525ac40a90b {{(pid=74311) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 10:56:46 user nova-compute[74311]: DEBUG nova.scheduler.client.report [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Inventory has not changed for provider 77cac819-3c22-4fec-a59d-0525ac40a90b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74311) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 10:56:46 user nova-compute[74311]: DEBUG nova.compute.resource_tracker [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Compute_service record updated for user:user {{(pid=74311) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 10:56:46 user nova-compute[74311]: DEBUG oslo_concurrency.lockutils [None req-34e9ac9f-5e45-4dce-8ce6-c7be701cf394 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74311) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 10:56:49 user nova-compute[74311]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74311) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}